...
Check out the newest features and enhancements we've just released.
v1.
...
3.0 (
...
2022-
...
07-
...
13)
Refactor
Terraform now uses modules
Improved script
build_lambda_deployment_packages.py
Add OSS4ITS Kinesis Data Firehose
Bug fix:
Updated glue jobs by splitting single job into 3
Updated logic for allSubDivs ingest to match stored procedure on RSIS
What's Next
Here are the features and enhancements we're working on... or at least we're thinking about working on them. 🤓
We want you to have a list of all available documentation, wiki pages, Word documents, PDF, etc.
What's Not New
v1.2.2 (2022-03-29)
Bugfix: removed tranformation_ctx from glue job; railroad and failureformdata failed to load
v1.2.1 (2022-02-04)
AWS Glue being used to ingest RSIS files for FRA-ARDS
Created the following resources
jdbc connection to rsis server
Glue crawler to crawl rsis database and create rsis data catalog
Glue rsis database/catalog
glue job for ingest from rsis
scheduled based trigger for job
IAM role for running glue jobs/crawlers
v1.2.0 (2022-01-05)
Features
tar and tar.gz files are now decompressed and extracted during copy to standardized data bucket
Refactor
raw-data_to_standardized-data Lambda code is easier to follow
improved testing scripts/data
v1.1.0 (2021-11-24)
Refactor
Terraform now uses modules
Improved script
build_lambda_deployment_packages.py
Add OSS4ITS Kinesis Data Firehose
v1.0.3 (2021-06-30)
BugFixes
Solved bug that caused gzip extraction to produce empty files.
...