Updates AWS, GCP and Azure to latest available components across the board.
Version bumps
- Collector to v3.7.0
- Enrich to v6.2.1
- Iglu Server to v0.14.1
- S3 Loader to v3.0.0 (AWS only)
- Snowflake Streaming Loader to v0.5.1 (AWS only)
- RDB Loader (Redshift + Databricks) to v6.1.5 (AWS only)
- BigQuery Loader to v2.0.1 (GCP only)
- Lake Loader to v0.7.0 (Azure only)
Future proofing
- Using Amazon Linux 2023 on AWS
- Using Ubuntu 24.04 on Azure and GCP
Breaking changes
- Collector by default now leverages Compression as default which requires Enrich v6+ to be able to decode the compressed payloads. Ensure to upgrade both applications to ensure data-flow doesn't stop.
- Removal of S3 Loader for RAW data from AWS.
- Removal of Postgres Loader from AWS and GCP - we are no longer maintaining this module going forward.
- Removal of Snowflake RDB Loader from AWS and Azure - we are no longer maintaining this module going forward.
Bug fixes
- Azure Iglu Server can now be deployed again with an upgraded base
vnetandpostgresmodule which supports the Flexible Postgres database offering from Azure