Migration notes from 5.0 pre-releases

This page explains the changes since 5.0.0-M1 , plus any changes required to migrate from these early releases of Atoti Data Connectors.

Changes since 5.0.0-M1

Added

Issue Key	Details
BAST-1246	Added implicit parsing column calculators which can be overridden via ParserOverrides bean
BAST-1249	Added cloud (Azure, AWS, GCP) support for CSV.
BAST-1153	Added support for JDBC source type.
BAST-1177	Added support for UNLOAD operation.
BAST-1154	Added support for listening operations (START_LISTEN, LISTEN_STATUS, STOP_LISTEN).
BAST-1151	Added support for Avro and Parquet.

Changed

Issue Key	Details
BAST-1162	Requests now enforce that every topic belongs to only one source. You can specify the source / source type in the request.
BAST-1262	Changed the structure of the configuration properties.

Fixed issues introduced in 5.0.0-M1

Issue Key	Details
BAST-1238	Correctly propagate errors to the IDlcResponse object & type requests and responses.

Migrate to 5.0.0-M2

Upgrading from version 5.0.0-M1, see Atoti Data Connectors 5.0 Release Notes.

Atoti Data Connectors uses Atoti Server 6.1.1 }. For new features and fixes included in these releases, please see the release notes for Atoti Server.

Breaking Changes

• Configuration Properties : The structure of the configuration properties has changed.
• Single Source per Topic : Requests now enforce that every topic belongs to only one source. You can specify the source / source type in the request.

Headline announcement

See Atoti Data Connectors 5.0.0 Migration Notes for details on:

• Implicit Parsing Column Calculators: Added implicit parsing column calculators which can be overridden via ParserOverrides bean. This means you no longer need to keep CsvColumnParsers in your channel description.
• CSV Cloud support: Added support for loading CSV files from Azure, AWS, and GCP.
• UNLOAD Operation: Added support for UNLOAD operation.
• Listening Operations: Added support for listening operations (START_LISTEN, LISTEN_STATUS, STOP_LISTEN).
• Avro & Parquet: Added support for Avro and Parquet.

Dependency Changes

None.

Configuration files

The format of the configuration properties has changed.

Previous	New	Additional Notes
dlc.local-csv-sources	dlc.csv.local.sources	Sources were previously a list, now they are a map from source name to description
dlc.csv-topics	dlc.csv.topics

Services

No changes.

Other Changes

Operations can now be extended directly rather than via the IDlcOperation interface. DlcLoadRequest.builder().operation("LOAD") should be replaced with DlcLoadRequest.builder()