Adding Custom Data Loading

This section describes how to add custom data-loading logic in Atoti Limits. The primary use cases are:

• Customizing the CSV sources
• Customizing the Data Load Controller
• Customizing the tuple publishers

Customizing the CSV source

This section shows how the CSV Source Config can be overridden with the ICSVSourceConfig interface. Some potential use cases are adding new CSV topics or updating the CSVParserConfiguration for existing topics.

Customizing the Data Load Controller

This section shows how the Data Load Controller can be overridden with the IDataLoadControllerConfig interface. Some potential use cases are registering new StoreMessageChannel objects to the DataLoadController, consuming new data from different sources.

Customizing the Tuple Publishers

This section introduces three new interfaces:

• IAsOfDateTuplePublisher: interface for publishing to the AsOfDate datastore
• ILimitTuplePublisher: interface for publishing to the Limits and LimitStructures datastores
• IIncidentTuplePublisher: interface for publishing to the Incidents datastore

Potential use cases with these interfaces are publishing data from a different data source (S3, AzureBlob, etc.) or adding custom validation to incoming data before being committed to the target datastores.