Local CSV source

The root directory is set through the root-base-dir property, which supports scope parameter placeholders. The DLC ensures that only files within that source can be loaded.

Configuration properties

Properties for a Local CSV Source are defined by name in the dlc.csv.local.sources namespace, and are picked up as configurations for the DLC.

Key	Required	Type	Description
root-base-dir	Y	`String`	Root base directory. Can include Scope Parameters. Example `#{SCOPE_PARAM}`
source-properties		`CsvSourceConfigurationProperties`	CSV Source Configuration
topics-to-include		`Set<String>`	Topics to include. See source to topic matching.
topics-to-exclude		`Set<String>`	Topics to exclude. See source to topic matching.
accepts-topic-overrides		`Boolean`	Whether this source is allowed to accept Topic Overrides in the Load Request.

YAML example

dlc:
  csv:
    local:
      sources:
        localCsvSource:
          root-base-dir: data
        datedSource:
          root-base-dir: data/#{AS_OF_DATE}

Java configuration

LocalCsvSourceDescription Spring Beans are picked up as configurations for the DLC.

Parameter	Required	Type	Description
name	Y	`String`	Name of the source.
rootBaseDir	Y	`String`	Root base directory.
sourceConfiguration		`CsvSourceConfiguration`	CSV Source Configuration
topicsToInclude		`Set<String>`	Topics to include. See source to topic matching.
topicsToExclude		`Set<String>`	Topics to exclude. See source to topic matching.
acceptsTopicOverrides		`Boolean`	Whether this source is allowed to accept Topic Overrides in the Load Request.

Java example

@Bean
LocalCsvSourceDescription source() {
    return LocalCsvSourceDescription.builder("localCsvSource", "data")
            .build();
}

@Bean
LocalCsvSourceDescription datedSource() {
    return LocalCsvSourceDescription.builder("datedSource", "data/#{AS_OF_DATE}")
            .build();
}

CSV

AWS CSV source

⌘I

Operations

Request API

Configuration

Components

Functional

Extensions

Configuration properties

YAML example

Java configuration

Java example

​Configuration properties

​YAML example

​Java configuration

​Java example

Configuration properties

YAML example

Java configuration

Java example