Skip to main content

​
Configuration properties

Properties for the CSV Source are provided inside the configuration of a CSV Source. For example: Local CSV Source.
KeyTypeDefaultDescription
parser-threadsintHalf of the available processors, but no more than eight and not less than twoSets the number of threads that run the parsing in parallel.
buffer-sizeDataSize64KBSets the size of a byte buffer.
synchronous-modebooleanfalseIn synchronous mode, the processing of a new file can only start when all the activity related to the previous file has been completed.
accepts-topic-overridesbooleanfalseWhether this source is allowed to accept Topic Overrides in the Load Request.

​
YAML example

dlc:
  csv:
    local:
      sources:
        source:
            root-base-dir: 'data'
            source-properties:
              synchronous-mode: false
              parser-threads: 3

​
Java configuration

CsvSourceConfiguration Java object can be used for configuration in Java. The object is used in the configuration of a CSV Topic. For more information, see the Atoti Server documentation on ICsvSourceConfiguration.

​
Java example

@Bean
LocalCsvSourceDescription source() {
    return LocalCsvSourceDescription.builder("source", "data")
            .sourceConfiguration(
                    CsvSourceConfiguration.builder()
                            .parserThreads(3)
                            .synchronousMode(false)
                            .build()
            )
            .build();
}