☰
Navigation :

CSV Source Configuration

Configuration Properties

Properties for the CSV Source are provided inside the configuration of a CSV Source. For example: Local CSV Source.

Key Type Default Description
parser-threads int Half of the available processors, but no more than eight and not less than two Sets the number of threads that run the parsing in parallel.
buffer-size DataSize 64KB Sets the size of a byte buffer.
synchronous-mode boolean false In synchronous mode, the processing of a new file can only start when all the activity related to the previous file has been completed.
accepts-topic-overrides boolean false Whether this source is allowed to accept Topic Overrides in the Load Request.

YAML Example 

dlc:
  csv:
    local:
      sources:
        source:
            root-base-dir: 'data'
            source-properties:
              synchronous-mode: false
              parser-threads: 3

Java Configuration

CsvSourceConfiguration Java object can be used for configuration in Java. The object is used in the configuration of a CSV Topic.

For more information, see the Atoti Server documentation on ICsvSourceConfiguration.

Java Example 

@Bean
LocalCsvSourceDescription source() {
    return LocalCsvSourceDescription.builder("source", "data")
            .sourceConfiguration(
                    CsvSourceConfiguration.builder()
                            .parserThreads(3)
                            .synchronousMode(false)
                            .build()
            )
            .build();
}