Navigation :

CSV Source Properties

Configuration Properties

Properties for the CSV Source are provided inside the configuration of a CSV Source. For example: Local CSV Source.

Key	Type	Default	Description
parser-threads	int	Half of the available processors, but no more than eight and not less than two	Sets the number of threads that run the parsing in parallel.
buffer-size	DataSize	64KB	Sets the size of a byte buffer.
synchronous-mode	boolean	false	In synchronous mode, the processing of a new file can only start when all the activity related to the previous file has been completed.
accepts-topic-overrides	boolean	false	Whether this source is allowed to accept Topic Overrides in the request.

Example

dlc:
  local-csv-sources:
    - source-name: source
      root-base-dir: 'data'
      source-properties:
        synchronous-mode: false
        parser-threads: 3

Java Configuration

CsvSourceConfiguration java object can be used for configuration in Java. The object is used in the configuration of a CSV Topic.

For more information, see the Atoti Server documentation on ICsvSourceConfiguration.

Example

@Bean
LocalCsvSourceDescription source() {
    return LocalCsvSourceDescription.builder("source", "data")
            .sourceConfiguration(
                    CsvSourceConfiguration.builder()
                            .parserThreads(3)
                            .synchronousMode(false)
                            .build()
            )
            .build();
}