CSV source configuration

Configuration properties

Properties for the CSV Source are provided inside the configuration of a CSV Source. For example: Local CSV Source.

Key	Type	Default	Description
parser-threads	int	Half of the available processors, but no more than eight and not less than two	Sets the number of threads that run the parsing in parallel.
buffer-size	DataSize	64KB	Sets the size of a byte buffer.
synchronous-mode	boolean	false	In synchronous mode, the processing of a new file can only start when all the activity related to the previous file has been completed.
accepts-topic-overrides	boolean	false	Whether this source is allowed to accept Topic Overrides in the Load Request.

YAML example

dlc:
  csv:
    local:
      sources:
        source:
            root-base-dir: 'data'
            source-properties:
              synchronous-mode: false
              parser-threads: 3

Java configuration

CsvSourceConfiguration Java object can be used for configuration in Java. The object is used in the configuration of a CSV Topic. For more information, see the Atoti Server documentation on ICsvSourceConfiguration.

Java example

@Bean
LocalCsvSourceDescription source() {
    return LocalCsvSourceDescription.builder("source", "data")
            .sourceConfiguration(
                    CsvSourceConfiguration.builder()
                            .parserThreads(3)
                            .synchronousMode(false)
                            .build()
            )
            .build();
}

CSV parser

JDBC

⌘I

Operations

Request API

Configuration

Components

Functional

Extensions

CSV source configuration

Configuration properties

YAML example

Java configuration

Java example

​Configuration properties

​YAML example

​Java configuration

​Java example

Configuration properties

YAML example

Java configuration

Java example