The limits-data-load.properties file defines the file loading formats and pattern matching for the input files to the datastore.
File location
The file is located in the folder limits-starter\src\main\resources.
File values
Property
Value
Description
default.csvSource.buffer.size
1024
CSV buffer size in KB.
default.csvSource.parser.threads
8
Specifies the number of threads to be used for data loading.
default.csvSource.synchronous.parsing.mode
false
Synchronous parsing mode.
default.topic.file.number.skipped.lines
1
The number of skipped lines.
default.topic.accept.incomplete.lines
false
Specifies whether incomplete CSV lines are accepted.
default.topic.accept.overflow.lines
false
Specifies whether overflowing CSV lines are accepted.
default.topic.parser.column.separator
,
Parser column separator.
topic.parser.column.separator.CrifDataParameters
,
The separator for the CRIF data files. The default separator is tab.
default.topic.parser.process.quotes
true
Enables/disables using the available CPU number to spawn off the parser threads. When set to false, the thread number specified in default.csvSource.parser.threads is used.