Navigation :
test ../../../../ test data-connectors-overview.html
Data Connectors Overview
test ../../../../ test data-connectors-overview/whats-new.html
- What's New
test ../../../../ test changelog.html
Release and migration notes
test ../../../../ test dee-overview.html
Data Extraction Engine
test ../../../../ test dlc-overview.html
Data Load Controller
test ../../../../ test dlc-overview/configuration.html
-
DLC Configuration
test ../../../../ test dlc-overview/transactions.html
-
DLC Transactions
test ../../../../ test dlc-overview/responses.html
-
DLC Responses
test ../../../../ test dlc-overview/design-and-customizations.html
-
DLC Design and Customizations
test ../../../../ test dlc-overview/user-guide.html
-
User Guide
test ../../../../ test dlc-overview/user-guide/rest-api.html
--
DLC REST API
test ../../../../ test dlc-overview/user-guide/dlc-rest-api-exmaple.html
-- DLC REST API Example
test ../../../../ test dlc-overview/user-guide/requests.html
--
DLC Requests
test ../../../../ test dlc-overview/user-guide/requests/data-loading.html
---
Loading data with the DLC
test ../../../../ test dlc-overview/user-guide/requests/data-loading/csv-listen.html
---- CSV Listen Sources
test ../../../../ test dlc-overview/user-guide/requests/data-loading/fetching-sources.html
---- Load from Fetching Sources
test ../../../../ test dlc-overview/user-guide/requests/data-loading/messaging-sources.html
---- Messaging source - Kafka and RabbitMQ
test ../../../../ test dlc-overview/user-guide/requests/unload-data.html
--- Unloading data with the DLC
test ../../../../ test dlc-overview/user-guide/requests/status-check.html
--- Checking Request Status
test ../../../../ test dlc-overview/user-guide/responses.html
--
DLC Responses
test ../../../../ test dlc-overview/dlc-extensions.html
-
DLC Extensions
CSV Listen Sources
There are two Operations when performing real time data-loading, START_LISTENING
and STOP_LISTENING
.
Below is an example of a JSON request to perform a START_LISTENING
(listening) operation from a CSV Listening Source. This request starts the file listener, listening for changes in the given file system:
{
"operation" :"START_LISTEN" ,
"topics" :["RealTimeTrades" ],
"scope" : {
"CobDate" : "2019-01-01"
}
}
When loading data from a CSV source, the scope in the request payload resolves to a sub-folder
in the data root directory.
Below is an example of a request to perform a STOP_LISTENING
(listening) operation from a CSV real time source. This request closes or shuts down the file listener; no more changes to the file system will be registered and published:
{
"operation" :"STOP_LISTEN" ,
"topics" :["RealTimeTrades" ],
"scope" : {
"CobDate" : "null"
}
}
The CodDate scope is null because the stopListening()
implementation does NOT accept a scope parameter.