Load Successful Response
Response with no errors
As can be seen below, the response will contain the following details of a successful Response:
Tag | Value |
---|---|
taskName | Name of the task/batch being processed |
timeTakenMs | Total time (in ms) taken to execute the task |
events | List of events with relevant information |
dlcLoadingStatus | Indicates if there is any exception during dlc loading which is different from the top level HTTP status, such as “status”: “success” |
Additionally, the LOAD_SUMMARY event has few more details of interest:
Tag | LOAD_SUMMARY event values |
---|---|
publishedObjectCount | Number of rows that have been successfully loaded. In a normal/no error run, this should be equal to lineCount - nbSkippedLines |
numberSkippedLines | Number of lines of the file skipped from the top (header rows) |
lineCount | Total number of lines in the file |
eventType | The type of the message |
{
"status": "success",
"data": {
"taskName": "1583350468714",
"timeTakenMs": 19503000,
"events": [
{
"threadName": "csv-worker-CsvSource-Bulk-2",
"threadId": 118,
"clazz": "com.qfs.msg.csv.impl.PublicationQueue$1",
"method": "onCompletion",
"lineNumber": 159,
"timeStamp": 1583350476869,
"taskName": "1583350468714",
"level": {
"name": "INFO",
"resourceBundleName": "sun.util.logging.resources.logging",
"localizedName": "INFO"
},
"upTime": 25629,
"file": "C:\\source\\tools\\data-connectors\\data-connectors-csv\\target\\test-classes\\data-samples\\data\\2019-01-01\\products.csv",
"parsingInfo": {
"publishedObjectCount": 16,
"characterCount": 681,
"lineCount": 17,
"byteCount": 683,
"elapsedTime": "PT0.002S",
"aggregatedTime": 1321901,
"aggregatedReadingTime": 504200,
"aggregatedDecodingTime": 47600,
"aggregatedParsingTime": 767900,
"aggregatedPublicationTime": 2201,
"exceptions": [],
"creationTime": "2020-03-04T19:34:36.867Z",
"numberSkippedLines": 1
},
"fileLineNumber": 0,
"tags": [
"parsing",
"csv",
"source"
],
"eventType": "LOAD_SUMMARY"
},
{
"threadId": 0,
"lineNumber": 0,
"timeStamp": 1583350476871,
"taskName": "1583350468714",
"level": {
"name": "INFO",
"resourceBundleName": "sun.util.logging.resources.logging",
"localizedName": "INFO"
},
"upTime": 0,
"message": "[LOAD_SUMMARY][CSV_SOURCE] CsvSource-Bulk completed fetch batch CsvSource-Bulk-1583350476381-#1 in 4ms ( 1 channels { StoreMessageChannel [topic=Products] } and scope {CobDate=2019-01-01} ). 683 bytes (683) parsed into 17 lines (16 records published)). Average throughput: 146 KiB 870 bytes (150374)/s, 3,742 lines parsed/s, 3,522 published records/s.",
"tags": [
"summary",
"health",
"dlc",
"source"
],
"eventType": "SUMMARY"
}
],
"dlcLoadingStatus": "SUCCEED"
}
}