Navigation :
application-dlc-azure-csv.yaml
File purpose
This profile is used to configure an Azure CSV source that will be used to for loading data from the Azure Blob Storage.
File location
The file is located in the folder mr-application\src\main\resources.
File values
| Key |
Value |
Description |
| dlc |
|
|
| dlc.enabled |
true |
This enables DLC for data loading in the application. |
| dlc.create-default-cloud-client |
|
|
| dlc.create-default-cloud-client.azure |
true |
This gets DLC to automatically configure an Azure client used to load data. It requires -Ddlc.azure.connection-string to be passed at runtime. |
| dlc.csv |
|
|
| dlc.csv.azure |
|
|
| dlc.csv.azure.sources |
|
|
| dlc.csv.azure.azure-csv-source |
|
|
| dlc.csv.azure.azure-csv-source.container |
${AZURE_CONTAINER} |
The Blob Storage container that holds your data, provided as an environment variable. |
| dlc.csv.azure.azure-csv-source.prefix |
${AZURE_PREFIX}/#{AsOfDate} |
The prefix for your data in the container. The AsOfDate scope is included. |