Skip to main content

Customize Table

DirectQuery allows to customize the table(s) retrieved from the remote database.

Typically, you would have discovered the table from the remote database, with a code similar to:

TableDescription salesTable =
    discoverer.discoverTable(new ClickhouseTableId("TUTORIAL", "SALES"));
TableDescription productsTable =
    discoverer.discoverTable(new ClickhouseTableId("TUTORIAL", "PRODUCTS"));

However, you might not be satisfied with the current data structure. Note that all the changes are done in the local data structure, and nothing is written in the remote database.

Customize a table​

Each table can be customized.

Rename the table​

For instance, you can rename the table:

salesTable = salesTable.toBuilder().localName("Sales").build();
productsTable = productsTable.toBuilder().localName("Products").build();

Select a subset of fields​

The remote table might also contain some fields which are not relevant for the application. It's possible to select the fields you want:

productsTable =
    TableDescriptionUtils.selectFields(
        productsTable, List.of("PRODUCT_ID", "CATEGORY", "SIZE", "PURCHASE_PRICE", "BRAND"));

Set the keys​

It is also possible to set the key(s) when it is not set properly.

salesTable = salesTable.toBuilder().keyFieldNames(List.of("SALE_ID")).build();

Set the clustering fields​

Clustering fields can also be set.

salesTable = salesTable.toBuilder().clusteringFields(Set.of("SHOP")).build();

Customize a field​

Each field in a table can be customized as well. As a general note, do not forget to update the field in the table.

Rename the field​

The field can be renamed:

salesTable =
    TableDescriptionUtils.updateField(
        salesTable, "PRODUCT", f -> f.toBuilder().localName("PRODUCT_ID").build());

Change the type​

The type can also be updated:

productsTable =
    TableDescriptionUtils.updateField(
        productsTable,
        "PURCHASE_PRICE",
        f -> FieldDescription.changeFieldType((FieldDescription) f, StandardTypes.FLOAT));

Make field non nullable​

You can mark explicitly the field as non-nullable in your application:

final FieldDescription notYetNonNullableShopField =
    (FieldDescription) salesTable.getField("SHOP");
final IFieldType nonNullableType =
    FieldType.setNonNullable(notYetNonNullableShopField.getType());
final AFieldDescription nonNullableShopField =
    FieldDescription.changeFieldType(notYetNonNullableShopField, nonNullableType);
final TableDescription updatedSalesTableWithNonNullableField =
    TableDescriptionUtils.updateField(salesTable, "SHOP", nonNullableShopField);

This only impacts the local model, not the external database. However, if possible, fields should be marked as non-nullable directly in the database, so the database could enforce it.

Use a custom type​

This is a bit more complex, and can be found in the dedicated guide.

Naming convention​

Instead of renaming the fields one by one it is possible to apply a naming convention to rename the table and the fields.

Some usual naming conventions can be found in the NamingConventions utility class.

For instance, it can be used to switch everything to lower case, upper case or capitalized:

productsTable =
    TableDescriptionUtils.applyNaming(
        productsTable, NamingConventions.LOWER_CASE_NAMING_CONVENTION);

or to change several names at once based on a mapping:

salesTable =
    TableDescriptionUtils.applyNaming(
        salesTable, NamingConventions.fromMapping(Map.of("DATE", "Time", "SALE_ID", "Id")));

For more custom renaming it is possible to implement a custom INamingConvention using NamingConventions.from.