Changelog

For user-facing changes, refer to the What’s New page. For information on upgrading from previous versions, see the Data Connectors Migration Notes

3.0.2

2023-02-02

Summary

3.0.1

2022-07-07

Summary

  • Small fix to fix reading DEE Template Orders located within JAR files.

Known Issues

  • Updated 2023-02-02 DataConnectors 3.0.1-AP5.11 does not work with AP 5.11.5+. You will need to upgrade to DataConnectors 3.0.2-AP5.11.

3.0.0

2022-02-04

Support for ActivePivot 5.11.

Summary

  • Support for ActivePivot 5.11.0 : Data-Connectors has been upgraded to support ActivePivot 5.11+.
  • Migrated to using ActivePivot’s APM : Migrated to use ActivePivot 5.11’s included APM.

Known Issues

The name of the bean used to initialize the APM’s Tracing APMTracingConfig.APM_TRACING has private access in AP5.11.0 & 5.11.1. For now, you can use the value of the String in your @DependsOn statement for your initial load.

Here is an example:

    @Bean
    @DependsOn(value = {"APM_TRACING"})
    public Void initialLoad() {
        // Load data here...
    }

Dependency Version Updates

Component Version
ActivePivot 5.11.0
Spring 2.6.1
Kafka 3.1.0
Avro 1.11.0

Fixed

Issue Details
TransactionTaskUtil.getExceptionEventsForTask() returned empty list getExceptionEventsForTask(taskName) now returns a collection of failure events.

2.2.2

2022-12-10

Summary

  • Added support for template place holders in GetAggregatesQuery
  • Added new DlcMessageHandler to catch exceptions thrown during CSV tuple publishing. Usage is explained in CSV Configuration and examples of creating custom IMessageHandlers can be found in Creating Custom CSV Message Handlers section. For migrating to using the new DlcMessageHandler please read the Migration Notes

Added

Issue Key Details
PST-757 Added support for template place holders in GetAggregatesQuery

Fixed

Issue Key Details
PST-747 Fixed issue where DLC would throw exception when Stop Listening on a Topic-Alias or on multiple Topics.
PST-717 Fixed issue where DLC was not aware of errors thrown during CSV Tuple Publishing.
PST-749 Allow DEE parameter formatNAToEmpty to work with all extraction queries (ie: SearchFactsQueries).
Class Cast Exception in DEE on failing orders Removed ClassCastException in ADataExtractionRestService.getTaskIds that caused DEE error messages to get eaten.

2.2.1

2021-11-23

Summary

  • Removed unused dependency that broke compatibility with Excel.

Fixed

Issue Key Details
PST-725 Removed unused dependency that broke compatibility with Excel.

2.2.0

2021-10-19

Summary

  • Add APM Monitoring to DEE : Added JMX properties to allow for additional logging of dee tasks.

Dependency versions

Component Version
ActivePivot 5.9.6
Java JDK11

Known Issues

  • APM needs to be upgraded to 10.0.1 in order to prevent issue where parsing of large files will cause null TraceContext value for HealthEvents, leading to the DLC not properly adding events to the Cache. This can be avoided by excluding APM from Data-Connectors then re-importing the correct 5.10.1 version. Example below:
<dependency>
  <groupId>com.activeviam.io</groupId>
  <artifactId>data-connectors-csv</artifactId>
  <version>2.2.0-AP5.10</version>
  <exclusions>
    <exclusion>
      <groupId>com.activeviam.lib</groupId>
      <artifactId>activepivot-apm</artifactId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
    <groupId>com.activeviam.lib</groupId>
    <artifactId>activepivot-apm</artifactId>
    <version>5.10.1</version>
</dependency>

Added

Issue Key Details
PST-733 Added APM Monitoring to DEE

Changed

Issue Key Details
PST-737 Upgraded APM Version to 5.10

Removed

  • com.activeviam.io.monitoring.LoggingUtils
    • Replaced by com.activeviam.apm.logging.impl.LoggingUtils

Fixed

Issue Key Details
PST-744 Fixed time units used in ADatastoreTransactionTask as the Nanosecond throughput time was in Milliseconds.

2.1.0

Fixed

Issue Key Details
PST-706 Removed NPE when checking if events have errors during Loading or Unloading of data
PST-711 Added safety checks when accessing DLC cache for expired events. Added proper closing of TraceContexts used to trace DLC IExecutionTask

Added

Key Details
PST-667 Added support for Listening on CSV files on the Local and Cloud file system. More can be found on the DLC Real-Time Data Sources page.
PST-712 Added ability to specify Get Aggregate Query exports using Level@Hierarchy@Dimension=Value Location strings. More can be found on Get aggregates query DEE order

Changed

Issue Key Details
PST-703 Removed Deprecation of Enhanced Drillthroughs as we will be keeping the enhanced drillthrough functionality

2.0.1

Fixed

Issue Key Details
PST-708 Updated APM dependency version that was causing the TraceContext of DLC events to be null in the DLC Cache

2.0.0

Known Issues

  • Parsing of large files will cause null TraceContext value for HealthEvents, leading to the DLC not properly adding events to the Cache.

Changed

  • AP version has been updated to 5.10.1
  • The Azure Cloud Source has migrated its dependency to the Azure Blob Storage SDK from v8 to v12

1.2.1

Fixed

Issue Key Details
PST-706 Removed NPE when checking if events have errors during Loading or Unloading of data

1.2.0

Added

Issue Key Details
PST-688 Integrated APM tracing for DLC health events

Fixed

Issue Key Details
PST-685 Fixed DLC response timeTakenMs to show ms instead of nanoseconds
PST-690 Fixed DEE issue in AEnhancedDrillthroughService in case of entries with the same underlying datastore field and entries without dictionaries. Fixed export of vector

Changed

Issue Key Details
PST-684 Removed IScopedFetchSource interface as it causes confusion, and is functionally identical to IFetchingDataSource
PST-670 Added CustomKafkaAvroDeserializerGenericRecord and CustomKafkaAvroDeserializerObjectTuple classes

1.1.0

Fixed

Issue Key Details
BAS-670 Removed NPE thrown when REST endpoint getTaskStatus() called after executing a DEE Order containing a bad MDX

Added

Issue Key Details
PST-662 Product Center’s ParquetParserBuilder has been implemented. This implementation requires AP version 5.9.2+
PST-668 Added ability to customize ordering of Topics within a given request. For more information, see Custom Ordering for Loading Topics