Changelog

For information on upgrading from previous versions, see the Atoti Data Connectors Migration Notes

5.0.0-M1

2024-12-12

Summary

The DLC has been completely re-written. Here are a few highlights of the new features:

• Out-of-the-box functionality: Spring Auto Configuration enables the DLC out-of-the-box functionality once the DLC is imported into a project, therefore requiring no further configuration.
• Simplified configuration: The DLC configuration has been simplified. Java configuration is now done via Spring beans, and we have added configuration through the use of Configuration properties.
• Familiar requests: DLC requests should be familiar but now have additional features, while supporting existing ones (scope, branch, etc.)
• Dynamic creation of Atoti Objects: Sources, Topics, and channels are now created at request time, allowing scope to be applied to topic, tuple publishers and column calculators.
• Separate file format from data processing: File formats have been separated from data processing layers, so that clients can own file formats while data processing can be changed freely by projects without impacting file formats.

For more information on the new DLC, see the Getting Started guide.

Dependency versions

Changed

4.2.0-AS6.1

2024-10-24

Summary

• Upgraded to Atoti Server 6.1: This release of Atoti Data Connectors is intended for you to use as a bridge while upgrading to Atoti Server 6.1 and should be replaced with the soon-to-be released Atoti Data Connectors 5.0.
• Removed CVE-2024-28752 coming from a cxf-rt-rs-client import: This import has been removed from the Data-Connectors dependencies.
• Upgraded to Java 21: We have upgraded from Java 17 to Java 21.

Upgrade to AS6.1

Atoti Server 6.1 introduces a new API structure that finalizes the Sources. The DLC has extended the Sources so we can pick and choose which files to load based on the DLC’s Scope. Atoti Server 6.1 has added new Topic features to allow us to load specific files without the need to extend the core Sources.

Consequently, the DLC Sources no longer extend the core Source, but instead delegate all API calls to a local delegate instance of the Source.

Known issues

Dependency versions

Changed

Removed

4.2.0-AP6.0

2024-06-20

Summary

• Allow Listening on Fetch Topics: The DLC now allows Listening on defined Fetch Topics.

Dependency versions

Added

Listening on Fetch Topics

The DLC now allows Listening on defined Fetch Topics. With this you can start listening on a Fetch Topic. There is no need to register a new Listen Source nor define Listen Topics.

When Listening on a Fetch Topic, a hybrid ListenOnFetchSource and topics will be created that will listen for file updates and process them in a batch Fetch operation.

For more on how the Listen-on-Fetch mechanism works and what can be configured, see the Listen-on-Fetch section.

4.1.1-AP6.0-sb3

2024-04-22

Summary

• Fixed DEE CSV Search Facts Queries: The CSV Search Facts Queries have been fixed in this version.

Known issues

None.

Dependency versions

Fixed

4.1.0

2024-04-18

Summary

• Removed DEE Remoting Services : The remoting services have been removed in response to vulnerability CVE-2016-1000027 to prevent potential remote code execution. See the migration notes for list of removed services.
• Upgrade to Java 17: Upgraded to use Java 17.
• Upgraded to Spring Boot 3 : Upgraded to use Spring Boot 3. With this, we have also updated to use Open Telemetry for tracing.

Known issues

• DEE CSV Search Facts Queries: The CSV Search Facts Queires fail in the DEE.

Dependency versions

Changed

Removed

4.0.5

2024-05-09

Summary

• Fixed DEE CSV Search Facts Queries: The CSV Search Facts Queries have been fixed in this version.

Known issues

Dependency versions

Fixed

4.0.4

2024-04-18

Summary

• GAQ Slicer Level Handling: Configuration property has been fixed.

Known issues

Workaround for mishandled exceptions in DEE (PST-953)

The javax library has been replaced with jakarta. The RuntimeDelegate that javax/jakarta use may not be available depending on the dependencies in your project. This can cause exceptions in the DEE to be consumed when the DEE tries to wrap them into a Response object.

To resolve this, add the following dependencies to your application:

<dependency>
	<groupId>javax.ws.rs</groupId>
	<artifactId>javax.ws.rs-api</artifactId>
	<version>2.1.1</version>
</dependency>
<dependency>
	<groupId>org.glassfish.jersey.core</groupId>
	<artifactId>jersey-common</artifactId>
</dependency>

Dependency versions

Fixed

4.0.3

2023-10-30

Summary

• GAQ Slicer Level Handling: Configuration property has been added to adjust how members of slicer levels are handled in Get Aggregates Queries DEE orders.

Known issues

Workaround for mishandled exceptions in DEE (PST-953)

The javax library has been replaced with jakarta. The RuntimeDelegate that javax/jakarta use may not be available depending on the dependencies in your project. This can cause exceptions in the DEE to be consumed when the DEE tries to wrap them into a Response object.

A resolution may be to add the following dependencies to your application:

<dependency>
	<groupId>javax.ws.rs</groupId>
	<artifactId>javax.ws.rs-api</artifactId>
	<version>2.1.1</version>
</dependency>
<dependency>
	<groupId>org.glassfish.jersey.core</groupId>
	<artifactId>jersey-common</artifactId>
</dependency>

Dependency versions

Added

4.0.2

2023-08-09

Summary

• DLC and DEE services discoverable in /versions/rest endpoint : The DLC and DEE services are discoverable in the /versions/rest REST service. See REST Service Version for more information.
• Deprecated internal REST services: Some internal REST services have been deprecated. See the Migration Notes for more information.

Fixed

• PST-943: Deprecated Internal endpoints and cleaned up version endpoint fields.

Known Issues

None.

4.0.1

2023-02-17

Summary

ActivePivot 6.0.2 Support : Support for ActivePivot 6.0.2 and up.

Fixed

• PIVOT-5950: Datastore Sizes will be printed when a DLC Load / Unload operation is performed.

Known Issues

No known issues at this time.

4.0.0

2022-12-13

Summary

ActivePivot 6.0 Support : Support for ActivePivot 6.0 and up.

Known issues

ActivePivot 6.0.1 will cause issues with the DLC Listen topics.

Added

• DlcCSVSourceConfiguration: See New DLC Source Configuration Object for more info.

Changed

Changed some of the Rest Services to better align with Spring MVC and removed exposing Rest Services through ActivePivot’s ASpringRestServerConfig. Instead, we now expose Rest services by extending Spring’s ASpringVersionedRestServerConfig and WebMvcConfigurer classes. You can find a complete list of classes that have been renamed or refactored in the Renamed Classes section of the Migration notes.

Removed

The following classes and features have been removed:

Prerequisites

The following requirements are no longer required as of Data Connectors 4.0.0:

• No longer need a ServicesConfigBeanPostProcessor.class in your ApplicationConfig.
• No longer need to specify the "com.activeviam.apm" path in your Registry as the APM has been integrated into the core ActivePivot.

Features

• CFX support
• XML support for DEE order definitions
• DEE Remoting Service

3.0.2

2023-02-02

Summary

• Added support for AP 5.11.5 as a core breaking change was introduced. See 3.0.2 Migration Notes.

3.0.1

2022-07-07

Summary

• Small fix to fix reading DEE Template Orders located within JAR files.

Known Issues

• Updated 2023-02-02 Data Connectors 3.0.1-AP5.11 does not work with AP 5.11.5+. You will need to upgrade to Data Connectors 3.0.2-AP5.11.

3.0.0

2022-02-04

Support for ActivePivot 5.11.

Summary

• Support for ActivePivot 5.11.0 : Data-Connectors has been upgraded to support ActivePivot 5.11+.
• Migrated to using ActivePivot’s APM : Migrated to use ActivePivot 5.11’s included APM.

Known Issues

The name of the bean used to initialize the APM’s Tracing APMTracingConfig.APM_TRACING has private access in AP5.11.0 & 5.11.1. For now, you can use the value of the String in your @DependsOn statement for your initial load.

Here is an example:

    @Bean
    @DependsOn(value = {"APM_TRACING"})
    public Void initialLoad() {
        // Load data here...
    }

Dependency Version Updates

Fixed

2.2.2

2022-12-10

Summary

• Added support for template place holders in GetAggregatesQuery
• Added new DlcMessageHandler to catch exceptions thrown during CSV tuple publishing. Usage is explained in CSV Configuration and examples of creating custom IMessageHandlers can be found in Creating Custom CSV Message Handlers section. For migrating to using the new DlcMessageHandler please read the Migration Notes

Added

Fixed

2.2.1

2021-11-23

Summary

• Removed unused dependency that broke compatibility with Excel.

Fixed

2.2.0

2021-10-19

Summary

• Add APM Monitoring to DEE : Added JMX properties to allow for additional logging of dee tasks.

Dependency versions

Known Issues

• APM needs to be upgraded to 10.0.1 in order to prevent issue where parsing of large files will cause null SpanContext value for HealthEvents, leading to the DLC not properly adding events to the Cache. This can be avoided by excluding APM from Data-Connectors then re-importing the correct 5.10.1 version. Example below:

<dependency>
  <groupId>com.activeviam.io</groupId>
  <artifactId>data-connectors-csv</artifactId>
  <version>2.2.0-AP5.10</version>
  <exclusions>
    <exclusion>
      <groupId>com.activeviam.lib</groupId>
      <artifactId>activepivot-apm</artifactId>
    </exclusion>
  </exclusions>
</dependency>

<dependency>
    <groupId>com.activeviam.lib</groupId>
    <artifactId>activepivot-apm</artifactId>
    <version>5.10.1</version>
</dependency>

Added

Changed

Removed

• com.activeviam.io.monitoring.LoggingUtils
  • Replaced by com.activeviam.apm.logging.impl.LoggingUtils

Fixed

2.1.0

Fixed

Added

Changed

2.0.1

Fixed

2.0.0

Known Issues

• Parsing of large files will cause null SpanContext value for HealthEvents, leading to the DLC not properly adding events to the Cache.

Changed

• AP version has been updated to 5.10.1
• The Azure Cloud Source has migrated its dependency to the Azure Blob Storage SDK from v8 to v12

1.2.1

Fixed

1.2.0

Added

Fixed

Changed

1.1.0

Fixed

Added