Changelog
For user-facing changes, refer to the What’s New page. For information on upgrading from previous versions, see the Atoti Data Connectors Migration Notes
4.0.5
2024-05-09
Summary
- Fixed DEE CSV Search Facts Queries: The CSV Search Facts Queries have been fixed in this version.
Known issues
| Issue Key | Details |
|---|---|
| PST-953 | Depending on your project’s javax/jakarta dependency, if an exception is raised in the DEE, then a java.lang.NoClassDefFoundError: jakarta/ws/rs/ext/RuntimeDelegate exception may be thrown.See workaround below. |
Dependency versions
| Component | Version |
|---|---|
| Atoti Server | 6.0.2+ |
| Java | JDK11 |
Fixed
| Issue Key | Details |
|---|---|
| PST-1074 | Fixed DEE SearchFactsQueries failing due to missing constructor runtime error. |
4.0.4
2024-04-18
Summary
- GAQ Slicer Level Handling: Configuration property has been fixed. Previously, the value of
dee.get-aggregates-query.use-default-memberswas not being applied properly.
Known issues
| Issue Key | Details |
|---|---|
| PST-953 | Depending on your project’s javax/jakarta dependency, if an exception is raised in the DEE, then a java.lang.NoClassDefFoundError: jakarta/ws/rs/ext/RuntimeDelegate exception may be thrown.See workaround below. |
| PST-1066 | The CSV Search Facts Queries fail in the DEE. |
Workaround for mishandled exceptions in DEE (PST-953)
The javax library has been replaced with jakarta. The RuntimeDelegate that javax/jakarta use may not be available depending on the dependencies in your
project. This can cause exceptions in the DEE to be consumed when the DEE tries to wrap them into a Response object.
To resolve this, add the following dependencies to your application:
<dependency>
<groupId>javax.ws.rs</groupId>
<artifactId>javax.ws.rs-api</artifactId>
<version>2.1.1</version>
</dependency>
<dependency>
<groupId>org.glassfish.jersey.core</groupId>
<artifactId>jersey-common</artifactId>
</dependency>
note
In the future, the DEE will move away from relying on javax/jakarta and instead of its REST services returning Response objects, we will use Spring to
return DTO response objects.
Dependency versions
| Component | Version |
|---|---|
| Atoti Server | 6.0.2+ |
| Java | JDK11 |
Fixed
| Issue Key | Details |
|---|---|
| PST-1066 | Configuration property: dee.get-aggregates-query.use-default-members always uses value of false. |
4.0.3
2023-10-30
Summary
- GAQ Slicer Level Handling: Configuration property has been added to adjust how members of slicer levels are handled in Get Aggregates Queries DEE orders.
Known issues
| Issue Key | Details |
|---|---|
| PST-953 | Depending on your project’s javax/jakarta dependency, if an exception is raised in the DEE, then a java.lang.NoClassDefFoundError: jakarta/ws/rs/ext/RuntimeDelegate exception may be thrown.See workaround below. |
| PST-1066 | Configuration property: dee.get-aggregates-query.use-default-members always uses value of false. |
Workaround for mishandled exceptions in DEE (PST-953)
The javax library has been replaced with jakarta. The RuntimeDelegate that javax/jakarta use may not be available depending on the dependencies in your
project. This can cause exceptions in the DEE to be consumed when the DEE tries to wrap them into a Response object.
A resolution may be to add the following dependencies to your application:
<dependency>
<groupId>javax.ws.rs</groupId>
<artifactId>javax.ws.rs-api</artifactId>
<version>2.1.1</version>
</dependency>
<dependency>
<groupId>org.glassfish.jersey.core</groupId>
<artifactId>jersey-common</artifactId>
</dependency>
note
In future, the DEE will move away from relying on javax/jakarta and instead of its REST services returning Response objects, we will use Spring to
return DTO response objects.
Dependency versions
| Component | Version |
|---|---|
| Atoti Server | 6.0.2+ |
| Java | JDK11 |
Added
| Issue Key | Details |
|---|---|
| PST-962 | Added configuration property for handling Slicer Levels with DEE GAQ. For details, see dee.get-aggregates-query.use-default-members. |
4.0.2
2023-08-09
Summary
- DLC and DEE services discoverable in
/versions/restendpoint : The DLC and DEE services are discoverable in the/versions/restREST service. See REST Service Version for more information. - Deprecated internal REST services: Some internal REST services have been deprecated. See the Migration Notes for more information.
Fixed
- PST-943: Deprecated Internal endpoints and cleaned up versions endpoint fields.
Known Issues
No known issues at this time.
4.0.1
2023-02-17
Summary
ActivePivot 6.0.2 Support : Support for ActivePivot 6.0.2 and up.
Fixed
- PIVOT-5950: Datastore Sizes will be printed when a DLC Load / Unload operation is performed.
Known Issues
No known issues at this time.
4.0.0
2022-12-13
Summary
ActivePivot 6.0 Support : Support for ActivePivot 6.0 and up.
Known issues
ActivePivot 6.0.1 will cause issues with the DLC Listen topics.
Added
DlcCSVSourceConfiguration: See New DLC Source Configuration Object for more info.
Changed
Changed some of the Rest Services to better align with Spring MVC and removed exposing Rest Services through ActivePivot’s ASpringRestServerConfig. Instead, we now expose Rest services by extending Spring’s ASpringVersionedRestServerConfig and WebMvcConfigurer classes. You can find a complete list of classes that have been renamed or refactored in the Renamed Classes section of the Migration notes.
Removed
The following classes and features have been removed:
Prerequisites
The following requirements are no longer required as of Data Connectors 4.0.0:
- No longer need a
ServicesConfigBeanPostProcessor.classin yourApplicationConfig. - No longer need to specify the
"com.activeviam.apm"path in your Registry as the APM has been integrated into the core ActivePivot.
Features
- CFX support
- XML support for DEE order definitions
- DEE Remoting Service
3.0.2
2023-02-02
Summary
- Added support for AP 5.11.5 as a core breaking change was introduced. See 3.0.2 Migration Notes.
3.0.1
2022-07-07
Summary
- Small fix to fix reading DEE Template Orders located within JAR files.
Known Issues
- Updated 2023-02-02 Data Connectors 3.0.1-AP5.11 does not work with AP 5.11.5+. You will need to upgrade to Data Connectors 3.0.2-AP5.11.
3.0.0
2022-02-04
Support for ActivePivot 5.11.
Summary
- Support for ActivePivot 5.11.0 : Data-Connectors has been upgraded to support ActivePivot 5.11+.
- Migrated to using ActivePivot’s APM : Migrated to use ActivePivot 5.11’s included APM.
Known Issues
The name of the bean used to initialize the APM’s Tracing APMTracingConfig.APM_TRACING has private access in AP5.11.0 & 5.11.1. For now, you can use the value of the String in your @DependsOn statement for your initial load.
Here is an example:
@Bean
@DependsOn(value = {"APM_TRACING"})
public Void initialLoad() {
// Load data here...
}
Dependency Version Updates
| Component | Version |
|---|---|
| ActivePivot | 5.11.0 |
| Spring | 2.6.1 |
| Kafka | 3.1.0 |
| Avro | 1.11.0 |
Fixed
| Issue | Details |
|---|---|
TransactionTaskUtil.getExceptionEventsForTask() returned empty list |
getExceptionEventsForTask(taskName) now returns a collection of failure events. |
2.2.2
2022-12-10
Summary
- Added support for template place holders in GetAggregatesQuery
- Added new DlcMessageHandler to catch exceptions thrown during CSV tuple publishing. Usage is explained in CSV Configuration and examples of creating custom
IMessageHandlers can be found in Creating Custom CSV Message Handlers section. For migrating to using the newDlcMessageHandlerplease read the Migration Notes
Added
| Issue Key | Details |
|---|---|
| PST-757 | Added support for template place holders in GetAggregatesQuery |
Fixed
| Issue Key | Details |
|---|---|
| PST-747 | Fixed issue where DLC would throw exception when Stop Listening on a Topic-Alias or on multiple Topics. |
| PST-717 | Fixed issue where DLC was not aware of errors thrown during CSV Tuple Publishing. |
| PST-749 | Allow DEE parameter formatNAToEmpty to work with all extraction queries (ie: SearchFactsQueries). |
| Class Cast Exception in DEE on failing orders | Removed ClassCastException in ADataExtractionRestService.getTaskIds that caused DEE error messages to get eaten. |
2.2.1
2021-11-23
Summary
- Removed unused dependency that broke compatibility with Excel.
Fixed
| Issue Key | Details |
|---|---|
| PST-725 | Removed unused dependency that broke compatibility with Excel. |
2.2.0
2021-10-19
Summary
- Add APM Monitoring to DEE : Added JMX properties to allow for additional logging of dee tasks.
Dependency versions
| Component | Version |
|---|---|
| ActivePivot | 5.9.6 |
| Java | JDK11 |
Known Issues
- APM needs to be upgraded to 10.0.1 in order to prevent issue where parsing of large files will cause null TraceContext value for HealthEvents, leading to the DLC not properly adding events to the Cache. This can be avoided by excluding APM from Data-Connectors then re-importing the correct 5.10.1 version. Example below:
<dependency>
<groupId>com.activeviam.io</groupId>
<artifactId>data-connectors-csv</artifactId>
<version>2.2.0-AP5.10</version>
<exclusions>
<exclusion>
<groupId>com.activeviam.lib</groupId>
<artifactId>activepivot-apm</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>com.activeviam.lib</groupId>
<artifactId>activepivot-apm</artifactId>
<version>5.10.1</version>
</dependency>
Added
| Issue Key | Details |
|---|---|
| PST-733 | Added APM Monitoring to DEE |
Changed
| Issue Key | Details |
|---|---|
| PST-737 | Upgraded APM Version to 5.10 |
Removed
com.activeviam.io.monitoring.LoggingUtils- Replaced by
com.activeviam.apm.logging.impl.LoggingUtils
- Replaced by
Fixed
| Issue Key | Details |
|---|---|
| PST-744 | Fixed time units used in ADatastoreTransactionTask as the Nanosecond throughput time was in Milliseconds. |
2.1.0
Fixed
| Issue Key | Details |
|---|---|
| PST-706 | Removed NPE when checking if events have errors during Loading or Unloading of data |
| PST-711 | Added safety checks when accessing DLC cache for expired events. Added proper closing of TraceContexts used to trace DLC IExecutionTask |
Added
| Key | Details |
|---|---|
| PST-667 | Added support for Listening on CSV files on the Local and Cloud file system. More can be found on the DLC Real-Time Data Sources page. |
| PST-712 | Added ability to specify Get Aggregate Query exports using Level@Hierarchy@Dimension=Value Location strings. More can be found on Get aggregates query DEE order |
Changed
| Issue Key | Details |
|---|---|
| PST-703 | Removed Deprecation of Enhanced Drillthroughs as we will be keeping the enhanced drillthrough functionality |
2.0.1
Fixed
| Issue Key | Details |
|---|---|
| PST-708 | Updated APM dependency version that was causing the TraceContext of DLC events to be null in the DLC Cache |
2.0.0
Known Issues
- Parsing of large files will cause null TraceContext value for HealthEvents, leading to the DLC not properly adding events to the Cache.
Changed
- AP version has been updated to 5.10.1
- The Azure Cloud Source has migrated its dependency to the Azure Blob Storage SDK from v8 to v12
1.2.1
Fixed
| Issue Key | Details |
|---|---|
| PST-706 | Removed NPE when checking if events have errors during Loading or Unloading of data |
1.2.0
Added
| Issue Key | Details |
|---|---|
| PST-688 | Integrated APM tracing for DLC health events |
Fixed
| Issue Key | Details |
|---|---|
| PST-685 | Fixed DLC response timeTakenMs to show ms instead of nanoseconds |
| PST-690 | Fixed DEE issue in AEnhancedDrillthroughService in case of entries with the same underlying datastore field and entries without dictionaries. Fixed export of vector |
Changed
| Issue Key | Details |
|---|---|
| PST-684 | Removed IScopedFetchSource interface as it causes confusion, and is functionally identical to IFetchingDataSource |
| PST-670 | Added CustomKafkaAvroDeserializerGenericRecord and CustomKafkaAvroDeserializerObjectTuple classes |
1.1.0
Fixed
| Issue Key | Details |
|---|---|
| BAS-670 | Removed NPE thrown when REST endpoint getTaskStatus() called after executing a DEE Order containing a bad MDX |
Added
| Issue Key | Details |
|---|---|
| PST-662 | Product Center’s ParquetParserBuilder has been implemented. This implementation requires AP version 5.9.2+ |
| PST-668 | Added ability to customize ordering of Topics within a given request. For more information, see Custom Ordering for Loading Topics |