Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.activeviam.com/llms.txt

Use this file to discover all available pages before exploring further.

Some Atoti features require large additional libraries and might not be useful in every projects. To keep the core library as light as possible, these features are packaged into separate plugins that can be installed when needed.

Available plugins

Data loading

atoti_jdbcCode to interact with databases through JDBC.
atoti_kafkaCode to interact with Kafka streams.
atoti_parquetCode to load Apache Parquet files.

Cloud storage

atoti_storage_awsCode to load CSV and Parquet files from AWS S3 into Atoti tables.
atoti_storage_azureCode to load CSV and Parquet files from Azure Blob Storage into Atoti tables.
atoti_storage_gcpCode to load CSV and parquet files from Google Cloud Storage into Atoti tables.
These connectors open tens of HTTP connections to the cloud storage in order to transfer the data in parallel. They then transparently reassemble the blocks directly in memory. They can load up to 300 GB in about 5 minutes. Some parameters can impact the overall download speed:
  • Bandwidth of the network interface.
  • Speed of the CPU cores since HTTPS connections and client side-encryption consume CPU resources.
  • File size: small files will not have good download speed (< 60 MB/s).
  • Type (hot/cold) of the storage: hot storage is faster.
  • Data locality: best when the host running Atoti and the data are in the same cloud region.

DirectQuery

See Using DirectQuery.
atoti_directquery_bigqueryCode to use DirectQuery on Google BigQuery.
atoti_directquery_clickhouseCode to use DirectQuery on ClickHouse.
atoti_directquery_databricksCode to use DirectQuery with Databricks.
atoti_directquery_jdbcCode to use DirectQuery through JDBC.
atoti_directquery_mssqlCode to use DirectQuery with Microsoft SQL Server.
atoti_directquery_redshiftCode to use DirectQuery on Amazon Redshift.
atoti_directquery_snowflakeCode to use DirectQuery on Snowflake.
atoti_directquery_synapseCode to use DirectQuery on Azure Synapse Analytics.

Administration & Monitoring

atoti_observabilityPlugin enhancing observability of Atoti sessions.
atoti_spring_boot_adminPlugin enabling Spring Boot Admin.

Installation

A plugin can be installed as a Python package or as a Conda package. For instance, to install the DirectQuery JDBC plugin: With uv:
uv add "atoti[directquery-jdbc]"
Or with pip:
pip install "atoti[directquery-jdbc]"
Multiple plugins can be installed with the “extras” syntax:
uv add "atoti[directquery-jdbc,jupyterlab,spring-boot-admin]"

Conda package (discouraged)

conda install atoti atoti-client-directquery-jdbc atoti-server-directquery-jdbc