atoti package as light as possible, these features are packaged into separate plugins that can be installed when needed.
Available plugins
Atoti Intelligence
Data loading
Cloud storage
These connectors open tens of HTTP connections to the cloud storage in order to transfer the data in parallel. They then transparently reassemble the blocks directly in memory. They can load up to 300 GB in about 5 minutes. Some parameters can impact the overall download speed:- Bandwidth of the network interface.
- Speed of the CPU cores since HTTPS connections and client side-encryption consume CPU resources.
- File size: small files will not have good download speed (< 60 MB/s).
- Type (hot/cold) of the storage: hot storage is faster.
- Data locality: best when the host running Atoti and the data are in the same cloud region.
DirectQuery
See Query an external database.atoti_directquery_bigqueryatoti_directquery_clickhouseatoti_directquery_databricksatoti_directquery_jdbcatoti_directquery_mssqlatoti_directquery_redshiftatoti_directquery_snowflakeatoti_directquery_synapse
Administration & Monitoring
BI tools
Visualization
Installation
The plugins can be installed as Python packages. For instance, to install the DirectQuery JDBC plugin: With uv:atoti itself, plugins have a client and a server part, both installed by atoti[<plugin>].