atoti_ai.AiConfig - Atoti Hub

final class atoti_ai.AiConfig

Atoti Intelligence configuration. See the Atoti Intelligence documentation for more details.

This feature is experimental, its key is "ai".

Example

>>> from atoti_ai import AiConfig
>>> from atoti_ai_amazon_bedrock import (
...     ChatConfig,
...     ConnectionConfig,
... )
>>> with tt.experimental({"ai"}):
...     ai_config = AiConfig(
...         connection=ConnectionConfig(
...             aws_access_key="...",
...             aws_secret_key="...",
...         ),
...         chat=ChatConfig(
...             model="anthropic.claude-3-sonnet-20240229-v1:0",
...         ),
...     )

Atoti Intelligence can also be enabled without an LLM provider: install no provider package (i.e. atoti[ai]) and leave connection and chat set to None. AutoExplain then returns a default, non-AI summary and the chat feature is disabled:

>>> import atoti as tt
>>> from atoti_ai import AiConfig

>>> with tt.experimental({"ai"}):
...     ai_config = AiConfig()

>>> session_config = tt.SessionConfig(ai=ai_config)

Opting out of dynamic_tool_discovery:

>>> import atoti as tt
>>> from atoti_ai import AiConfig

>>> with tt.experimental({"ai"}):
...     ai_config = AiConfig(dynamic_tool_discovery=False)

>>> session_config = tt.SessionConfig(ai=ai_config)

chat : ChatConfig | None = None

The configuration of the chat model.

connection : ConnectionConfig | None = None

The configuration of the connection to the LLM provider.

dynamic_tool_discovery : bool | None = None

Whether the chat sends the LLM only the tools matching each request. The LLM calls a tool search tool that queries a keyword index. It receives only the matching tools, which reduces prompt token usage and improves tool selection. Set to False to send the whole tool set on every request instead. A small tool set, where searching brings no benefit, is one reason to do so. Inspecting which tools the LLM can see is another. Defaults to True when left unset.

​final class atoti_ai.AiConfig

​Example

​chat : ChatConfig | None = None

​connection : ConnectionConfig | None = None

​dynamic_tool_discovery : bool | None = None

final class atoti_ai.AiConfig

Example

chat : ChatConfig | None = None

connection : ConnectionConfig | None = None

dynamic_tool_discovery : bool | None = None