ChatConfig

atoti_ai_amazon_bedrock.ChatConfig(
    *,
    model: str,
    temperature: float | None = None,
    top_p: float | None = None,
    top_k: int | None = None,
    max_tokens: int | None = None,
)

Chat config for Amazon Bedrock. See the corresponding Javadoc for more details.

​

Attributes

​

model

The ID of the model to use, for example "anthropic.claude-3-sonnet-20240229-v1:0".

​

temperature

Controls randomness in responses from 0.0 (deterministic) to 1.0 (creative).

​

top_p

Nucleus sampling parameter. Controls diversity via cumulative probability.

​

top_k

Limits vocabulary to top K tokens at each generation step.

​

max_tokens

Maximum number of tokens to generate in the response.