Skip to main content
atoti_ai_amazon_bedrock.ChatConfig(
    *,
    model: str,
    temperature: float | None = None,
    top_p: float | None = None,
    top_k: int | None = None,
    max_tokens: int | None = None,
)
Chat config for Amazon Bedrock. See the corresponding Javadoc for more details.
See also: The other ChatConfig implementations.

Attributes

model

The ID of the model to use, for example "anthropic.claude-3-sonnet-20240229-v1:0".

temperature

Controls randomness in responses from 0.0 (deterministic) to 1.0 (creative).

top_p

Nucleus sampling parameter. Controls diversity via cumulative probability.

top_k

Limits vocabulary to top K tokens at each generation step.

max_tokens

Maximum number of tokens to generate in the response.