atoti_ai_amazon_bedrock.ChatOptions#

final class atoti_ai_amazon_bedrock.ChatOptions#

Chat options for Amazon Bedrock.

Warning

This feature is experimental, its key is "ai".

See the corresponding Javadoc for more details.

See also

The other ChatOptions implementations.

frequency_penalty: float | None = None#

Penalty for token frequency. Positive values discourage repetition.

max_tokens: int | None = None#

Maximum number of tokens to generate in the response.

model: str#

The ID of the model to use, for example "anthropic.claude-3-sonnet-20240229-v1:0".

presence_penalty: float | None = None#

Penalty for token presence. Positive values encourage topic diversity.

stop_sequences: Sequence[str] | None = None#

Sequences that will stop generation when encountered.

temperature: float | None = None#

Controls randomness in responses from 0.0 (deterministic) to 1.0 (creative).

top_k: int | None = None#

Limits vocabulary to top K tokens at each generation step.

top_p: float | None = None#

Nucleus sampling parameter.

Controls diversity via cumulative probability.