mistral_common.protocol.instruct.request
ChatCompletionRequest(**data)
Bases: BaseCompletionRequest
, Generic[ChatMessageType]
Request for a chat completion.
Attributes:
Name | Type | Description |
---|---|---|
model |
Optional[str]
|
The model to use for the chat completion. |
messages |
List[ChatMessageType]
|
The messages to use for the chat completion. |
response_format |
ResponseFormat
|
The format of the response. |
tools |
Optional[List[Tool]]
|
The tools to use for the chat completion. |
tool_choice |
ToolChoice
|
The tool choice to use for the chat completion. |
truncate_for_context_length |
bool
|
Whether to truncate the messages for the context length. |
Examples:
>>> from mistral_common.protocol.instruct.messages import UserMessage, AssistantMessage
>>> from mistral_common.protocol.instruct.tool_calls import ToolTypes, Function
>>> request = ChatCompletionRequest(
... messages=[
... UserMessage(content="Hello!"),
... AssistantMessage(content="Hi! How can I help you?"),
... ],
... response_format=ResponseFormat(type=ResponseFormats.text),
... tools=[Tool(type=ToolTypes.function, function=Function(name="get_weather", parameters={}))],
... tool_choice=ToolChoice.auto,
... truncate_for_context_length=True,
... )
Source code in .venv/lib/python3.13/site-packages/pydantic/main.py
ResponseFormat(**data)
Bases: MistralBase
The format of the response.
Attributes:
Name | Type | Description |
---|---|---|
type |
ResponseFormats
|
The type of the response. |
Examples: