llama_core

Module chat

Source
Expand description

Define APIs for chat completion.

Functionsยง

chat
Processes a chat-completion request and returns either a stream of ChatCompletionChunk instances or a ChatCompletionObject instance.