Function chat

Source
pub async fn chat(
    chat_request: &mut ChatCompletionRequest,
) -> Result<Either<impl TryStream<Ok = String, Error = LlamaCoreError>, ChatCompletionObject>, LlamaCoreError>
Expand description

Processes a chat-completion request and returns either a stream of ChatCompletionChunk instances or a ChatCompletionObject instance.