Module chat_flame_backend::llm::generate_parameter

source ·
Expand description

Parameters for text generation.

This module defines the parameters used to control the behavior of text generation, such as the maximum number of new tokens to generate, temperature settings, and others. Generate Parameters Module.

This module defines parameters used for controlling text generation.

Structs