Module chat_flame_backend::llm

The llm (Language Model) module contains the implementation and utilities related to language models. This includes tokenization, text generation, model interfaces, and other language model-related functionality.

Large Language Model (LLM) Module

This module contains components necessary for loading and processing large language models. It includes utilities for handling model parameters, loading models, generating tokens, and other functionalities essential for text generation.

Modules

• generate_parameter
  Parameters for text generation.
• loader
  Module for loading models.
• model_processor
  Processor for language models.
• models
  Enumerations for supported models.
• sampler
  Sampling utilities for language models.
• text_generation
  Main text generation logic.
• text_generator
  Generator for text generation.
• token_generator
  Token generator utilities.

Enums

• FinishReason
  Enumeration representing the reason why text generation was finished.
• Model