Module chat_flame_backend::llm::loader
source · Expand description
Module for loading models.
Provides functionality to load model weights and other necessary components for language models. Model Loader Module.
This module contains functions for loading model weights and tokenizers for text generation. It supports various models and uses the Hugging Face Hub for downloading model files.
Functions
- Creates and loads model weights from the Hugging Face Hub.
- Creates and loads a tokenizer from the Hugging Face Hub.