Module chat_flame_backend::llm::model_processor

Processor for language models.

Handles the processing of input data through the model, including forward passes and manipulation of outputs. Model Processor module for text generation.

This module contains the ModelProcessor trait and its implementations which are used for processing input tensors and generating output tensors representing logits from a language model.

Structs

• DummyModelProcessor
  A dummy implementation of ModelProcessor for testing purposes.

Traits

• ModelProcessor
  A trait for processing model inputs and generating outputs.