Trait chat_flame_backend::llm::model_processor::ModelProcessor

pub trait ModelProcessor {
    // Required method
    fn forward(&mut self, x: &Tensor, index_pos: usize) -> Result<Tensor>;
}

A trait for processing model inputs and generating outputs.

This trait defines a method for processing input tensors through a model and generating output tensors.

Required Methods

fn forward(&mut self, x: &Tensor, index_pos: usize) -> Result<Tensor>

Processes an input tensor and generates an output tensor.

Arguments

• x - A reference to the input tensor.
• index_pos - The position index for processing.

Returns

Returns a Result containing the output tensor.

Implementors

impl ModelProcessor for Model

impl ModelProcessor for DummyModelProcessor

Implementation of ModelProcessor for DummyModelProcessor.