Struct chat_flame_backend::llm::sampler::DummySampler

pub struct DummySampler { /* private fields */ }

A dummy implementation of Sampler for testing purposes.

This sampler sequentially returns incrementing integers as tokens.

Implementations

impl DummySampler

pub fn new() -> Self

Creates a new DummySampler.

Trait Implementations

impl Default for DummySampler

Provides a default instance of DummySampler.

fn default() -> Self

Returns the “default value” for a type.

impl Sampler for DummySampler

Implementation of Sampler for DummySampler.

fn sample(&mut self, _logits: &Tensor) -> Result<u32>

Samples a token based on provided logits.