Module chat_flame_backend::api::routes::generate

Module containing all route handlers.

This module organizes the different API endpoints and their associated handlers. Each route corresponds to a specific functionality of the text generation inference API.

Modules

• generate - Handles requests for token generation with streaming capability.
• generate_stream - Handles streaming requests for text generation.
• generate_text - Handles requests for generating text without streaming.
• health - Provides a health check endpoint.
• info - Provides information about the text generation inference service.

Functions

• generate_handler
  Handler for generating text tokens.