TokenSpeed is a speed-of-light LLM inference engine.
-
Updated
May 17, 2026 - Python
#
lightseek
Here are 4 public repositories matching this topic...
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
chat mcp routing gemini openai claude llm anthropic vllm sglang anthropic-api inference-gateway responses-api tensorrtllm trtllm lightseek
-
Updated
May 17, 2026 - Rust
Improve this page
Add a description, image, and links to the lightseek topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the lightseek topic, visit your repo's landing page and select "manage topics."