Claude Skill
vllm-project/semantic-router
Semantic Router is a system-level intelligent router for mixture-of-models AI architectures, enabling efficient workload routing across cloud, data center, and edge environments. Part of the vLLM e...
Overview
Stars3,935
Forks645
LanguageGo
Last pushed2026-04-28
Last synced2026-04-28
Repository
Ownervllm-project
Repositorysemantic-router
Full namevllm-project/semantic-router
Repo ID1,045,247,072
🚀 Install this Skill
openclaw install vllm-project/semantic-routerSummary
Semantic Router is a system-level intelligent router designed for mixture-of-models architectures, enabling efficient routing of AI workloads across cloud, data center, and edge environments. It is a key component of the vLLM ecosystem, built primarily in Go.
Chinese description
系统级智能路由器：面向云、数据中心与边缘的模型混合架构
Key features
- System-level intelligent routing for AI models
- Supports mixture-of-models (MoM) architectures
- Deployment across cloud, data center, and edge
- Built with Go for performance and scalability
- Integration with vLLM and Hugging Face ecosystems
- Kubernetes-native deployment support
Use cases
- AI gateway for routing LLM requests
- Dynamic model selection based on semantic context
- Load balancing across multiple AI model instances
- Edge AI inference with intelligent routing
- Multi-tenant AI service platforms
- PII detection and content filtering routing