Claude Skill
vllm-project/semantic-router
Semantic Router is a system-level intelligent router for mixture-of-models AI architectures, enabling efficient workload routing across cloud, data center, and edge environments.
Overview
Stars3,388
Forks570
LanguageGo
Last pushed2026-03-14
Last synced2026-03-14
Repository
Ownervllm-project
Repositorysemantic-router
Full namevllm-project/semantic-router
Repo ID1,045,247,072
🚀 Install this Skill
openclaw install vllm-project/semantic-routerSummary
Semantic Router is a system-level intelligent router designed for mixture-of-models architectures, enabling efficient routing of AI workloads across cloud, data center, and edge environments.
Chinese description
系统级智能路由器：面向云、数据中心与边缘的模型混合架构
Key features
- System-level intelligent routing for AI models
- Supports mixture-of-models architectures
- Deployment across cloud, data center, and edge
- Built with Go and Rust for performance
- Integrates with Kubernetes for orchestration
- Leverages Hugging Face libraries (Transformers, Candle)
Use cases
- AI gateway for routing LLM requests
- Dynamic model selection based on semantic input
- PII detection and content filtering
- Prompt engineering and guard systems
- Orchestrating multiple AI models in production
- Edge AI deployments with efficient routing