RelayPlane/proxy

Registry 信息

项目简介

RelayPlane/proxy 是一个面向AI代理的开源成本智能代理，通过智能模型路由削减高达80%的成本。它提供仪表盘、策略引擎，并支持11家供应商，采用MIT许可证。

要点

• 智能模型路由，成本削减高达80%
• 内置仪表盘，用于成本监控与分析
• 策略引擎，支持自定义成本管理规则
• 支持包括Anthropic和OpenAI在内的11家AI供应商
• 采用MIT许可证，开放且灵活使用

使用场景

• 优化AI代理应用的LLM API成本
• 跨多个AI供应商集中追踪成本
• 为企业AI部署执行预算策略
• 自动将请求路由到最具成本效益的模型

README 摘要

# @relayplane/proxy [](https://www.npmjs.com/package/@relayplane/proxy) [](https://github.com/RelayPlane/proxy/blob/main/LICENSE) A **Node.js npm LLM proxy** that sits between your AI agents and providers. Drop-in replacement for OpenAI and Anthropic base URLs — no Docker, no Python, just `npm install`. Tracks every request, shows where the money goes, and offers configurable task-aware routing — all running **locally, for free**. **Live savings dashboard:** [relayplane.com/live](https://relayplane.com/live) — see real-time aggregate savings from developers worldwide. **The npm-native LLM proxy for Node.js developers.** Works with Claude Code, Cursor, OpenClaw, and any tool that supports `OPENAI_BASE_URL` or `ANTHROPIC_BASE_URL`. **Free, open-source proxy features:** - 📊 Per-request cost tracking across 11 providers - 💰 **Cache-aware cost tracking** - accurately tracks Anthropic prompt caching with cache read savings, creation costs, and true per-request costs - 🔀 Configurable task-aware routing (complexity-based, cascade, model overrides) - 🛡️ Circuit breaker - if the proxy fails, your agent doesn't notice - 📈 **Local dashboard** at `localhost:4100` - cost breakdown, savings analysis, provider health, agent breakdown - 💵 **Budget enforcement** - daily/hourly/per-request spend limits with block, warn, downgrade, or alert actions - 🔍 **Anomaly detection** - catches runaway agent loops, cost spikes, and token explosions in real time - 🔔 **Cost alerts** - threshold alerts at configurable percentages, webhook delivery, alert history - ⬇️ **Auto-downgrade** - automatically switches to cheaper models when budget thresholds are hit - 📦 **Aggressive cache*

话题