AlexsJones/llmfit

Registry 信息

项目简介

LLMFit 是一款基于 Rust 的工具，通过一条命令即可帮助用户根据其特定硬件配置找到兼容的 LLM 模型和供应商。它支持 497 个模型和 133 家供应商，简化了识别合适 AI 模型部署方案的过程。

要点

• 一条命令即可查找与硬件兼容的 LLM 模型
• 支持 497 个模型和 133 家供应商
• 使用 Rust 构建，确保性能和可靠性
• 简化 AI 模型部署选择
• 开源且由社区驱动

使用场景

• 识别可在特定硬件上运行的 LLM 模型
• 比较不同供应商间的模型兼容性
• 简化 AI 应用程序的部署规划
• 研究受硬件限制的可用 LLM 选项
• 优化模型推理的资源分配

README 摘要

# llmfit <p align="center"> <img src="assets/icon.svg" alt="llmfit icon" width="128" height="128"> </p> <p align="center"> <b>English</b> · <a href="README.zh.md">中文</a> </p> <p align="center"> <a href="https://github.com/AlexsJones/llmfit/actions/workflows/ci.yml"><img src="https://github.com/AlexsJones/llmfit/actions/workflows/ci.yml/badge.svg" alt="CI"></a> <a href="https://crates.io/crates/llmfit"><img src="https://img.shields.io/crates/v/llmfit.svg" alt="Crates.io"></a> <a href="LICENSE"><img src="https://img.shields.io/badge/license-MIT-blue.svg" alt="License"></a> <a href="https://about.signpath.io"><img src="https://img.shields.io/badge/SignPath-signed-brightgreen?logo=data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSIxNiIgaGVpZ2h0PSIxNiIgZmlsbD0id2hpdGUiIHZpZXdCb3g9IjAgMCAxNiAxNiI+PHBhdGggZD0iTTEwLjA2NyA0LjU2N2wtNC43MzQgNC43MzMtMS40LTEuNGExIDEgMCAwIDAtMS40MTQgMS40MTRsMi4xIDIuMWExIDEgMCAwIDAgMS40MTQgMGw1LjQ0LTUuNDRhMSAxIDAgMCAwLTEuNDE0LTEuNDE0eiIvPjwvc3ZnPg==" alt="Signed with SignPath"></a> </p> > **New: [Community Leaderboard](#community-leaderboard-b)** — Browse real-world performance data from actual users. Press `b` to see measured tok/s, TTFT, and VRAM for any GPU — not just yours. Pick from 27+ hardware presets (RTX 5090 to Apple M1) with `H` to compare real numbers before you buy or build. **Hundreds of models & providers. One command to find what runs on your hardware.** A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine. Ships with an interactive TUI (default) and a classic CLI mode. Supports multi-GPU setups,

话题