Claude Skill
RightNow-AI/picolm
开源 C 语言项目，用于在低成本嵌入式硬件上运行十亿参数大语言模型。支持在仅 256MB 内存的 10 美元开发板上进行 AI 推理。兼容 ARM、RISC-V 架构。
概览
仓库信息
安装这个 Skill
git clone https://github.com/rightnow-ai/picolm.gitRegistry 信息
项目简介
Picolm 是一个基于 C 语言的项目，它使得在仅有 256MB 内存的低成本嵌入式硬件（例如 10 美元开发板）上运行 10 亿参数的大语言模型成为可能。
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
要点
- 在嵌入式硬件上运行 10 亿参数大语言模型
- 极低内存需求（256MB RAM）
- 针对低成本（10美元）开发板优化
- 使用高效的 C 语言编写
- 支持 ARM 和 RISC-V 架构
使用场景
- 物联网设备的端侧 AI 推理
- 资源受限硬件上的教育项目
- 在树莓派上原型化 LLM 应用
- 大语言模型的边缘计算
- 展示高效的模型量化技术
README 摘要
<p align="center"> <img src="https://img.shields.io/badge/Language-C11-blue?style=flat-square" alt="C11"> <img src="https://img.shields.io/badge/Binary_Size-~80KB-brightgreen?style=flat-square" alt="Binary Size"> <img src="https://img.shields.io/badge/Runtime_RAM-45MB-orange?style=flat-square" alt="RAM"> <img src="https://img.shields.io/badge/Dependencies-Zero-success?style=flat-square" alt="Zero Dependencies"> <img src="https://img.shields.io/badge/License-MIT-yellow?style=flat-square" alt="MIT License"> </p> <h1 align="center">PicoLM</h1> <p align="center"> <strong>Run a 1-billion parameter LLM on a $10 board with 256MB RAM.</strong><br> Pure C. Zero dependencies. One binary. No Python. No cloud. </p> <p align="center"> <code>echo "Explain gravity" | ./picolm model.gguf -n 100 -j 4</code> </p> --- ## The Perfect Match: PicoLM + PicoClaw <div align="center"> <img src="picolm.jpg" alt="PicoLM — Run a 1-billion parameter LLM on a $10 board" width="640"> <br><br> </div> PicoLM was built as the **local brain** for [PicoClaw](https://github.com/sipeed/picoclaw) — an ultra-lightweight AI assistant in Go that runs on $10 hardware. Together, they form a **fully offline AI agent** — no cloud, no API keys, no internet, no monthly bills. > **Every other LLM provider needs the internet. PicoLM doesn't.** <table align="center"> <tr align="center"> <td><b>The Hardware</b></td> <td><b>The Architecture</b></td> </tr> <tr> <td align="center"><img src="https://raw.githubusercontent.com/sipeed/picoclaw/main/assets/licheervnano.png" alt="$9.90 LicheeRV Nano" width="360"></td> <td align="center"><img src="https://raw.githubusercontent.com/sipeed/picoclaw/main/assets/arch.jpg" alt="PicoClaw architecture — PicoLM sits in the LLM box" width="