huggingface/upskill

Registry 信息

项目简介

Upskill 是一个为代码代理（如 Claude Code、Open Code、OpenAI Codex）生成和评估专业技能集的框架。它提供了一套系统化的技能开发方法，涵盖代码理解、生成、优化、调试和文档，并配有一个全面的评估体系，覆盖功能性、质量、效率和实用性等多个维度。

要点

• 为代码代理提供系统化的技能生成
• 多维评估指标（功能性、质量、效率、实用性）
• 专注于代码理解、生成、优化和调试
• 具有实时反馈的持续优化机制
• 与基准测试集（如 HumanEval, MBPP）集成

使用场景

• 增强代码代理的软件开发能力
• 对不同代码生成模型进行基准测试和比较
• 自动化代码审查、优化和文档任务
• 训练和评估AI驱动的编程助手
• 研究AI代码生成与代理性能

README 摘要

<img width="1920" height="1080" alt="upskill_banner" src="https://github.com/user-attachments/assets/b71fd417-7d23-4f5d-aa89-06ea6b284d1b" /> # UPskill Generate and evaluate agent skills based on traces with agents. Create skills with teacher models (expensive/slow) that student models (cheap/fast) can use to perform harder tasks reliably. > [!TIP] > > UPskill v2 - recommended default config file now runs evaluations on Hugging Face Jobs. Make sure > to set your `HF_TOKEN` and use `--artifact-repo <dataset-name>` for job creation and result capture ## Quick Start Install upskill: ```bash uv pip install upskill # or just use uv uvx upskill ``` Create a new skill ```bash upskill generate "write good git commit messages" # or based on previous agent traces upskill generate "document the pattern" --from ./trace.md # Skills are saved to ./skills/{skill-name}/ by default ``` Generate a skill with a teaching model and evaluate it on a student model. ```bash upskill generate "write good git commit messages" --model sonnet --eval-model haiku ``` Benchmark a set of models against a skill. ```bash upskill eval ./skills/git-commit-messages/ -m haiku -m sonnet # logs pretty printed to the terminal ``` View the results later. ```bash upskill runs --skill git-commit-messages ``` ## Development checks This repo uses a CI flow inspired by `fast-agent` with separate format, lint, typecheck, and test stages. Install dev dependencies: ```bash uv sync --extra dev ``` Run the quality gates locally: ```bash uv run scripts/format.py uv run scripts/lint.py uv run scripts/typecheck.py uv run scripts/cpd.py --check uv run --extra dev pytest -v ``` Or use the helper script to run the whole sequence: ```bash uv run scripts/check.py ``` Add `--sync` to include `uv sync --

话题

暂无话题