Skip to content
ai101.tools
navigateopenescclose
Claude+372Whisper+228LangChain+168Codex+223NotebookLM+276DALL-E 3+192DeepL+249n8n+208Topaz Video AI+153LlamaIndex+161
LLM Finetuning logo
Skill

LLM Finetuning

Runs fine-tuning as a gated lifecycle where the eval harness is built before any training config.

0
SaveVisit website ↗

Install

Claude Code: /plugin marketplace add wshobson/agents → /plugin install llm-finetuning@claude-code-workflows
Triggers on

Açık ağırlıklı bir model uçtan uca ince ayarlanırken, değerlendirme takımı kurulurken ya da bir checkpoint'in yayına çıkıp çıkmayacağına karar verilirken

Author
Seth Hobson
License
MIT

Eleven skills sequence the work: decide whether to fine-tune at all, build the eval harness, curate data, train, then gate the checkpoint. The routing skill opens with off-ramps — volatile facts belong in RAG, unsettled behaviour belongs in the prompt — because most requests that arrive as "fine-tune this" are cheaper to solve elsewhere. Evaluation comes first by design: the labelled traces that produce the golden set also produce training data, with every golden excluded by ID so leakage cannot quietly inflate the score. Promotion is a four-stage gate, and a checkpoint that wins on held-out goldens but loses the paired arena against the base model does not ship. Methods run from LoRA and QLoRA through DPO to GRPO with verifiable rewards, ending in GGUF or FP8 export.

Comments(0)

Sign in to comment

No comments yet — be the first.

Similar skills

Report this comment

Why are you reporting this?