LLM Finetuning
Runs fine-tuning as a gated lifecycle where the eval harness is built before any training config.
Install
Claude Code: /plugin marketplace add wshobson/agents → /plugin install llm-finetuning@claude-code-workflows
Açık ağırlıklı bir model uçtan uca ince ayarlanırken, değerlendirme takımı kurulurken ya da bir checkpoint'in yayına çıkıp çıkmayacağına karar verilirken
- Author
- Seth Hobson
- License
- MIT
Eleven skills sequence the work: decide whether to fine-tune at all, build the eval harness, curate data, train, then gate the checkpoint. The routing skill opens with off-ramps — volatile facts belong in RAG, unsettled behaviour belongs in the prompt — because most requests that arrive as "fine-tune this" are cheaper to solve elsewhere. Evaluation comes first by design: the labelled traces that produce the golden set also produce training data, with every golden excluded by ID so leakage cannot quietly inflate the score. Promotion is a four-stage gate, and a checkpoint that wins on held-out goldens but loses the paired arena against the base model does not ship. Methods run from LoRA and QLoRA through DPO to GRPO with verifiable rewards, ending in GGUF or FP8 export.
Similar skills
Protect MCP
SkillGates every tool call through a Cedar policy and signs the decision into a hash-chained receipt.
PluginEval
SkillScores a Claude Code skill on ten dimensions across static checks, an LLM judge and Monte Carlo runs.
Skill Forge Essentials
SkillThree behavioural skills aimed at the mistakes agents make rather than the ones humans make.
Comments(0)
Sign in to comment