Skip to content
ai101.tools
navigateopenescclose
Claude+372Whisper+228LangChain+168Codex+223NotebookLM+276DALL-E 3+192DeepL+249n8n+208Topaz Video AI+153LlamaIndex+161
PluginEval logo
Skill

PluginEval

Scores a Claude Code skill on ten dimensions across static checks, an LLM judge and Monte Carlo runs.

0
SaveVisit website ↗

Install

Ships scripts
Claude Code: /plugin marketplace add wshobson/agents → /plugin install plugin-eval@claude-code-workflows
Triggers on

Yazılan bir skill ya da eklentinin kalitesi ölçülürken, iki skill karşılaştırılırken ya da bir pazar yeri için puan eşiği belirlenirken

Author
Seth Hobson
License
MIT

Three layers stack, each more expensive than the last: a static pass that parses SKILL.md and finishes in under two seconds, an LLM judge that scores triggering, orchestration, output and scope in about thirty seconds, and a Monte Carlo layer that runs the skill fifty to a hundred times to estimate reliability. The static checks are opinionated in a way worth knowing before writing skills — progressive disclosure is measured against a 200 to 600 line sweet spot, and every detected anti-pattern multiplies the layer score down by another five percent, flooring at half. Results feed an Elo ranking against a corpus, so a skill is placed relative to its peers instead of against an absolute bar. It ships as a real Python package with a test suite, not just prompt files.

Comments(0)

Sign in to comment

No comments yet — be the first.

Similar skills

Report this comment

Why are you reporting this?