Skill Evals, Packaging, and Portability
A skill is finished when its package survives linting, routes on the right requests, improves a measured task, stays inside policy, and degrades honestly on another host.
150 minutesBuildPython (stdlib)Members
Learning Objectives
- Turn an expert workflow into a skill by separating judgment, deterministic computation, references, and output contracts.
- Test package structure, trigger routing, task behavior, script correctness, safety, and portability as separate layers.
- Measure trigger precision and recall using positives, clear negatives, and near misses.
- Compare performance with and without the skill across repeated runs.
- Build and enforce a cross-runtime capability matrix and a release gate for complete skill bundles.