Back to Skills

skill-creator

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

19,608stars2,461forksUpdated 5/18/2026

Security Assessment

Safe(100/100)
Security Score100/100

About skill-creator

The Skill Creator is an AI tool designed to help users create, modify, and optimize other skills. It addresses the challenge of building effective AI skills from scratch or improving existing ones by providing a structured, iterative workflow. Users can leverage this skill to draft new skills, design test prompts, evaluate performance both qualitatively and quantitatively, and refine the skill based on feedback. This process reduces trial-and-error and accelerates the development of high-quality, well-functioning skills, making it particularly valuable for those who want to systematically improve AI behavior and output accuracy.

Key capabilities of the Skill Creator include drafting skills based on user intent, setting up test cases, running evaluations, and performing variance analysis to benchmark performance. It guides users through iterative improvement cycles, allowing them to refine skills based on both subjective feedback and objective metrics. Additionally, it supports optimizing skill descriptions for better triggering accuracy, ensuring that skills respond reliably in the intended contexts. The tool is flexible and can adapt to different user needs, whether they want a formal evaluation process or a more casual, exploratory approach.

This skill is useful for AI developers, product teams, and technically-inclined users who want to build or enhance AI skills without manually managing every development step. Typical use cases include creating new AI functions, improving existing ones, running comprehensive evaluations, and enhancing skill descriptions for better discoverability and responsiveness. It is also accessible to users with varying levels of technical knowledge, providing guidance on terminology and processes where necessary, which makes it suitable for both experts and newcomers looking to experiment with AI capabilities.

FAQ

How do I start creating a new skill with Skill Creator?

Begin by specifying the skill's intended purpose and desired behavior. Draft the skill, create test prompts, and then iteratively evaluate and refine it based on feedback and performance metrics.

Can Skill Creator improve an existing skill?

Yes, it can optimize an existing skill by evaluating its performance, identifying weaknesses, and guiding improvements through iterative edits and benchmarking.

What technical knowledge do I need to use Skill Creator?

While familiarity with coding and AI concepts can help, the tool is designed to accommodate users with varying technical backgrounds, providing explanations for terms and processes when needed.

Does Skill Creator support automated performance evaluation?

Yes, it can generate quantitative and qualitative evaluations, use variance analysis for benchmarking, and provide metrics to guide skill refinement.

Is Skill Creator compatible with all types of AI skills?

It is intended for skills that can be drafted, tested, and iteratively refined. Skills requiring specialized or unsupported platforms may have limitations in testing or evaluation.

All Files

18 files
LICENSE.txt11.1 KB
View
scripts/run_eval.py11.2 KB
View
agents/analyzer.md10.1 KB
View
scripts/__init__.py0.0 KB
View
scripts/utils.py1.6 KB
View
eval-viewer/generate_review.py15.9 KB
View
scripts/package_skill.py4.1 KB
View
assets/eval_review.html6.9 KB
View
scripts/improve_description.py10.8 KB
View
agents/grader.md8.8 KB
View
scripts/generate_report.py12.5 KB
View
eval-viewer/viewer.html43.9 KB
View
scripts/quick_validate.py3.9 KB
View
agents/comparator.md7.1 KB
View
scripts/aggregate_benchmark.py13.9 KB
View
SKILL.md32.2 KB
View
references/schemas.md11.8 KB
View
scripts/run_loop.py13.3 KB
View

Install skill-creator

Download and extract the skill files to your .claude/skills/ directory.

Quick Setup:

  1. Copy the skill folder to .claude/skills/
  2. Claude will automatically detect and use the skill