Skill Factory

💡 Examples

"Create a skill for Twitter scraping":

Pull trigger phrases from reddit-scraper

Pull CDP/browser patterns from fast-browser-use

Pull output format (JSON array) from crypto-market-data

Synthesize into twitter-scraper/SKILL.md

---

⚙️ Configuration

Create evals/evals.json:

[
  {
    "id": "basic-create",
    "prompt": "Create a skill that sends a Slack message",
    "expected_output": "SKILL.md with slack-notifier name and working command",
    "assertions": [
      "contains SKILL.md frontmatter with name and description",
      "contains at least one bash command example",
      "description includes trigger phrases"
    ]
  }
]

Eval Run

For each eval case: 1. Execute the prompt using current skill 2. Grade against assertions (pass/fail per assertion) 3. Log result to evals/runs/.json

Run Report Format

{
  "skill": "skill-creator",
  "version": "1.0.0",
  "timestamp": "2026-02-22T03:00:00Z",
  "pass_rate": 0.85,
  "cases": [
    { "id": "basic-create", "passed": true, "assertions_passed": 3, "assertions_total": 3 }
  ]
}

---