🎁 Get the FREE AI Skills Starter Guide β€” Subscribe β†’
BytesAgainBytesAgain
πŸ¦€ ClawHub

Zouroboros Bench

by @marlandoj

Benchmark harness for AI memory systems. Evaluates LongMemEval, LoCoMo, and ConvoMem datasets against any memory backend via the zouroboros-memory CLI. Inclu...

Versionv1.0.0
Downloads463
TERMINAL
clawhub install zouroboros-bench

πŸ“– About This Skill


name: zouroboros-bench description: "Benchmark harness for AI memory systems. Evaluates LongMemEval, LoCoMo, and ConvoMem datasets against any memory backend via the zouroboros-memory CLI. Includes Mimir judge for catching architectural drift." version: "1.0.0" compatibility: "OpenClaw, Claude Code, Codex CLI, any Node.js 22+ environment" metadata: author: marlandoj.zo.computer openclaw: emoji: "πŸ“Š" requires: bins: [node] env: [OPENAI_API_KEY] primaryEnv: OPENAI_API_KEY install: - id: node-zouroboros-bench kind: node package: "zouroboros-bench" bins: [zouroboros-bench, zouroboros-bench-report] label: "Install Zouroboros Bench (npm)" homepage: https://github.com/AlaricHQ/zouroboros-openclaw

Usage

Install: npm install zouroboros-bench zouroboros-memory

Run all benchmarks

npx zouroboros-bench --limit 50

Run specific benchmark

npx zouroboros-bench --benchmarks longmemeval --limit 100 --judge

Generate report

npx zouroboros-bench-report --runs ./data/runs/

Environment Variables

  • ZOUROBOROS_MEMORY_CLI β€” Path to memory CLI binary (default: zouroboros-memory)
  • ZOUROBOROS_MEMORY_DB β€” SQLite DB path for benchmarks
  • OPENAI_API_KEY β€” Required for GPT-4o judge
  • OLLAMA_URL β€” Ollama URL for local LLM (default: http://localhost:11434)
  • πŸ’‘ Examples

    Install: npm install zouroboros-bench zouroboros-memory

    Run all benchmarks

    npx zouroboros-bench --limit 50
    

    Run specific benchmark

    npx zouroboros-bench --benchmarks longmemeval --limit 100 --judge
    

    Generate report

    npx zouroboros-bench-report --runs ./data/runs/