Arya Model Router

Efficiently routes tasks between cheap, default, and pro models using optional sub-agents and briefing to minimize token use and cost.

Llm As Judge

Build a cost-efficient LLM evaluation ensemble with sampling, tiebreakers, and deterministic validators. Learned from 600+ production runs judging local Olla...

Aa Benchmarking Framework

Composite scoring and efficiency frontier analysis for LLM evaluation — combines multiple quality dimensions (accuracy, latency, cost, consistency) into a si...

Aoineco Ledger — AI Agent Financial Tracking Engine

Track detailed AI agent expenses, revenues, budgets, and ROI with per-agent attribution and alerts for efficient micro-budget financial management.

Llm As Judge

Build a cost-efficient LLM evaluation ensemble with sampling, tiebreakers, and deterministic validators. Learned from 600+ production runs judging local Olla...

skill-evaluation

Evaluate any AI skill's quality through step-by-step diagnosis — measuring trigger accuracy, per-step execution (completion/correctness/quality), efficiency,...

War Room Debug

Facilitates coordinated crisis response using multiple agents to assess, investigate, fix, and document critical production issues efficiently.