๐ŸŽ Get the FREE AI Skills Starter Guide โ€” Subscribe โ†’
BytesAgainBytesAgain
๐Ÿฆ€ ClawHub

AI Leaderboard

by @luduoxin

Comprehensive AI leaderboard for LLM models and AI applications. Query model rankings, model IDs, and pricing from OpenRouter, Artificial Analysis, and Pinch...

Versionv1.20.1
Downloads747
TERMINAL
clawhub install ai-leaderboard

๐Ÿ“– About This Skill


name: AI Rankings Leaderboard display_name: AI Rankings Leaderboard / AI ๆŽ’่กŒๆฆœ description: Comprehensive AI leaderboard for LLM models and AI applications. Query model rankings, model IDs, and pricing from OpenRouter, Artificial Analysis, and Pinchbench. Trigger words include "AI rankings", "LLM leaderboard", "model comparison", "AI apps ranking", "best AI models", "model benchmark", "free models", "ๅ…่ดนๆจกๅž‹", "OpenRouter model ID", "OpenRouter ๆจกๅž‹", "Artificial Analysis", "artificial analysis", "AI ๆ™บๅŠ›ๆŒ‡ๆ•ฐ", "intelligence index", "coding index", "codingๆŽ’่กŒๆฆœ", "agentic index", "agenticๆŽ’่กŒๆฆœ", "ๆจกๅž‹้€ŸๅบฆๆŽ’่กŒ", "ๆจกๅž‹ไปทๆ ผๅฏนๆฏ”", "model ID for", "OpenRouter model parameter". version: 1.20.1 cli_dependencies: - agent-browser

AI Rankings Leaderboard Skill

Description

A comprehensive skill for querying AI model and application rankings from multiple authoritative sources. Get the latest insights on LLM performance, popularity, pricing, and value metrics.

Data Sources

| Source | URL | Focus | |--------|-----|-------| | Artificial Analysis | https://artificialanalysis.ai/ | Intelligence Index, Speed, Price benchmarks | | LLM Leaderboard | https://artificialanalysis.ai/leaderboards/models | Model comparison (100+ models) | | LLM API Providers | https://artificialanalysis.ai/leaderboards/providers | API Provider comparison (500+ endpoints) | | Image & Video Leaderboards | https://artificialanalysis.ai/ (Image & Video section) | Image/Video model ELO rankings | | OpenRouter Rankings | https://openrouter.ai/rankings | Model usage & popularity | | OpenRouter Apps | https://openrouter.ai/apps | AI applications ranking | | OpenRouter Models | https://openrouter.ai/models | All available models with pricing | | OpenRouter Free Models | https://openrouter.ai/models?q=free | Free models only | | Pinchbench | https://pinchbench.com/ | Model benchmark (Success Rate, Speed, Cost, Value) |

Features

1. Artificial Analysis LLM Leaderboard

Intelligence Index (ๆ™บๅŠ›ๆŒ‡ๆ•ฐ)

  • Artificial Analysis Intelligence Index v4.0: Comprehensive model intelligence score
  • 10 evaluation dimensions: Multiple independent assessment criteria
  • Frontier Models: Top intelligence models (Gemini 3.1 Pro, GPT-5.4, Claude Opus 4.6, etc.)
  • Reasoning Models: Identifies models with reasoning capabilities
  • Artificial Analysis Coding Index (็ผ–็จ‹่ƒฝๅŠ›ๆŒ‡ๆ•ฐ)

  • URL: https://artificialanalysis.ai/?intelligence=coding-index
  • ่ฏ„ไผฐๆจกๅž‹ๅœจ็ผ–็จ‹ไปปๅŠกไธŠ็š„่กจ็Žฐ
  • ็ปผๅˆๅคšไธชไปฃ็ ่ฏ„ๆต‹ๅŸบๅ‡†
  • Artificial Analysis Agentic Index (ๆ™บ่ƒฝไฝ“่ƒฝๅŠ›ๆŒ‡ๆ•ฐ)

  • URL: https://artificialanalysis.ai/?intelligence=agentic-index
  • ่ฏ„ไผฐๆจกๅž‹็š„่‡ชไธปๆ™บ่ƒฝไฝ“่ƒฝๅŠ›
  • ๅŒ…ๆ‹ฌๅทฅๅ…ทไฝฟ็”จใ€ๅคšๆญฅ้ชคๆŽจ็†ใ€ไปปๅŠกๅฎŒๆˆ็ญ‰
  • Performance Metrics | Metric | Description | |--------|-------------| | Intelligence Index | Overall model intelligence score (higher is better) | | Speed | Output tokens per second (tokens/s) | | Blended Price | Combined USD per million tokens (3:1 input/output ratio) | | Input Price | Price per million input tokens (USD) | | Output Price | Price per million output tokens (USD) | | Latency (TTFT) | Time to First Token in seconds | | Context Window | Maximum context length supported |

    Model Comparison Table Columns | Column | Description | |--------|-------------| | Features | Model features (reasoning badge, etc.) | | Model | Model name with logo | | Context Window | Max context length | | Creator | Provider/Company | | Intelligence Index | AI intelligence score | | Blended USD/1M Tokens | Combined input/output price | | Median Tokens/s | Median output speed | | Latency First Chunk (s) | Time to first token | | Further Analysis | Link to detailed analysis |

    Filters Available | Filter | Options | |--------|---------| | Frontier Models | On/Off | | Open Weights | On/Off (ๅผ€ๆบๆƒ้‡ๆจกๅž‹) | | Size Class | Small, Medium, Large, etc. | | Reasoning | On/Off (ๆŽจ็†ๆจกๅž‹็ญ›้€‰) | | Model Status | Current, Preview, Discontinued |

    2. Artificial Analysis LLM API Providers Leaderboard

    Comparison of 500+ AI Model Endpoints

    | Column | Description | |--------|-------------| | API Provider | Provider name (Cerebras, Groq, Fireworks, etc.) | | Model | Model name | | Context Window | Max context length | | License | Model license | | Intelligence Index | Model intelligence score | | Blended USD/1M Tokens | Combined price | | Median Tokens/s | Output speed | | Median First Chunk (s) | Latency (TTFT) | | Total Response (s) | End-to-end response time | | Reasoning Time (s) | Reasoning model computation time | | End-to-End Response Time | Full request-response cycle |

    Key Providers

  • Cerebras
  • Eigen AI
  • Fireworks
  • SambaNova
  • Together.ai
  • Hyperbolic
  • Nebius Fast
  • Google Vertex
  • Groq
  • Azure OpenAI
  • AWS Bedrock
  • OpenAI Direct
  • Anthropic Direct
  • And 10+ more...
  • 3. Artificial Analysis Image & Video Leaderboards

    Text-to-Image Leaderboard

  • ELO scores from blind preference votes
  • 95% confidence intervals displayed
  • Top models: GPT Image 1.5, Imagen 4 Ultra, Gemini Image models, etc.
  • Video Leaderboards | Category | Description | |----------|-------------| | Text to Video (with Audio) | Text generates video with sound | | Text to Video (without Audio) | Text generates silent video | | Image to Video (with Audio) | Image + text generates video with sound | | Image to Video (without Audio) | Image + text generates silent video | | Image Editing | Edit existing images with AI |

    Evaluation Method

  • ELO scoring system (blind preference voting)
  • 95% confidence intervals
  • Real user preference data
  • 4. OpenRouter Model Rankings

  • LLM Leaderboard: Overall model usage rankings
  • Market Share: Market share by model provider
  • Categories: Rankings by use case
  • Languages: Natural language support rankings
  • Programming: Programming language support
  • Context Length: Long context handling
  • Tool Calls: Tool calling capabilities
  • Images: Image processing volume
  • 5. OpenRouter App Rankings

  • Most Popular: Top apps by token usage
  • Trending: Fastest growing apps this week
  • Categories: Coding Agents, Productivity, Creative, Entertainment
  • 6. OpenRouter Model Catalog

  • All Models: Complete list of available models on OpenRouter
  • Free Models: Models with $0 pricing (free to use)
  • Model ID: The exact model parameter to use when calling OpenRouter API
  • Pricing Info: Input/output token pricing
  • 7. Pinchbench Benchmarks

  • Success Rate: Task completion success percentage
  • Speed: Response time performance
  • Cost: Cost per run analysis
  • Value: Price-performance ratio
  • Trigger Keywords

    General AI Rankings

  • "AI rankings" / "AI ๆŽ’่กŒๆฆœ"
  • "LLM leaderboard" / "LLM ๆŽ’่กŒ"
  • "model comparison" / "ๆจกๅž‹ๅฏนๆฏ”"
  • "best AI models" / "ๆœ€ๅฅฝ็š„ AI ๆจกๅž‹"
  • "AI apps ranking" / "AI ๅบ”็”จๆŽ’่กŒ"
  • "model benchmark" / "ๆจกๅž‹่ฏ„ๆต‹"
  • Artificial Analysis Specific

  • "Artificial Analysis" / "artificialanalysis"
  • "AI intelligence index" / "AI ๆ™บๅŠ›ๆŒ‡ๆ•ฐ"
  • "intelligence index" / "ๆ™บๅŠ›ๆŒ‡ๆ•ฐ"
  • "ๆจกๅž‹้€ŸๅบฆๆŽ’่กŒ" / "speed ranking"
  • "ๆจกๅž‹ไปทๆ ผๅฏนๆฏ”" / "price comparison"
  • "fastest models" / "ๆœ€ๅฟซๆจกๅž‹"
  • "cheapest models" / "ๆœ€ไพฟๅฎœๆจกๅž‹"
  • "tokens per second" / "t/s" / "tokens/s"
  • "latency" / "TTFT" / "้ฆ– token ๅปถ่ฟŸ"
  • "Artificial Analysis Intelligence Index"
  • "AAII" / "AA Intelligence"
  • "API providers" / "API ๆไพ›ๅ•†"
  • "LLM providers" / "LLM ๆไพ›ๅ•†"
  • "Cerebras" / "Groq" / "Fireworks"
  • "open weights" / "ๅผ€ๆบๆƒ้‡"
  • "reasoning models" / "ๆŽจ็†ๆจกๅž‹"
  • "elo score" / "ELO ่ฏ„ๅˆ†"
  • "image arena" / "ๅ›พ็”Ÿๅ›พ"
  • "text to image" / "ๆ–‡็”Ÿๅ›พ"
  • "text to video" / "ๆ–‡็”Ÿ่ง†้ข‘"
  • "image to video" / "ๅ›พ็”Ÿ่ง†้ข‘"
  • OpenRouter Specific

  • "free models" / "ๅ…่ดนๆจกๅž‹" / "free AI models"
  • "OpenRouter models" / "OpenRouter ๅ…่ดนๆจกๅž‹"
  • "OpenRouter rankings" / "OpenRouter ๆŽ’่กŒ"
  • "Pinchbench"
  • "OpenRouter model ID" / "OpenRouter ๆจกๅž‹ ID"
  • "ๆŸฅๆ‰พ OpenRouter" / "OpenRouter ไธŠ็š„ๆจกๅž‹"
  • "model ID for [ๆจกๅž‹ๅ]" / "[ๆจกๅž‹ๅ] model ID"
  • "OpenRouter ไธŠ [ๆจกๅž‹ๅ]" / "OpenRouter [ๆจกๅž‹ๅ] ๆจกๅž‹"
  • "OpenRouter model parameter"
  • "่ฐƒ็”จ้‡ๆŽ’่กŒ" / "ไฝฟ็”จ้‡ๆŽ’่กŒ" / "top models" / "top ๆจกๅž‹"
  • "OpenRouter ่ฐƒ็”จ้‡" / "OpenRouter ไฝฟ็”จ้‡"
  • Runtime Tools

    This skill requires:

  • execute_command: Execute shell commands and scripts
  • use_skill: Load browser-automation skill for JavaScript-rendered pages
  • web_fetch: Fallback for simple HTTP requests
  • Installation

    Required CLI Dependency: agent-browser

    The agent-browser CLI must be installed before using this skill. Install via:

    npm install -g agent-browser
    

    or

    npx agent-browser --version

    This skill calls agent-browser via subprocess with hardcoded argument arrays (no shell injection risk).

    Note on browser eval: The agent-browser eval command executes document.body.innerText or similar DOM queries on the remote page to extract rendered content. This is standard web scraping behavior for JavaScript-rendered pages and is limited to reading page content only.

    Browser Automation Support

    For JavaScript-rendered pages (OpenRouter Rankings, Artificial Analysis), this skill uses browser automation:

    1. Load browser-automation skill first:

       use_skill("browser-automation")
       

    2. Navigate to rankings page:

       agent-browser open "https://artificialanalysis.ai/leaderboards/models"
       agent-browser wait --load networkidle
       agent-browser eval "document.body.innerText"
       

    3. Key pages requiring browser: - https://artificialanalysis.ai/leaderboards/models - LLM comparison (100+ models) - https://artificialanalysis.ai/leaderboards/providers - API providers (500+ endpoints) - https://artificialanalysis.ai/ - Image & Video leaderboards - https://openrouter.ai/rankings - Model usage rankings (JS rendered) - https://openrouter.ai/apps - App rankings (JS rendered)

    Artificial Analysis Page Structure

    LLM Leaderboard Page (/leaderboards/models):

    LLM Leaderboard - Comparison of over 100 AI models
    โ”œโ”€โ”€ HIGHLIGHTS section
    โ”‚   โ”œโ”€โ”€ Intelligence: Gemini 3.1 Pro Preview, GPT-5.4 (xhigh)
    โ”‚   โ”œโ”€โ”€ Speed: Mercury 2 (943 t/s), NVIDIA Nemotron 3 Super (462 t/s)
    โ”‚   โ””โ”€โ”€ Price: Gemma 3n E4B (cheapest)
    โ”œโ”€โ”€ Filters:
    โ”‚   โ”œโ”€โ”€ Frontier Models | Open Weights | Size Class | Reasoning | Model Status
    โ”œโ”€โ”€ Comparison table columns:
    โ”‚   โ”œโ”€โ”€ Features | Model | Context Window | Creator
    โ”‚   โ”œโ”€โ”€ Intelligence Index | Blended USD/1M | Median Tokens/s | Latency
    โ”‚   โ””โ”€โ”€ Further Analysis
    โ””โ”€โ”€ Key definitions (expandable)
        โ”œโ”€โ”€ Context window
        โ”œโ”€โ”€ Output Speed (tokens/s)
        โ”œโ”€โ”€ Latency (Time to First Token)
        โ”œโ”€โ”€ Price (3:1 blended)
        โ”œโ”€โ”€ Output Price
        โ””โ”€โ”€ Input Price
    

    LLM API Providers Page (/leaderboards/providers):

    LLM API Providers Leaderboard - 500+ endpoints
    โ”œโ”€โ”€ Filters (same as LLM Leaderboard)
    โ”œโ”€โ”€ Comparison table columns:
    โ”‚   โ”œโ”€โ”€ API Provider | Model | Context Window | License
    โ”‚   โ”œโ”€โ”€ Intelligence Index | Blended USD/1M | Median Tokens/s
    โ”‚   โ”œโ”€โ”€ Median First Chunk (s) | Total Response (s) | Reasoning Time (s)
    โ”‚   โ””โ”€โ”€ Further Analysis
    โ””โ”€โ”€ 24+ Providers: Cerebras, Groq, Fireworks, SambaNova, etc.
    

    Image & Video Leaderboards (on homepage):

    Image & Video Leaderboards
    โ”œโ”€โ”€ Tabs:
    โ”‚   โ”œโ”€โ”€ Text to Image (ELO scores, 95% CI)
    โ”‚   โ”œโ”€โ”€ Image Editing
    โ”‚   โ”œโ”€โ”€ Text to Video (with Audio)
    โ”‚   โ”œโ”€โ”€ Text to Video (without Audio)
    โ”‚   โ”œโ”€โ”€ Image to Video (with Audio)
    โ”‚   โ””โ”€โ”€ Image to Video (without Audio)
    โ””โ”€โ”€ Top models with ELO rankings
    

    OpenRouter Page Structure (Reminder)

    OpenRouter Rankings Page (/rankings):

    https://openrouter.ai/rankings
    โ”œโ”€โ”€ Top Models (chart header)
    โ”œโ”€โ”€ LLM Leaderboard โ† THIS is the usage ranking (parse this!)
    โ”‚   โ”œโ”€โ”€ 1. MiniMax M2.5 (1.75T tokens)
    โ”‚   โ”œโ”€โ”€ 2. Step 3.5 Flash (1.34T tokens)
    โ”‚   โ””โ”€โ”€ [Show more] button
    โ”œโ”€โ”€ Market Share (different metric - don't mix!)
    โ””โ”€โ”€ ...
    

    Usage Examples

    Query Artificial Analysis Intelligence Index

    User: "What are the top models on Artificial Analysis Intelligence Index?"
    -> Fetches Artificial Analysis LLM Leaderboard and displays top models by intelligence
    

    Query Model Speed Rankings

    User: "Which AI models are the fastest in terms of output speed?"
    -> Fetches Artificial Analysis data and lists models by tokens/second
    

    Query API Providers

    User: "Compare LLM API providers like Cerebras and Groq"
    -> Fetches Artificial Analysis Providers Leaderboard and compares speed/price
    

    Query Image/Video Models

    User: "What are the best text-to-image models?"
    -> Fetches Artificial Analysis Image Arena leaderboard with ELO scores
    

    Query Model Rankings (OpenRouter)

    User: "What are the top 10 AI models right now?"
    -> Fetches OpenRouter rankings and displays top models with usage stats
    

    Query Free Models

    User: "What free models are available on OpenRouter?"
    -> Fetches https://openrouter.ai/models?q=free and lists all free models with their model IDs
    

    Get Model ID for API Calls

    User: "What's the model ID for GPT-4o on OpenRouter?"
    -> Fetches https://openrouter.ai/models and returns the exact model parameter to use
    

    Compare Model Performance

    User: "Compare GPT-4 and Claude on Pinchbench"
    -> Fetches Pinchbench data and compares success rate, speed, cost
    

    Output Format

    Artificial Analysis Intelligence Index

    ==================================================
        Artificial Analysis Intelligence Index
    ==================================================

    Top 10 Models by Intelligence:

    | Rank | Model | Intelligence | Speed (t/s) | Price ($/M) | |------|-------|--------------|-------------|-------------| | 1 | Gemini 3.1 Pro Preview | 57 | ~50 | $1.25 | | 2 | GPT-5.4 (xhigh) | 57 | ~60 | $15.00 | | 3 | Claude Opus 4.6 (max) | 53 | ~80 | $18.00 | | 4 | Claude Sonnet 4.6 (max) | 52 | ~85 | $4.50 | | 5 | GLM-5 | 50 | ~45 | $0.50 | ...

    Fastest Models: Mercury 2 (943 t/s), NVIDIA Nemotron 3 Super (462 t/s) Best Price: Gemma 3n E4B, Granite 4.0 H Small

    Data Source: Artificial Analysis (artificialanalysis.ai) ==================================================

    API Providers Comparison

    ==================================================
        LLM API Providers Leaderboard
    ==================================================

    | Provider | Model | Speed (t/s) | Price ($/M) | Latency (s) | |----------|-------|-------------|-------------|-------------| | Cerebras | Llama 3.1 70B | 2143 | $0.12 | 0.08 | | Groq | Llama 3.1 70B | 943 | $0.59 | 0.15 | | Fireworks | Llama 3.1 70B | 562 | $0.90 | 0.22 | ...

    Data Source: Artificial Analysis Providers ==================================================

    Image Arena (ELO Rankings)

    ==================================================
        Text-to-Image Leaderboard (ELO)
    ==================================================

    | Rank | Model | ELO Score | 95% CI | |------|-------|-----------|--------| | 1 | GPT Image 1.5 (high) | 1342 | ยฑ12 | | 2 | Imagen 4 Ultra | 1289 | ยฑ15 | | 3 | Gemini 3.1 Flash Image | 1245 | ยฑ18 | ...

    Data Source: Artificial Analysis Image Arena ==================================================

    OpenRouter Model Rankings

    ==================================================
        AI Model Rankings (OpenRouter)
    ==================================================

    Top 10 Models by Usage:

    | Rank | Model | Provider | Tokens | Growth | |------|-------|----------|--------|--------| | 1 | MiniMax M2.5 | minimax | 1.75T | +15% | | 2 | Step 3.5 Flash | step | 1.34T | +22% | ...

    Data Source: OpenRouter (Weekly Rankings) ==================================================

    Free Models List

    ==================================================
        Free Models on OpenRouter
    ==================================================

    | Model Name | Model ID (for API) | Context | |------------|-------------------|---------| | GPT-4o Mini | openai/gpt-4o-mini | 128K | | Llama 3.3 70B | meta-llama/llama-3.3-70b-instruct | 128K | | DeepSeek V3 | deepseek/deepseek-chat | 64K | ...

    ๐Ÿ’ก Usage: Set model parameter to the Model ID value Example: model="openai/gpt-4o-mini"

    Data Source: OpenRouter Models ==================================================

    Execution Instructions

    Method 1: Browser Automation for Rankings (Recommended)

    Artificial Analysis and OpenRouter rankings pages require JavaScript rendering:

    # Step 1: Load browser-automation skill (REQUIRED)
    use_skill("browser-automation")

    Step 2: Navigate to Artificial Analysis LLM Leaderboard

    agent-browser open "https://artificialanalysis.ai/leaderboards/models" agent-browser wait --load networkidle

    Step 3: Wait for content to load, then extract

    agent-browser wait 3000 agent-browser eval "document.body.innerText"

    Step 4: Close browser when done

    agent-browser close

    Method 2: Python Script for OpenRouter Model Catalog

    Use the query_leaderboard.py script to fetch model data via OpenRouter API (no JavaScript needed):

    # List free models
    python3 "${SKILL_DIR}/query_leaderboard.py --free"

    Search models by name

    python3 "${SKILL_DIR}/query_leaderboard.py -s glm" python3 "${SKILL_DIR}/query_leaderboard.py -s gpt"

    Get specific model info

    python3 "${SKILL_DIR}/query_leaderboard.py --id openai/gpt-4o"

    List all models with limit

    python3 "${SKILL_DIR}/query_leaderboard.py --all --limit 50"

    Method 3: Web Fetch (Fallback)

    When browser/Python is not available, use web_fetch:

    1. For Artificial Analysis: Fetch https://artificialanalysis.ai/leaderboards/models 2. For OpenRouter model catalog: Use OpenRouter API https://openrouter.ai/api/v1/models 3. For benchmarks: Fetch https://pinchbench.com/

    Note: Rankings pages require JavaScript rendering - use browser automation (Method 1).

    Notes

  • Data is updated regularly (Artificial Analysis, OpenRouter weekly, Pinchbench near real-time)
  • Artificial Analysis Intelligence Index is based on 10 independent evaluations
  • ELO scores are from blind preference voting with 95% confidence intervals
  • Pinchbench disclaimer: "For entertainment purposes only, should not be relied upon for critical decisions"
  • Rankings reflect actual usage data from millions of users
  • Free models have $0.00 pricing on OpenRouter
  • Model ID format: Use the exact string (e.g., openai/gpt-4o-mini) as the model parameter in API calls
  • Artificial Analysis API Patterns

    Based on observed page structure, Artificial Analysis provides:

  • Model comparison data: https://artificialanalysis.ai/leaderboards/models
  • Provider comparison: https://artificialanalysis.ai/leaderboards/providers
  • Image/Video arenas: Embedded on homepage with tab navigation
  • Model-specific provider data: /models/{model-id}/providers endpoint pattern
  • Example model providers API:

    /models/gpt-oss-120b/providers
    /models/gemini-3-1-pro-preview/providers
    /models/claude-opus-4-6-adaptive/providers
    

    OpenRouter API Usage

    When calling OpenRouter API (for chat completions), use the Model ID. Note: This skill's scripts (fetch_rankings.py, query_leaderboard.py) only read public leaderboard data and do NOT require API authentication.

    curl https://openrouter.ai/api/v1/chat/completions \
      -H "Authorization: Bearer $OPENROUTER_API_KEY" \
      -H "Content-Type: application/json" \
      -d '{
        "model": "openai/gpt-4o-mini",  # <- Model ID from this skill
        "messages": [{"role": "user", "content": "Hello"}]
      }'
    

    ๐Ÿ“‹ Tips & Best Practices

  • Data is updated regularly (Artificial Analysis, OpenRouter weekly, Pinchbench near real-time)
  • Artificial Analysis Intelligence Index is based on 10 independent evaluations
  • ELO scores are from blind preference voting with 95% confidence intervals
  • Pinchbench disclaimer: "For entertainment purposes only, should not be relied upon for critical decisions"
  • Rankings reflect actual usage data from millions of users
  • Free models have $0.00 pricing on OpenRouter
  • Model ID format: Use the exact string (e.g., openai/gpt-4o-mini) as the model parameter in API calls