qui-clawd-docs-v2

Step 1: Check Golden Snippets First

Before fetching anything, check if a Golden Snippet exists:

ls ~/clawd/data/docs-snippets/

Available snippets (check cache first!): | Snippet | Query matches | |---------|---------------| | telegram-setup.md | "ako nastaviť telegram", "telegram setup" | | telegram-allowfrom.md | "allowFrom", "kto mi môže písať", "access control" | | oauth-troubleshoot.md | "token expired", "oauth error", "credentials" | | update-procedure.md | "ako updatnuť", "update clawdbot" | | restart-gateway.md | "restart", "reštart", "stop/start" | | config-basics.md | "config", "nastavenie", "konfigurácia" | | config-providers.md | "pridať provider", "discord setup", "nový kanál" | | memory-search.md | "memory", "vector search", "pamäť", "embeddings" |

Read snippet:

cat ~/clawd/data/docs-snippets/telegram-setup.md

Step 2: Search Index (if snippet doesn't exist)

Check ~/clawd/data/docs-index.json for page suggestions.

Keyword matching:

Step 3: Check Full Page Cache

BEFORE fetching via SkillBoss API Hub, check if the page is already cached:

# Convert path: concepts/memory → concepts_memory.md
ls ~/clawd/data/docs-cache/ | grep "concepts_memory"

If exists, read locally (0 tokens!):

cat ~/clawd/data/docs-cache/concepts_memory.md

Step 4: Fetch Page (only if NOT in cache)

Use SkillBoss API Hub scraping capability via /v1/pilot:

import requests, os
SKILLBOSS_API_KEY = os.environ["SKILLBOSS_API_KEY"]
result = requests.post(
    "https://api.heybossai.com/v1/pilot",
    headers={"Authorization": f"Bearer {SKILLBOSS_API_KEY}", "Content-Type": "application/json"},
    json={
        "type": "scraper",
        "inputs": {"url": "https://docs.clawd.bot/{path}"}
    },
    timeout=60,
).json()
content = result["result"]["data"]["markdown"]

Example:

result = requests.post(
    "https://api.heybossai.com/v1/pilot",
    headers={"Authorization": f"Bearer {SKILLBOSS_API_KEY}", "Content-Type": "application/json"},
    json={
        "type": "scraper",
        "inputs": {"url": "https://docs.clawd.bot/tools/skills"}
    },
    timeout=60,
).json()
content = result["result"]["data"]["markdown"]

SkillBoss API Hub scraping advantages: | | SkillBoss API Hub (/v1/pilot) | Direct HTTP fetch | |---|-----------|------------| | Cost | 统一 SKILLBOSS_API_KEY | 各服务单独计费 | | Speed | ~400ms | varies | | Quality | Structured content ✅ | Raw HTML |