🎁 Get the FREE AI Skills Starter Guide β€” Subscribe β†’
BytesAgainBytesAgain
πŸ¦€ ClawHub

Notcrawl

by @openclaw

Notion archive: search, sync freshness, pages/databases, Markdown exports, SQL counts, and Notcrawl repo work.

Versionv1.0.1
Downloads655
Stars⭐ 2
TERMINAL
clawhub install notcrawl

πŸ“– About This Skill


name: notcrawl description: Mirror a Notion workspace into local SQLite + normalized Markdown for search, diff, and agent queries without depending on the Notion UI. homepage: https://github.com/vincentkoc/notcrawl metadata: {"clawdbot":{"emoji":"πŸ“","os":["darwin","linux"],"requires":{"bins":["notcrawl"],"env":["NOTION_API_KEY"]},"install":[{"id":"release","kind":"github-release","repo":"vincentkoc/notcrawl","asset":"notcrawl_*_darwin_arm64.tar.gz","bins":["notcrawl"],"label":"Install notcrawl (GitHub release)"}]}}

Notcrawl

Local-first Notion crawler. Pulls pages, databases, and blocks into a SQLite store and emits normalized Markdown alongside, so PaperBrain can absorb Notion content into the vault graph.

Requirements

  • Notion internal integration token. Create at https://www.notion.so/profile/integrations β†’ New integration β†’ copy the secret (secret_… or ntn_…).
  • Share each Notion page or database with the integration (Notion's … menu β†’ Connections β†’ add your integration). Notcrawl can only see what the integration is invited to.
  • notcrawl binary on PATH (installed at ~/.local/bin/notcrawl).
  • Setup

    export NOTION_API_KEY="ntn_…"
    notcrawl init                              # create ~/.notcrawl/config.toml + db
    notcrawl sync --full                       # initial pull of all shared content
    notcrawl export-md --out ~/.notcrawl/md    # dump normalized Markdown
    

    State

  • Config: ~/.notcrawl/config.toml
  • Database: ~/.notcrawl/notcrawl.db
  • Markdown export: ~/.notcrawl/md/ (configurable)
  • Common Commands

    notcrawl status --json
    notcrawl sync --incremental
    notcrawl pages list --json
    notcrawl search "OKR" --json
    notcrawl export-md --out              # regenerate Markdown
    notcrawl sql 'SELECT count(*) FROM pages'
    

    Integration Notes

  • Markdown export is the bridge to PaperVault β€” point --out at a vault folder (e.g. KNOWLEDGE/notion/) to fold Notion content into the graph.
  • Schedule notcrawl sync --incremental + notcrawl export-md via PaperFang for hands-free mirroring.
  • Diff-friendly: Markdown output is deterministic, so changes show up cleanly in git.
  • βš™οΈ Configuration

    export NOTION_API_KEY="ntn_…"
    notcrawl init                              # create ~/.notcrawl/config.toml + db
    notcrawl sync --full                       # initial pull of all shared content
    notcrawl export-md --out ~/.notcrawl/md    # dump normalized Markdown