🦀 ClawHub
Kekik Crawler
by @keyiflerolsun
Scrapling-only, deterministic web crawler with clean SRP architecture, presets, checkpointing, and JSONL/report outputs.
TERMINAL
clawhub install kekik-crawler📖 About This Skill
name: kekik-crawler description: Scrapling-only, deterministic web crawler with clean SRP architecture, presets, checkpointing, and JSONL/report outputs.
Kekik Crawler
Scrapling tabanlı, browser'sız crawler.
Quick Start
pip install -r requirements.txt
python main.py --urls https://example.org
Presets
python main.py --queries "Ömer Faruk Sancak" keyiflerolsun --preset person-research --out outputs/person.jsonl --report outputs/person-report.json
python main.py --queries "Ömer Faruk Sancak" keyiflerolsun --preset deep-research --out outputs/deep.jsonl --report outputs/deep-report.json
Notes
outputs/main.pycore/crawl_runner.py💡 Examples
pip install -r requirements.txt
python main.py --urls https://example.org
📋 Tips & Best Practices
outputs/main.pycore/crawl_runner.py