π¦ ClawHub
Sitemap Generator
by @charlie-morrison
Generate XML sitemaps by crawling a website or scanning local files. Auto-discovers pages via link extraction. Supports local HTML/MD file scanning with last...
βοΈ Configuration
| Flag | Default | Description |
|------|---------|-------------|
| --max-pages | 500 | Maximum pages to crawl |
| --timeout | 10 | Request timeout in seconds |
| --output / -o | stdout | Save sitemap.xml to file |
| --robots | off | Also generate robots.txt |
| --local | off | Scan local directory instead of crawling |
| --base-url | β | Base URL for local mode (required) |
| --verbose / -v | off | Show crawl progress |
TERMINAL
clawhub install cm-sitemap-generator