π¦ ClawHub
Web Scraper
by @rupertnt034
Extract and export structured web data like text, tables, and images in JSON, CSV, Markdown, or SQL formats while respecting ethical and legal scraping pract...
TERMINAL
clawhub install rupert-web-scraperπ About This Skill
Web Scraper Skill
Overview
Extract data from websites efficiently and ethically.Capabilities
1. Data Extraction
2. Formats
3. Features
4. Ethical Scraping
Usage
Commands
scrape [URL] for [data]extract [element] from [URL]get table from [URL]crawl [website] depth [n]export [URL] to [format]Examples
Input: "scrape example.com for product names and prices" Output:
{
"products": [
{"name": "Product A", "price": "$19.99"},
{"name": "Product B", "price": "$29.99"}
]
}
Configuration
Rate Limits
Output Options
Best Practices
1. Always identify yourself 2. Cache responses 3. Handle errors gracefully 4. Stay within legal bounds 5. Don't overwhelm serversπ‘ Examples
Input: "scrape example.com for product names and prices" Output:
{
"products": [
{"name": "Product A", "price": "$19.99"},
{"name": "Product B", "price": "$29.99"}
]
}
βοΈ Configuration
Rate Limits
Output Options
π Tips & Best Practices
1. Always identify yourself 2. Cache responses 3. Handle errors gracefully 4. Stay within legal bounds 5. Don't overwhelm servers