🎁 Get the FREE AI Skills Starter Guide β€” Subscribe β†’
BytesAgainBytesAgain
BytesAgain β€Ί Skills β€Ί Scrapeless Webunlocker Skill
πŸ¦€ ClawHub

Scrapeless Webunlocker Skill

by @scrapelesshq

Bypass website blocks and scrape web content using Scrapeless Universal Scraping API.

Versionv1.0.0
#clawhub
πŸ’‘ Examples

Command: 

python3 scripts/webunlocker.py --url "https://example.com"

Examples: 

# Scrape HTML content
python3 scripts/webunlocker.py --url "https://httpbin.io/get"
Scrape plain text

python3 scripts/webunlocker.py --url "https://example.com" --response-type plaintext
Scrape as Markdown

python3 scripts/webunlocker.py --url "https://example.com" --response-type markdown
Take a screenshot

python3 scripts/webunlocker.py --url "https://example.com" --response-type png
Capture network requests

python3 scripts/webunlocker.py --url "https://example.com" --response-type network
Extract specific content types

python3 scripts/webunlocker.py --url "https://example.com" --response-type content --content-types emails,links,images
Use a specific country proxy

python3 scripts/webunlocker.py --url "https://example.com" --country US
Use POST method

python3 scripts/webunlocker.py --url "https://httpbin.org/post" --method POST --data '{"key": "value"}'
Add custom headers

python3 scripts/webunlocker.py --url "https://example.com" --headers '{"User-Agent": "Mozilla/5.0"}'
Use custom proxy

python3 scripts/webunlocker.py --url "https://example.com" --proxy-url "http://your-proxy-url:port"
Enable JavaScript rendering

python3 scripts/webunlocker.py --url "https://example.com" --js-render
Enable JavaScript rendering with headless mode

python3 scripts/webunlocker.py --url "https://example.com" --js-render --headless
Enable JavaScript rendering and wait for specific element

python3 scripts/webunlocker.py --url "https://example.com" --js-render --wait-selector "body > div > p:nth-child(3) > a"
Bypass Cloudflare protection with JavaScript rendering

python3 scripts/webunlocker.py --url "https://example.com" --js-render
Bypass Cloudflare Turnstile challenge

python3 scripts/webunlocker.py --url "https://2captcha.com/demo/cloudflare-turnstile-challenge" --js-render --headless --response-type markdown

πŸ“‹ Tips & Best Practices

⚠️ Timeout Policy:

  • Page load timeout: 30 seconds
  • Global execution timeout: 180 seconds

    • ⚠️ Supported CAPTCHAs:

  • reCaptcha V2
  • Cloudflare Turnstile
  • Cloudflare Challenge

    • ⚠️ Rate Limits:

  • 429 errors indicate rate limit exceeded. Reduce request frequency or upgrade plan.

    • ⚠️ Billing:

  • Charges are applied on a per-request basis
  • Only successful requests will be billed

    • View on ClawHub
    TERMINAL
    clawhub install scrapeless-webunlocker-skill

    πŸ§ͺ Use this skill with your agent

    Most visitors already have an agent. Pick your environment, install or copy the workflow, then run the smoke-test prompt above.

    Manus
    Task-oriented agent. Great for testing AI skills end-to-end.
    Try Manus β†’
    OpenClaw
    Local-first agent. Install skills via ClawHub CLI.
    Set up OpenClaw β†’
    Claude Code
    Anthropic's coding agent. Paste the prompt or SKILL.md into your session.
    Claude Code docs β†’
    Cursor
    AI-powered IDE. Use the smoke-test prompt in Cursor Agent.
    Open Cursor β†’
    Continue.dev
    Open-source AI code assistant. Add SKILL.md as a custom tool.
    Continue docs β†’
    Windsurf
    Agentic IDE by Codeium. Paste the prompt into Cascade.
    Try Windsurf β†’
    Cline
    VS Code extension for autonomous coding with MCP tools.
    Cline on GitHub β†’
    Copilot Workspace
    GitHub's AI dev environment. Suitable for code-generation skills.
    Copilot Workspace β†’

    πŸ” Can't find the right skill?

    Search 60,000+ AI agent skills β€” free, no login needed.

    Search Skills β†’