🎁 Get the FREE AI Skills Starter Guide β€” Subscribe β†’
BytesAgainBytesAgain
πŸ¦€ ClawHub

X (Twitter) Data Scraper

by @lamtest556-blip

X (Twitter) data extraction and analysis. Use when user asks to "get tweets from @username", "search X for", "analyze Twitter data", "fetch tweets about [top...

Versionv1.0.1
Downloads673
TERMINAL
clawhub install claude-code-x-scraper

πŸ“– About This Skill


name: claude-code-x-scraper description: X (Twitter) data extraction and analysis. Use when user asks to "get tweets from @username", "search X for", "analyze Twitter data", "fetch tweets about [topic]", or "scrape X posts". Supports user timelines, keyword search, tweet details, and social media research workflows.

X (Twitter) Data Scraper

Extract and analyze X/Twitter data programmatically.

When to Use

  • Fetch tweets from a specific user
  • Search X for keywords/topics
  • Analyze Twitter data and sentiment
  • Monitor social media trends
  • Quick Start

    # Get user tweets
    python3 scripts/get_user_tweets.py elonmusk 20

    Search for topic

    python3 scripts/search_tweets.py "machine learning" 30

    Setup

    Credentials: Create ~/.openclaw/credentials/x_api_tokens.env:

    X_BEARER_TOKEN=Bearer YOUR_TOKEN_HERE
    

    Get token: https://developer.twitter.com/en/portal/dashboard

    Scripts

    | Script | Purpose | |--------|---------| | get_user_tweets.py | Fetch user timeline | | search_tweets.py | Search by keyword | | fetch_x_playwright.py | Browser-based scraping | | x_api_client.py | API client module |

    Advanced Search

    # Exclude replies/retweets
    python3 scripts/get_user_tweets.py elonmusk 20 --no-replies --no-retweets

    Complex search

    python3 scripts/search_tweets.py "(AI OR ML) from:elonmusk lang:en" 20

    Troubleshooting

  • 401 Unauthorized: Check Bearer token format
  • 403 Forbidden: Search API needs Elevated access
  • 429 Rate Limited: Wait 15 minutes
  • License

    MIT

    ⚑ When to Use

    TriggerAction
    - Search X for keywords/topics
    - Analyze Twitter data and sentiment
    - Monitor social media trends

    πŸ’‘ Examples

    # Get user tweets
    python3 scripts/get_user_tweets.py elonmusk 20

    Search for topic

    python3 scripts/search_tweets.py "machine learning" 30

    βš™οΈ Configuration

    Credentials: Create ~/.openclaw/credentials/x_api_tokens.env:

    X_BEARER_TOKEN=Bearer YOUR_TOKEN_HERE
    

    Get token: https://developer.twitter.com/en/portal/dashboard

    πŸ“‹ Tips & Best Practices

  • 401 Unauthorized: Check Bearer token format
  • 403 Forbidden: Search API needs Elevated access
  • 429 Rate Limited: Wait 15 minutes