🎁 Get the FREE AI Skills Starter Guide β€” Subscribe β†’
BytesAgainBytesAgain
BytesAgain β€Ί Skills β€Ί Signal Pipeline
πŸ¦€ ClawHub

Signal Pipeline

by @mephistophelesbits

Marketing intelligence pipeline - gather signals from RSS, X/Twitter, Telegram, and Gmail newsletters. Generate daily posts, weekly summaries, and monthly de...

Versionv1.1.0
Downloads1,328
#devops#social-media#email-marketing#legal#automation
TERMINAL
clawhub install signal-pipeline

πŸ“– About This Skill

name: signal-pipeline description: Marketing intelligence pipeline - gather signals from RSS, X/Twitter, Telegram, and Gmail newsletters. Generate daily posts, weekly summaries, and monthly deep-dives for content creation. Use when you need to build a content intelligence system or track marketing/tech trends.

Signal Pipeline

A marketing intelligence pipeline that aggregates signals from multiple sources, stores them in SQLite, and generates content for personal branding.

What It Does

  • RSS feeds β†’ SQLite database (rss_db.py)
  • X/Twitter β†’ SQLite database (x_monitor.py)
  • Telegram channels β†’ SQLite database (telegram_monitor.py)
  • Gmail newsletters β†’ Signal extraction (newsletter_monitor.py)
  • Daily signals β†’ Draft posts
  • Weekly synthesis β†’ Theme analysis
  • Monthly deep-dive β†’ Essay/book chapter

    • Files Included

    signal-pipeline/
β”œβ”€β”€ SKILL.md              # This file
β”œβ”€β”€ README.md             # Setup instructions
β”œβ”€β”€ requirements.txt      # Python dependencies
β”œβ”€β”€ daily_signals.py      # Main script (daily/weekly/monthly)
β”œβ”€β”€ rss_db.py           # RSS feed storage
β”œβ”€β”€ x_monitor.py        # X/Twitter monitoring
β”œβ”€β”€ telegram_monitor.py  # Telegram channel scraping
└── newsletter_monitor.py # Gmail newsletter extraction

    Quick Start

    # Install dependencies
cd skills/signal-pipeline
pip install -r requirements.txt
    Run daily signals
    
python daily_signals.py
    Generate weekly summary
    
python daily_signals.py --weekly
    Generate monthly report
    
python daily_signals.py --monthly

    Configuration

    RSS Feeds

    Edit rss_db.py to add your feed URLs: 
    new_feeds = [
    ('Feed Name', 'https://example.com/feed.xml'),
]

    Telegram Channels

    Edit telegram_monitor.py: 
    CHANNELS = ['channel_name_1', 'channel_name_2']

    X Accounts

    Edit x_monitor.py: 
    MONITOR_URLS = [
    'https://x.com/username/status/123456789',
]

    Gmail Newsletters

    The newsletter_monitor.py uses gog CLI. Ensure it's configured: 
    gog gmail search 'newer_than:30d label:newsletter'

    Requirements

  • Python 3.8+
  • feedparser>=6.0.0
  • beautifulsoup4>=4.12.0
  • requests>=2.31.0
  • httpx>=0.25.0

    • Database

    Three SQLite databases are created:

  • rss_db.db - RSS articles
  • x_monitor.db - X/Twitter data
  • telegram_db.db - Telegram posts

    • Use Cases

    1. Content Creation - Daily signals for X/LinkedIn posts 2. Market Research - Track industry trends 3. Competitive Intelligence - Monitor competitors 4. Personal Branding - Build content streak 5. Book Writing - Compile monthly insights

    Author

    Open source - free to use and modify.

    ⚑ When to Use

    TriggerAction
    2. **Market Research** - Track industry trends
    3. **Competitive Intelligence** - Monitor competitors
    4. **Personal Branding** - Build content streak
    5. **Book Writing** - Compile monthly insights

    πŸ’‘ Examples

    # Install dependencies
cd skills/signal-pipeline
pip install -r requirements.txt
    Run daily signals
    
python daily_signals.py
    Generate weekly summary
    
python daily_signals.py --weekly
    Generate monthly report
    
python daily_signals.py --monthly

    βš™οΈ Configuration

    RSS Feeds

    Edit rss_db.py to add your feed URLs: 
    new_feeds = [
    ('Feed Name', 'https://example.com/feed.xml'),
]

    Telegram Channels

    Edit telegram_monitor.py: 
    CHANNELS = ['channel_name_1', 'channel_name_2']

    X Accounts

    Edit x_monitor.py: 
    MONITOR_URLS = [
    'https://x.com/username/status/123456789',
]

    Gmail Newsletters

    The newsletter_monitor.py uses gog CLI. Ensure it's configured: 
    gog gmail search 'newer_than:30d label:newsletter'