Tabstack Extractor

Tabstack Extractor

Overview

This skill enables structured data extraction from websites using the Tabstack API. It's ideal for web scraping tasks where you need consistent, schema-based data extraction from job boards, news sites, product pages, or any structured content.

Quick Start

1. Install Babashka (if needed)

# Option A: From GitHub (recommended for sharing)
curl -s https://raw.githubusercontent.com/babashka/babashka/master/install | bash
Option B: From Nix
nix-shell -p babashka
Option C: From Homebrew
brew install borkdude/brew/babashka

2. Set up API Key

Option A: Environment variable (recommended)

export TABSTACK_API_KEY="your_api_key_here"

Option B: Configuration file

mkdir -p ~/.config/tabstack
echo '{:api-key "your_api_key_here"}' > ~/.config/tabstack/config.edn

Get an API key: Sign up at Tabstack Console

3. Test Connection

bb scripts/tabstack.clj test

4. Extract Markdown (Simple)

bb scripts/tabstack.clj markdown "https://example.com"

5. Extract JSON (Start Simple)

# Start with simple schema (fast, reliable)
bb scripts/tabstack.clj json "https://example.com" references/simple_article.json
Try more complex schemas (may be slower)
bb scripts/tabstack.clj json "https://news.site" references/news_schema.json

6. Advanced Features

# Extract with retry logic (3 retries, 1s delay)
bb scripts/tabstack.clj json-retry "https://example.com" references/simple_article.json
Extract with caching (24-hour cache)
bb scripts/tabstack.clj json-cache "https://example.com" references/simple_article.json
Batch extract from URLs file
echo "https://example.com" > urls.txt
echo "https://example.org" >> urls.txt
bb scripts/tabstack.clj batch urls.txt references/simple_article.json

Core Capabilities

1. Markdown Extraction

When to use: When you need the textual content of a page without the HTML clutter.

Example use cases:

2. JSON Schema Extraction

When to use: When scraping job listings, product pages, news articles, or any structured data.

Example use cases:

3. Schema Templates

Available schemas:

Workflow: Job Scraping Example

Follow this workflow to scrape job listings:

1. Identify target sites - BuiltIn, LinkedIn, company career pages 2. Choose or create schema - Use references/job_schema.json or customize 3. Test extraction - Run a single page to verify schema works 4. Scale up - Process multiple URLs 5. Store results - Save to database or file

Example job schema:

{
  "type": "object",
  "properties": {
    "title": {"type": "string"},
    "company": {"type": "string"},
    "location": {"type": "string"},
    "description": {"type": "string"},
    "salary": {"type": "string"},
    "apply_url": {"type": "string"},
    "posted_date": {"type": "string"},
    "requirements": {"type": "array", "items": {"type": "string"}}
  }
}

Integration with Other Skills

Combine with Web Search

Combine with Browser Automation

Error Handling

Common issues and solutions:

1. Authentication failed - Check TABSTACK_API_KEY environment variable 2. Invalid URL - Ensure URL is accessible and correct 3. Schema mismatch - Adjust schema to match page structure 4. Rate limiting - Add delays between requests

Resources

scripts/

references/

Best Practices

1. Start small - Test with single pages before scaling 2. Respect robots.txt - Check site scraping policies 3. Add delays - Avoid overwhelming target sites 4. Validate schemas - Test schemas on sample pages 5. Handle errors gracefully - Implement retry logic for failed requests

Teaching Focus: How to Create Schemas

This skill is designed to teach agents how to use Tabstack API effectively. The key is learning to create appropriate JSON schemas for different websites.

Learning Path

See Schema Creation Guide for detailed instructions and examples.

Common Mistakes to Avoid

Babashka Advantages

Using Babashka for this skill provides:

1. Single binary - Easy to share/install (GitHub releases, brew, nix) 2. Fast startup - No JVM warmup, ~50ms startup time 3. Built-in HTTP client - No external dependencies 4. Clojure syntax - Familiar to you (Wes), expressive 5. Retry logic & caching - Built into the skill 6. Batch processing - Parallel extraction for multiple URLs

Example User Requests

For this skill to trigger:

1. Install Babashka (if needed)

# Option A: From GitHub (recommended for sharing)
curl -s https://raw.githubusercontent.com/babashka/babashka/master/install | bash
Option B: From Nix
nix-shell -p babashka
Option C: From Homebrew
brew install borkdude/brew/babashka

2. Set up API Key

Option A: Environment variable (recommended)

export TABSTACK_API_KEY="your_api_key_here"

Option B: Configuration file

mkdir -p ~/.config/tabstack
echo '{:api-key "your_api_key_here"}' > ~/.config/tabstack/config.edn

Get an API key: Sign up at Tabstack Console

3. Test Connection

bb scripts/tabstack.clj test

4. Extract Markdown (Simple)

bb scripts/tabstack.clj markdown "https://example.com"

5. Extract JSON (Start Simple)

# Start with simple schema (fast, reliable)
bb scripts/tabstack.clj json "https://example.com" references/simple_article.json
Try more complex schemas (may be slower)
bb scripts/tabstack.clj json "https://news.site" references/news_schema.json

6. Advanced Features

# Extract with retry logic (3 retries, 1s delay)
bb scripts/tabstack.clj json-retry "https://example.com" references/simple_article.json
Extract with caching (24-hour cache)
bb scripts/tabstack.clj json-cache "https://example.com" references/simple_article.json
Batch extract from URLs file
echo "https://example.com" > urls.txt
echo "https://example.org" >> urls.txt
bb scripts/tabstack.clj batch urls.txt references/simple_article.json

1. Start small - Test with single pages before scaling 2. Respect robots.txt - Check site scraping policies 3. Add delays - Avoid overwhelming target sites 4. Validate schemas - Test schemas on sample pages 5. Handle errors gracefully - Implement retry logic for failed requests