Web Search

Web Search

Overview

Search the web using DuckDuckGo's API to find information across web pages, news articles, images, and videos. Returns results in multiple formats (text, markdown, JSON) with filtering options for time range, region, and safe search.

When to Use This Skill

Use this skill when users request:

Prerequisites

Install the required dependency:

pip install duckduckgo-search

This library provides a simple Python interface to DuckDuckGo's search API without requiring API keys or authentication.

Core Capabilities

1. Basic Web Search

Search for web pages and information:

python scripts/search.py ""

Example:

python scripts/search.py "python asyncio tutorial"

Returns the top 10 web results with titles, URLs, and descriptions in a clean text format.

2. Limiting Results

Control the number of results returned:

python scripts/search.py "" --max-results 

Example:

python scripts/search.py "machine learning frameworks" --max-results 20

Useful for:

3. Time Range Filtering

Filter results by recency:

python scripts/search.py "" --time-range 

Time range options:

Example:

python scripts/search.py "artificial intelligence news" --time-range w

Great for:

4. News Search

Search specifically for news articles:

python scripts/search.py "" --type news

Example:

python scripts/search.py "climate change" --type news --time-range w --max-results 15

News results include:

5. Image Search

Search for images:

python scripts/search.py "" --type images

Example:

python scripts/search.py "sunset over mountains" --type images --max-results 20

Image filtering options:

Size filters:

python scripts/search.py "landscape photos" --type images --image-size Large

Color filters:

python scripts/search.py "abstract art" --type images --image-color Blue

Type filters:

python scripts/search.py "icons" --type images --image-type transparent

Layout filters:

python scripts/search.py "wallpapers" --type images --image-layout Wide

Image results include:

6. Video Search

Search for videos:

python scripts/search.py "" --type videos

Example:

python scripts/search.py "python tutorial" --type videos --max-results 15

Video filtering options:

Duration filters:

python scripts/search.py "cooking recipes" --type videos --video-duration short

Resolution filters:

python scripts/search.py "documentary" --type videos --video-resolution high

Video results include:

7. Region-Specific Search

Search with region-specific results:

python scripts/search.py "" --region 

Common region codes:

Example:

python scripts/search.py "local news" --region us-en --type news

8. Safe Search Control

Control safe search filtering:

python scripts/search.py "" --safe-search 

Options:

Example:

python scripts/search.py "medical information" --safe-search on

9. Output Formats

Choose how results are formatted:

Text format (default):

python scripts/search.py "quantum computing"

Clean, readable plain text with numbered results.

Markdown format:

python scripts/search.py "quantum computing" --format markdown

Formatted markdown with headers, bold text, and links.

JSON format:

python scripts/search.py "quantum computing" --format json

Structured JSON data for programmatic processing.

10. Saving Results to File

Save search results to a file:

python scripts/search.py "" --output 

Example:

python scripts/search.py "artificial intelligence" --output ai_results.txt
python scripts/search.py "AI news" --type news --format markdown --output ai_news.md
python scripts/search.py "AI research" --format json --output ai_data.json

The file format is determined by the --format flag, not the file extension.

Output Format Examples

Text Format

1. Page Title Here
   URL: https://example.com/page
   Brief description of the page content...
2. Another Result
   URL: https://example.com/another
   Another description...

Markdown Format

## 1. Page Title Here
URL: https://example.com/page
Brief description of the page content...
2. Another Result
URL: https://example.com/another
Another description...

JSON Format

[
  {
    "title": "Page Title Here",
    "href": "https://example.com/page",
    "body": "Brief description of the page content..."
  },
  {
    "title": "Another Result",
    "href": "https://example.com/another",
    "body": "Another description..."
  }
]

Common Usage Patterns

Research on a Topic

Gather comprehensive information about a subject:

# Get overview from web
python scripts/search.py "machine learning basics" --max-results 15 --output ml_web.txt
Get recent news
python scripts/search.py "machine learning" --type news --time-range m --output ml_news.txt
Find tutorial videos
python scripts/search.py "machine learning tutorial" --type videos --max-results 10 --output ml_videos.txt

Current Events Monitoring

Track news on specific topics:

python scripts/search.py "climate summit" --type news --time-range d --format markdown --output daily_climate_news.md

Finding Visual Resources

Search for images with specific criteria:

python scripts/search.py "data visualization examples" --type images --image-type photo --image-size Large --max-results 25 --output viz_images.txt

Fact-Checking

Verify information with recent sources:

python scripts/search.py "specific claim to verify" --time-range w --max-results 20

Academic Research

Find resources on scholarly topics:

python scripts/search.py "quantum entanglement research" --time-range y --max-results 30 --output quantum_research.txt

Market Research

Gather information about products or companies:

python scripts/search.py "electric vehicle market 2025" --max-results 20 --format markdown --output ev_market.md
python scripts/search.py "EV news" --type news --time-range m --output ev_news.txt

Implementation Approach

When users request web searches:

1. Identify search intent: - What type of content (web, news, images, videos)? - How recent should results be? - How many results are needed? - Any filtering requirements?

2. Configure search parameters: - Choose appropriate search type (--type) - Set time range if currency matters (--time-range) - Adjust result count (--max-results) - Apply filters (image size, video duration, etc.)

3. Select output format: - Text for quick reading - Markdown for documentation - JSON for further processing

4. Execute search: - Run the search command - Save to file if results need to be preserved - Print to stdout for immediate review

5. Process results: - Read saved files if needed - Extract URLs or specific information - Combine results from multiple searches

Quick Reference

Command structure:

python scripts/search.py "" [options]

Essential options:

Image-specific options:

Video-specific options:

Get full help:

python scripts/search.py --help

Best Practices

1. Be specific - Use clear, specific search queries for better results 2. Use time filters - Apply --time-range for current information 3. Adjust result count - Start with 10-20 results, increase if needed 4. Save important searches - Use --output to preserve results 5. Choose appropriate type - Use news search for current events, web for general info 6. Use JSON for automation - JSON format is easiest to parse programmatically 7. Respect usage - Don't hammer the API with rapid repeated searches

Troubleshooting

Common issues:

Limitations:

Advanced Use Cases

Combining Multiple Searches

Gather comprehensive information by combining search types:

# Web overview
python scripts/search.py "topic" --max-results 15 --output topic_web.txt
Recent news
python scripts/search.py "topic" --type news --time-range w --output topic_news.txt
Images
python scripts/search.py "topic" --type images --max-results 20 --output topic_images.txt

Programmatic Processing

Use JSON output for automated processing:

python scripts/search.py "research topic" --format json --output results.json
Then process with another script
python analyze_results.py results.json

Building a Knowledge Base

Create searchable documentation from web results:

# Search multiple related topics
python scripts/search.py "topic1" --format markdown --output kb/topic1.md
python scripts/search.py "topic2" --format markdown --output kb/topic2.md
python scripts/search.py "topic3" --format markdown --output kb/topic3.md

Resources

scripts/search.py

The main search tool implementing DuckDuckGo search functionality. Key features:

The script can be executed directly and includes comprehensive command-line help via --help.

Install the required dependency:

pip install duckduckgo-search

This library provides a simple Python interface to DuckDuckGo's search API without requiring API keys or authentication.

1. Be specific - Use clear, specific search queries for better results 2. Use time filters - Apply --time-range for current information 3. Adjust result count - Start with 10-20 results, increase if needed 4. Save important searches - Use --output to preserve results 5. Choose appropriate type - Use news search for current events, web for general info 6. Use JSON for automation - JSON format is easiest to parse programmatically 7. Respect usage - Don't hammer the API with rapid repeated searches