Smart Web Search
by @davidme6
Smart Web Search v3.1 - Intelligent search with Baidu (China) and Google (International) as primary engines. Real-time news, ad filtering, content de-toxicat...
clawhub install smart-web-search๐ About This Skill
name: smart-web-search description: Smart Web Search v3.1 - Intelligent search with Baidu (China) and Google (International) as primary engines. Real-time news, ad filtering, content de-toxication, multi-engine aggregation. Auto-detects query language for accurate results. version: 3.1.0 author: Jarvis triggers: - search - find - web search - real-time news - latest news - today news - latest - verified search - safe search - filter ads - no ads - search with Baidu - search with Google
๐ Smart Web Search v3.1
Primary Engines: Baidu (China) + Google (International)
Core Features:
Auto-selects optimal search engine based on query content.
๐ง Intelligent Detection Logic
Use Baidu Search (China) When:
Use Google Search (International) When:
๐ง Tool Calls
Domestic Search (Chinese Queries)
Primary Engine (Baidu):
web_fetch(url="https://www.baidu.com/s?wd=query", extractMode="text", maxChars=15000)
Advanced Search:
# Exact match
web_fetch(url="https://www.baidu.com/s?wd=\"exact+keyword\"", extractMode="text", maxChars=15000)Exclude site
web_fetch(url="https://www.baidu.com/s?wd=keyword+-site:zhihu.com", extractMode="text", maxChars=15000)File type
web_fetch(url="https://www.baidu.com/s?wd=keyword+filetype:pdf", extractMode="text", maxChars=15000)
Real-time News:
# Latest 24 hours
web_fetch(url="https://www.baidu.com/s?wd=query+2026-03-17&src=news", extractMode="text", maxChars=15000)Latest 7 days
web_fetch(url="https://www.baidu.com/s?wd=query+this+week&src=news", extractMode="text", maxChars=15000)
Backup Engines (by priority):
1. 360 Search: https://m.so.com/s?q=query
2. Sogou WeChat: https://weixin.sogou.com/weixin?type=2&query=query
3. Bing CN: https://cn.bing.com/search?q=query
4. Sogou Web: https://www.sogou.com/web?query=query
5. Toutiao: https://www.toutiao.com/search/?keyword=query
Baidu Advantages:
International Search (English Queries)
Primary Engine (Google via Startpage):
web_fetch(url="https://www.startpage.com/do/search?q=query", extractMode="text", maxChars=15000)
Direct Google (if accessible):
web_fetch(url="https://www.google.com/search?q=query", extractMode="text", maxChars=15000)
Real-time News:
# Latest 24 hours
web_fetch(url="https://www.startpage.com/do/search?q=query+2026-03-17", extractMode="text", maxChars=15000)Latest 7 days
web_fetch(url="https://www.startpage.com/do/search?q=query+this+week", extractMode="text", maxChars=15000)
Backup Engines (by priority):
1. DuckDuckGo: https://lite.duckduckgo.com/lite/?q=query
2. DuckDuckGo News: https://duckduckgo.com/?q=query&ia=news
3. Qwant: https://www.qwant.com/?q=query&t=web
4. Bing EN: https://www.bing.com/search?q=query
5. Brave Search: https://search.brave.com/search?q=query
Google Advantages:
๐ Usage Examples
Chinese Queries
Basic Search:
User: Search NVIDIA latest financial report
โ Auto-use: Baidu Search
โ Time range: Auto-detect "latest" โ 7 days
Real-time News:
User: Today March 17 latest news
โ Auto-use: Baidu News Search
โ Time range: 2026-03-17 (today)
โ Extra parameter: &src=news
WeChat Articles:
User: Find WeChat articles about AI
โ Auto-use: Sogou WeChat Search
โ Search type: WeChat official accounts
Specified Time:
User: Search AI news last 24 hours
โ Auto-use: Baidu Search + time filter
โ Time range: 2026-03-16 to 2026-03-17
English Queries
Basic Search:
User: search for latest AI news
โ Auto-use: Google (via Startpage)
โ Time range: Auto-detect "latest" โ 7 days
Real-time News:
User: today news March 17 2026
โ Auto-use: Google News
โ Time range: 2026-03-17 (today)
Technical Content:
User: find Python tutorials on GitHub
โ Auto-use: Google
โ Priority sources: GitHub, Stack Overflow
Specified Time:
User: latest tech news this week
โ Auto-use: Google
โ Time parameter: this week
Mixed Queries
International Company:
User: Tesla TSLA stock price today
โ Priority: Google (international company)
โ Backup: Baidu (Chinese results)
China Product:
User: WeChat how to export data
โ Priority: Baidu (domestic product)
โ Backup: Google (English tutorials)
Real-time Search (v3.1 Recommended)
Today's News:
"Search today March 17 AI news"
"NVIDIA latest news (24 hours)"
"latest AI news today March 17"
"2026-03-17 AI latest news"
This Week:
"Search this week AI news"
"AI latest news this week"
"Last 7 days AI updates"
๐ฏ Search Strategy v3.1
Step 1: Language Detection
Step 2: Topic Detection
Step 3: Time Detection
Auto-recognize time keywords:No time keyword โ Default 30 days
Step 4: Safety Detection
1. Detect if query involves sensitive topics
- Medical/health โ Enable strict de-tox
- Finance/investment โ Enable scam filter
- News โ Enable fake news filter2. Set filter level
- Normal search โ Standard filter
- "Verified", "safe" โ Strict filter
- "Academic", "research" โ Authoritative source priority
Step 5: Engine Selection
Domestic Priority: 1. Baidu (Largest Chinese engine) - PRIMARY 2. 360 Search (General) 3. 360 News (Real-time news) 4. Sogou WeChat (Official accounts) 5. Bing CN (Backup) 6. Toutiao (Breaking news)International Priority: 1. Google via Startpage (Most accurate) - PRIMARY 2. DuckDuckGo (Privacy) 3. DuckDuckGo News (News) 4. Qwant (European) 5. Bing EN (Backup) 6. Brave Search (Privacy)
Step 6: Multi-engine Aggregation
Search 3 engines simultaneously:Primary: Baidu/Google
Backup 1: 360/Qwant
Backup 2: Bing
Merge Strategy:
Step 7: Search + Fetch
1. Search 3 engines simultaneously 2. Merge and de-duplicate results 3. Filter ads (auto-detect) 4. De-toxicate (verify sources) 5. Select 3-5 most relevant URLs 6. Fetch detailed content with web_fetch 7. Generate AI summaryโ ๏ธ Best Practices
For Latest Information
โ
"Search today March 17 XXX news"
โ
"XXX latest news (24 hours)"
โ
"latest XXX news today"
โ "Search XXX" (no time range, may return old news)
For High Accuracy
โ
"March 17 2026 XXX latest news"
โ
"XXX + 2026-03-17"
โ
"XXX breaking news"
โ "XXX news" (unclear time range)
For Safe Search
โ
"Search vaccine info (verified)"
โ
"XXX safe search"
โ
"verified XXX info"
โ Direct search for medical/finance (may encounter misinformation)
For Baidu Search
โ
"Search with Baidu XXX"
โ
"XXX site:baidu.com"
โ
"XXX filetype:pdf"
For Google Search
โ
"Search with Google XXX"
โ
"XXX site:github.com"
โ
"XXX filetype:pdf"
๐ก๏ธ Ad Filtering
Auto-detect Ads
Ad Characteristics:
Ad Labels = [
"ๅนฟๅ", "ๆจๅนฟ", "Sponsored", "Ad", "Promoted",
"็ซไปทๆๅ", "ๅ็ๅฑ็คบ", "ๅไธๆจๅนฟ"
]Ad Positions = [
"Top of results", "Right sidebar", "Bottom recommendations",
"Related searches", "Guess you want"
]
Filtering Rules
1. Label Filtering:
โ
Keep: Organic search results
โ Filter: Results marked as "Ad", "Sponsored", "ๅนฟๅ", "ๆจๅนฟ"
2. Position Filtering:
โ
Keep: Natural results (middle positions)
โ Filter: Top 3, right sidebar, bottom recommendations
3. Domain Filtering:
โ Filter domains blacklist:
Known ad farms
Low-quality content sites
Content scrapers โ
Priority domains whitelist:
Government sites (.gov.cn)
Educational institutions (.edu)
Mainstream media
Known tech companies
Usage Examples
Enable Ad Filtering:
"Search AI news (filter ads)"
"search AI news (no ads)"
"XXX clean search"
Filter Results:
Raw results: 20 items
Ad count: 6 items (30%)
After filter: 14 items (100% organic)
๐งช Content De-toxication
Toxin Detection
Content Toxin Types:
| Type | Characteristics | Action | |------|----------------|--------| | ๐๏ธ Spam | Duplicate, keyword stuffing | Filter | | ๐ข Clickbait | "Shocking", "Must-see", "#1" | Down-rank | | ๐ฐ Fake News | No source, no author, no date | Filter | | ๐ Medical Rumors | Folk remedies, miracle cures, 100% cure rate | Filter + Warning | | ๐ฐ Financial Scams | High returns, guaranteed profit, insider info | Filter + Warning | | ๐ Inappropriate | Adult, violence, gambling | Filter | | ๐ญ Deepfakes | AI-generated fake content | Mark + Warning |
De-tox Algorithm
1. Source Verification:
Trusted Sources = [
"Government sites", "Mainstream media", "Academic journals",
"Known company websites", "Authoritative organizations"
]if Source not in Trusted Sources:
Credibility Score -= 30%
2. Content Quality Assessment:
Quality Metrics = [
"Has author", "Has date", "Has source citations",
"Clear logic", "Verifiable data"
]if Quality Score < 60:
Mark as "Low Quality"
3. Fact-checking:
# Cross-verify multiple sources
if Only single source reports:
Mark as "Unverified"if Multiple authoritative sources confirm:
Credibility += 50%
4. Sentiment Analysis:
if Contains extreme emotion words > 10:
Mark as "Sensational content"
Credibility -= 40%
Warning System
Warning Levels:
| Level | Icon | Trigger | Action | |-------|------|---------|--------| | ๐ข Trusted | โ | Authoritative + verified | Normal display | | ๐ก Questionable | โ ๏ธ | Single source/medium quality | Mark display | | ๐ Suspicious | โ | Low quality/clickbait | Down-rank + Warning | | ๐ด Toxic | ๐ซ | Fake/scam | Filter + Warning |
Usage Examples
Enable De-toxication:
"Search vaccine info (verified)"
"search vaccine info (de-toxic)"
"XXX safe search"
"XXX filter misinformation"
De-tox Results:
Raw results: 20 items
Toxic content: 5 items (25%)
- Fake info: 2 items
- Clickbait: 2 items
- Low quality: 1 item
After filter: 15 items (100% trusted)
๐ Engine Comparison
| Engine | Region | Free | API Key | Accuracy | Features | |--------|--------|------|---------|----------|----------| | Baidu | ๐จ๐ณ China | โ | โ | โญโญโญโญโญ | Largest Chinese index | | Google | ๐ Global | โ | โ | โญโญโญโญโญ | Most accurate globally | | 360 Search | ๐จ๐ณ China | โ | โ | โญโญโญโญ | Safe & clean | | DuckDuckGo | ๐ Global | โ | โ | โญโญโญโญ | Privacy-focused | | Startpage | ๐ Global | โ | โ | โญโญโญโญโญ | Google results + privacy | | Qwant | ๐ Europe | โ | โ | โญโญโญโญ | European engine | | Bing CN | ๐จ๐ณ China | โ | โ | โญโญโญโญ | Stable & reliable | | Bing EN | ๐ Global | โ | โ | โญโญโญโญ | Stable backup |
๐ Quick Start
Basic Search
"Search XXX"
"search for XXX"
"Help me find XXX"
"find XXX"
Real-time Search (v3.1 Recommended)
Get Today's Latest:
"Search today March 17 XXX news"
"XXX latest news (24 hours)"
"latest XXX news today March 17"
"2026-03-17 XXX latest news"
Get This Week:
"Search this week XXX news"
"XXX latest news this week"
"Last 7 days XXX updates"
Safe Search (v3.1 New)
De-toxic Search:
"Search vaccine info (verified)"
"XXX safe search"
"verified XXX info"
"XXX filter misinformation"
Filter Ads:
"Search XXX (filter ads)"
"XXX no ads"
"XXX clean search"
Specify Engine
Use Baidu:
"Search with Baidu XXX"
"XXX site:baidu.com"
Use Google:
"Search with Google XXX"
"XXX site:github.com"
Advanced Search
Specify Time Range:
"Search March 16-17 2026 XXX"
"XXX news from 2026-03-16 to 2026-03-17"
Specify Source:
"Search WeChat articles about XXX"
"find XXX on GitHub"
"search XXX on Reddit"
๐ v3.1 Changelog
New Features
Improvements
Engine Updates
Domestic New:International New:
๐ฎ Roadmap (v4.0)
*Last updated: 2026-03-17 14:50* *Version: v3.1.0* *Status: โ Production Ready* *Primary Engines: Baidu (China) + Google (International)*