šŸŽ Get the FREE AI Skills Starter Guide ā€” Subscribe ā†’
BytesAgainBytesAgain
BytesAgain ā€ŗ Skills ā€ŗ Web Crawl
šŸ¦€ ClawHub

Web Crawl

by @nowhitestar

Advanced web crawling and content extraction tool with multiple extraction modes

Versionv1.0.0
Downloads567
#writing#legal#gaming
TERMINAL
clawhub install web-crawl

šŸ“– About This Skill

name: web-crawl version: "1.0.0" description: Advanced web crawling and content extraction tool with multiple extraction modes activation: keywords: ["crawl", "ęŠ“å–", "ęå–ē½‘锵", "ē ”ē©¶", "ę·±åŗ¦ē ”ē©¶", "research", "analyze website"] tags: ["web", "research", "crawling"]

Web Crawl Skill

Advanced web content extraction with multiple modes and intelligent content detection.

When to Use

Use this skill when:

  • User asks to "ē ”ē©¶" / "ę·±åŗ¦ē ”ē©¶" a topic
  • User wants to "ęŠ“å–" / "ęå–" content from websites
  • Need to analyze multiple web pages systematically
  • Current web_fetch output is insufficient

    • Extraction Modes

    | Mode | Use Case | |------|----------| | text | Clean plain text | | markdown | Formatted Markdown (recommended) | | links | Extract all links | | structured | JSON metadata + content | | full | Markdown + links combined |

    Tools Available

  • web_crawl - Extract content from a single URL
  • parallel_crawl - Extract from multiple URLs in parallel
  • research_topic - Multi-step research with search + crawl

    • Example Usage

    User: "ē ”ē©¶äø€äø‹ OpenManus-Max 锹ē›®"
ā†’ Use research_topic tool with query="OpenManus-Max GitHub features"

    āš” When to Use

    TriggerAction
    - User asks to "ē ”ē©¶" / "ę·±åŗ¦ē ”ē©¶" a topic
    - User wants to "ęŠ“å–" / "ęå–" content from websites
    - Need to analyze multiple web pages systematically
    - Current `web_fetch` output is insufficient