All Skills — writing
39 skills in "writing" matching "Scraper"
🌐 Allcodingdevopsapidatabasesecuritydataresearchwritingimage-genvideoaudiotranslationseosocial-mediaemail-marketingadvertisingfinancecrypto-defiecommercelegalhrreal-estatehealtheducationcookingtravelgamingautomationcommunicationproductivityclawhubbytesagainlobehubdifymcpskillssh
🦀 ClawHub11.4k dl
Deep Scraper
Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output.
🦀 ClawHub3.5k dl
Python Script Generator
生成专业的 Python 脚本和应用模板,支持 CLI 工具、Flask API、FastAPI、Django Command、Scraper 等,一键生成完整项目代码。
🦀 ClawHub2.1k dl
Apify Ultimate Scraper
Universal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, Google Maps, Google Search, Google Trends, Booking.com, and TripAdvisor. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research, content analytics, audience analysis, or any data extraction task.
🦀 ClawHub1.1k dl
Zoomin Docs Portal Scraper Tool
Scrape documentation content from Zoomin Software portals using Playwright browser automation to handle dynamic content loading. Use when standard web fetchi...
🦀 ClawHub827 dl
Content Scraper — AI Trend Monitor
Monitors configured social channels daily to identify trending topics, viral content, and new content ideas within your niche, delivering structured reports.
🦀 ClawHub657 dl
tiktok-scraper
Access live TikTok data via the CreatorCrawl API. Look up creator profiles, search videos, pull comments and transcripts, track trending hashtags, discover p...
🦀 ClawHub468 dl
Apify Substack Scraper
Scrape Substack newsletters and articles. Use when user asks to search Substack, find newsletter posts, extract Substack content, or monitor Substack publica...
🦀 ClawHub402 dl
Agentify
Analyze, rewrite, and generate design specs to make web pages and websites more easily usable by AI agents, web scrapers, and automation tools. Use when (1)...
🦀 ClawHub360 dl
Web Scraper - Firecrawl
Web scraping and content extraction using Firecrawl API. Use when users need to crawl websites, extract structured data, convert web pages to markdown, scrap...
🦀 ClawHub340 dl
Sitemap Content Scraper
Discover website sitemaps from robots.txt and common sitemap locations, choose the right sitemap or content family such as docs, blog, help center, academy,...
🦀 ClawHub284 dl
Apify Google News Scraper
This skill should be used when the user asks to "scrape Google News", "get news articles", "search for news", "extract news data", "monitor news topics", "ge...
🦀 ClawHub267 dl
Web Scraper
Python web scraping toolkit for data extraction, pagination handling, anti-blocking techniques, Selenium for JavaScript-heavy sites, and structured output (J...
🦀 ClawHub239 dl
Novel Scraper SPA
支持 JavaScript 加载的小说抓取工具,使用 Playwright 渲染 SPA 网站。自动检测网站类型,静态网站使用 curl,SPA 网站使用浏览器渲染。
🦀 ClawHub6.0k dl
Reddit Scraper
Read and search Reddit posts via web scraping of old.reddit.com. Use when Clawdbot needs to browse Reddit content - read posts from subreddits, search for topics, monitor specific communities. Read-only access with no posting or comments.
🦀 ClawHub5.3k dl
Playwright Scraper
Scrapes websites using Playwright with stealth mode to bypass bot detection, supporting dynamic JS content and customizable viewport and User-Agent.
🦀 ClawHub3.3k dl
Crawl4AI Web Scraper
Full web page scraping with JavaScript rendering via local Crawl4AI instance, delivering clean markdown or detailed JSON including links and media.
🦀 ClawHub2.9k dl
Ecommerce Scraper
爬取动态电商网站数据。使用Playwright处理JavaScript渲染的页面,支持Cloudflare反爬、隐躲API发现、分页抓取。适用于: (1) 爬取京东/淘宝/拼多多等中国电商, (2) 爬取Amazon/eBay等国际电商, (3) 价格监控和竞品分析, (4) 批量商品数据采集。
🦀 ClawHub1.5k dl
Scraper
Structured extraction and cleanup for public, user-authorized web pages. Use when the user wants to collect, clean, summarize, or transform content from acce...
🦀 ClawHub1.4k dl
PulpMiner Web Scraper - Convert Any Webpage to Realtime JSON API
Convert any webpage into structured JSON data using AI. Scrape websites, extract data into custom JSON schemas, and call saved APIs programmatically. Useful for web scraping, data extraction, content monitoring, lead generation, price tracking, and building data pipelines.
🦀 ClawHub962 dl
Traktor Web Scraper
Extract all assets and content from websites including images, SVGs, fonts, videos, and page structure. Parallel agents with thorough scraping coverage. Trig...
🦀 ClawHub905 dl
Novel Scraper
智能小说抓取工具,支持自动翻页、分页补全、章节号自动解析。 使用 curl+BeautifulSoup 抓取笔趣阁等小说网站,输出格式化 TXT 文件。 默认每 10 章合并为一个文档,避免文件零散分布。 自动检测分页并补全,智能跳过非小说内容(作者感言、抽奖预告等)。 Use when: 抓取网络小说章节、批量...
🦀 ClawHub699 dl
Oxylabs AI Studio — Web Scraper, Crawler & Browser Agent
Web scraping, crawling, searching, and browser automation using Oxylabs AI Studio. Use this skill when the user asks to scrape a website, extract content fro...
🦀 ClawHub660 dl
Agent Launchpad
Generate complete, deployable AI agent skill packages from natural language descriptions. Includes 6 templates (monitor, scraper, analyst, trader, assistant,...
🦀 ClawHub597 dl
Huo15 Js Scraper
JavaScript渲染网站抓取工具。当需要抓取JS渲染的页面(如企微文档、Vue/React SPA)、企查查企业数据获取)、绕过反爬、或者普通curl/wget/web_fetch无法获取内容的网站时使用此技能。支持Playwright和scrapling双引擎自动切换。
🦀 ClawHub568 dl
Skylv Web Scraper
Extract and parse web page content including text, links, and images using CSS selectors and regex for flexible data scraping.
🦀 ClawHub442 dl
Js Render Scraper
爬取需要 JavaScript 渲染的动态网页内容。当用户要求抓取 SPA、React/Vue 应用、无限滚动页面、需要登录的页面或任何依赖 JS 动态加载内容的网站时使用。支持使用 Playwright 进行浏览器自动化抓取。
🦀 ClawHub418 dl
Apify Scraper
Scrape content from sites that block bots — Twitter/X threads, Reddit, LinkedIn, YouTube comments, Google SERP, and more. Use when standard web_fetch is bloc...
🦀 ClawHub387 dl
Web Scraper Trae
Opens browser and scrapes webpage content using Playwright. Invoke when user wants to crawl/scrape a webpage, extract data from a website, or get content fro...
🦀 ClawHub374 dl
Smart Scraper
AI-powered web scraper with intelligent structure recognition. Extracts lists, articles, and tables from any website with automatic type detection.
🦀 ClawHub354 dl
Lightpanda Scraper
Fast headless browser web scraping using Lightpanda (0.5s page loads, 90x faster than Chromium). Perfect for OSINT recon, link extraction, and content scrapi...
🦀 ClawHub350 dl
Crawl4ai Docker Skill
Dockerized web crawling and scraping service with REST API. Docker化网页爬虫服务 | Web crawler, web scraper, REST API service. Intelligent content extraction with L...
🦀 ClawHub312 dl
Novel Scraper Pro
智能小说抓取工具 V6,支持自动翻页、分页补全、章节号自动解析、内存监控、中断续抓。 使用 curl+BeautifulSoup 抓取笔趣阁等小说网站,输出格式化 TXT 文件。 默认每 10 章合并为一个文档,避免文件零散分布。 自动检测分页并补全,智能跳过非小说内容(作者感言、抽奖预告等)。 内存监控和中断续...
🦀 ClawHub285 dl
Apify Threads Scraper
This skill should be used when the user asks to "scrape Threads posts", "get Threads data", "extract Threads content", "search Threads", "monitor Threads has...
🦀 ClawHub276 dl
xiaofei自用-WeChat Article Scraper
微信公众号文章抓取工具。从 mp.weixin.qq.com 抓取公开文章(文字+图片+视频),解析内容块顺序,下载图片,按原顺序写入飞书知识库。
🦀 ClawHub274 dl
Forge — Python Developer
Python development agent — automation scripts, API wrappers, CLI tools, data pipelines, web scrapers. Tested code with error handling and docs. Use when you...
🦀 ClawHub256 dl
Data Scraper
Extract data from websites and APIs for analysis. Use when user needs to collect product prices from e-commerce sites, gather news articles, extract structur...
🦀 ClawHub244 dl
deep-scraper
A Docker-based tool using Crawlee and Playwright to deeply scrape complex sites like YouTube, extracting verified raw transcripts or descriptions with ads re...
🦀 ClawHub137 dl
Social Media Content Scraper Pro
Social Media Content Bulk Scraper, extract articles/posts from WeChat, Instagram, TikTok, YouTube, export to Markdown/HTML with full metadata. $0.005 USDT pe...
🦀 ClawHub
web-search-scraper-api-skill
This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API. The Agent should proactive...