How does this skill differ from standard web fetching tools?

This skill specifically focuses on converting messy HTML into clean Markdown, removing noise like ads and footers to make the content more readable for AI models.

Does it support sites that require JavaScript?

This version primarily fetches static content. Websites that rely heavily on client-side JavaScript rendering may not display full content.

How do I handle request timeouts on slow websites?

You can use the --timeout option to increase the waiting period, ensuring that slower pages have enough time to respond before the skill errors out.

Can I scrape multiple URLs simultaneously?

Yes, the skill supports parallel execution using background processes in the terminal, allowing you to fetch content from several sources at once.

Markdown Web Scraper

Name: Markdown Web Scraper
Author: zephyrwang6

byzephyrwang6

•

ウェブスクレイピングとデータ収集

Extracts web page content and converts it into clean, readable Markdown for seamless AI analysis and data collection.

The Web Scraper skill empowers Claude to interact with the live web by fetching HTML content and transforming it into structured Markdown format. By stripping away intrusive elements like advertisements, footers, and navigation menus, it provides a high-signal text output that is optimized for Claude's reasoning capabilities. This tool is particularly useful for reading online documentation, summarizing articles, or retrieving information from URLs when standard built-in fetch tools encounter network restrictions or formatting issues.

主な機能

01Configurable request timeouts and output length limits

0237 GitHub stars

03Parallel fetching support for processing multiple URLs

04Boilerplate removal for cleaner content extraction

05High-fidelity HTML to Markdown conversion

06Raw HTML output mode for structural debugging

ユースケース

01Providing Claude with fresh documentation context from a library's website

02Bypassing standard web fetch limitations during terminal-based AI workflows

03Automating the extraction of blog post content for summarization

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add zephyrwang6/myskill web-scraper

For use in Claude.ai and ChatGPT

Download Skill