How does the Website Content Extractor work?

It executes a Ruby script that fetches a URL and utilizes content-cleaning logic to strip away non-essential elements like ads, returning only the primary article text.

Does it work on websites with paywalls?

No, this skill is designed for publicly accessible URLs such as blog posts, news articles, and technical documentation.

Which script does this skill use?

This skill utilizes the jina.rb script located within the dotfiles repository to perform the extraction.

What is the benefit over standard web browsing?

It provides Claude with a 'text-only' version of the page, which saves token space and prevents the AI from being distracted by irrelevant sidebar text or navigation links.

Can I use this for scraping entire websites?

It is optimized for single-page extraction (articles/posts) rather than bulk crawling or complex data scraping of entire domains.

Website Content Extractor

Name: Website Content Extractor
Author: mgomes

bymgomes

•

网络抓取与数据收集

Extracts clean, clutter-free article and blog content from URLs by stripping away ads, navigation, and unnecessary UI elements.

关于

The Website Content Extractor skill provides a streamlined way for Claude to ingest web content without the noise of modern web design. By utilizing a specialized script, it targets the core readable content of blog posts, tutorials, and articles, removing sidebars, advertisements, and navigation menus. This is particularly useful for developers and researchers who need to provide Claude with clean context from documentation or technical guides for analysis, transformation, or summarization tasks.

主要功能

Automated article extraction from any public URL
Seamless integration with Claude Code for rapid knowledge ingestion
Optimized for blog posts, tutorials, and documentation
1 GitHub stars
Strips navigation menus and sidebars for clean text
Removal of intrusive advertisements and pop-ups

使用场景

Archiving clean versions of blog posts for local reference
Summarizing long-form industry articles without manual copy-pasting
Feeding technical documentation into Claude for code analysis

关于

主要功能

Automated article extraction from any public URL
Seamless integration with Claude Code for rapid knowledge ingestion
Optimized for blog posts, tutorials, and documentation
1 GitHub stars
Strips navigation menus and sidebars for clean text
Removal of intrusive advertisements and pop-ups

使用场景

Archiving clean versions of blog posts for local reference
Summarizing long-form industry articles without manual copy-pasting
Feeding technical documentation into Claude for code analysis