Why use Firecrawl instead of standard WebSearch?

Firecrawl provides superior accuracy, handles JavaScript rendering, bypasses bot detection, and returns markdown optimized specifically for LLM context windows.

Where are the scraped results stored?

By default, the skill creates a .firecrawl/ directory in your project to store JSON or Markdown files, preventing your terminal context from being flooded.

How do I authenticate Firecrawl?

Use the 'firecrawl login --browser' command to quickly authenticate via your web browser and start using your API credits immediately.

Can Firecrawl scrape multiple pages at once?

Yes, it supports parallel execution using xargs or background tasks to maximize efficiency within your API concurrency limits.

Does Firecrawl handle sites with lots of ads and navigation?

Yes, the --only-main-content flag automatically filters out non-essential elements like headers, footers, and advertisements to provide clean text.

Firecrawl Web Search & Scraping

Name: Firecrawl Web Search & Scraping
Author: lev-os

bylev-os

0•

Web Scraping & Data Collection

Automates high-performance web searching, scraping, and site mapping with LLM-optimized markdown output.

Firecrawl is a specialized tool for Claude Code that replaces standard web browsing utilities with a more robust, developer-focused interface. It excels at extracting clean, structured markdown from complex websites, handling JavaScript-heavy pages, and generating site maps to discover all available URLs. By automating authentication and parallelizing requests, it enables deep research, competitor analysis, and documentation harvesting directly within the terminal, ensuring the context window is populated only with the most relevant, high-quality data.

Key Features

01High-performance parallel scraping with built-in concurrency management

020 GitHub stars

03JavaScript rendering and automated block-bypassing for complex sites

04LLM-optimized markdown extraction that removes noise like navbars and ads

05Full site mapping to discover and list all URLs on a domain

06Advanced web, news, and image search with customizable filters

Use Cases

01Conducting automated competitor research and market analysis with structured data

02Building local knowledge bases by crawling and saving entire sites to markdown files

03Extracting clean documentation from library websites for RAG or coding assistance

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add lev-os/agents search-firecrawl

For use in Claude.ai and ChatGPT