Skills Guide

Firecrawl - Web Scraping and URL Discovery

VerifiedSafe

Web scraping and URL discovery using Firecrawl API. Use it to convert web pages to Markdown or map out a site's structure. Ideal for extracting structured data from targeted websites.

Sby Skills Guide Bot
DevelopmentIntermediate
1006/2/2026
Claude Code
#web-scraping#url-discovery#firecrawl#markdown

Recommended for

Backend developerClaude CodeCode reviewFrontend developerFullstack developerRefactoring

Our review

Scrapes web pages and discovers URLs using the Firecrawl API, converting content to Markdown.

Strengths

  • Fast extraction of web content into clean Markdown
  • Structured URL discovery via the map command
  • Integration with Task agents to avoid context overload

Limitations

  • Requires a valid Firecrawl API key
  • Not a replacement for a search engine – limited to targeted pages
  • The quality of Markdown depends on the source page structure
When to use it

To fetch the textual content of a web page or explore the sitemap of a specific site.

When not to use it

For general web searches – prefer a search engine like Perplexity.

Security analysis

Safe
Quality score85/100

The skill instructs using the Firecrawl CLI for web scraping, a legitimate tool. No destructive commands, exfiltration, or obfuscation. It recommends using a Task agent to avoid context overload, indicating safe usage patterns. No security risks detected in the instruction file.

No concerns found

Examples

Scrape a page to Markdown
Scrape https://example.com/article to Markdown and summarize the key points.
Discover URLs on a site
Use Firecrawl to discover all pages under https://docs.example.com and list their URLs.

name: Firecrawl description: Web scraping and URL discovery using Firecrawl. Use for scraping web pages to markdown and discovering URLs on websites. Keywords: scrape, crawl, firecrawl, web, markdown, url discovery, sitemap.

Firecrawl

Web scraping and URL discovery powered by Firecrawl API.

Variables

  • FIRECRAWL_CLI_PATH: .claude/skills/firecrawl/firecrawl_cli/

Instructions

Run from FIRECRAWL_CLI_PATH:

cd .claude/skills/firecrawl/firecrawl_cli/
uv run fc --help                   # Discover all commands
uv run fc <command> --help         # Detailed usage

Rules:

  • ALWAYS use Task agent for scrapes - pages are large and will overload context
  • Use map to explore - when you need to find where content lives on a site
  • Use Perplexity for search - this skill is for targeted scraping, not search

Troubleshooting

  • "FIRECRAWL_API_KEY not found": Run /prime to validate environment
Related skills

Next.js App Router Expert

Development

A skill that turns Claude into a Next.js App Router expert.

Claude CodeCursoradvanced
890
234
2,846
Admin

README Generator

Development

Creates professional and comprehensive README.md files for your projects.

claudeCursorWindsurfbeginner
259
72
821
Admin

API Documentation Writer

Development

Generates comprehensive API documentation in OpenAPI/Swagger format.

claudeCursorWindsurfintermediate
156
44
682
Admin