Skills Guide

Web Scraping with Firecrawl

VerifiedCaution

Scrape web pages and extract structured content via Firecrawl API. Supports multiple output formats (markdown, HTML, text).

Download and use
Sby Skills Guide Bot
Data & AIBeginner
3/8/2026
Claude Code
#web-scraping#firecrawl#content-extraction#mcp#web-search

Recommended for

Claude CodeData scientistData & analysis

Automated summary

This skill fetches the content of a web page or runs a web search through the Firecrawl MCP server, returning the result as markdown, HTML, or plain text.

Strengths

  • Simple command-line interface with just two main parameters (--url or --search)
  • Selectable output format (markdown, html, text) that suits downstream processing
  • Combines web search and content extraction in a single command

Limitations

  • Requires a configured Firecrawl MCP server and a valid FIRECRAWL_API_KEY
  • Relies on an internal script (scripts/mcp/firecrawl_scrape.py) specific to this environment
  • No described handling of complex JavaScript rendering, pagination, or authenticated pages
When to use it

Use it when you need to quickly pull the textual content of a URL or run a web search whose results you want to read.

When not to use it

Avoid it when no Firecrawl server or API key is available, or when you must scrape login-protected or heavily dynamic sites.

Security analysis

Caution
Quality score82/100

The skill invokes a local script through Bash and uses network access for web scraping. This is a legitimate use of powerful tools, but because the executed script is not shown and arbitrary URLs can be fetched, it warrants caution rather than a fully safe rating.

Findings
  • •Uses Bash to execute a local Python script whose implementation is not included in SKILL.md, so actual behavior depends on that script.
  • •Requires FIRECRAWL_API_KEY; API key handling is not described, so users should ensure it is not exposed or logged.
  • •Fetches arbitrary user-provided URLs via Firecrawl, which is legitimate but can reach internal/sensitive endpoints if run in an unrestricted environment.
How this analysis is made

Examples

Scrape documentation page
Scrape https://docs.python.org/3/library/asyncio.html and give me the markdown content.
Search the web
Search the web for 'Python asyncio best practices 2024' with Firecrawl and summarize the top results.
Extract page as plain text
Use the firecrawl-scrape skill to fetch https://example.com as plain text.

name: firecrawl-scrape description: Scrape web pages and extract content via Firecrawl MCP allowed-tools: [Bash, Read]

Firecrawl Scrape Skill

When to Use

  • Scrape content from any URL
  • Extract structured data from web pages
  • Search the web and get content

Instructions

uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --url "https://example.com" \
    --format "markdown"

Parameters

  • --url: URL to scrape
  • --format: Output format - markdown, html, text (default: markdown)
  • --search: (alternative) Search query instead of direct URL

Examples

# Scrape a page
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --url "https://docs.python.org/3/library/asyncio.html"

# Search and scrape
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --search "Python asyncio best practices 2024"

MCP Server Required

Requires firecrawl server in mcp_config.json with FIRECRAWL_API_KEY.

From the file to a first result

The download contains exactly the content displayed on this page. This copy may differ from the latest version in the source repository.

View the source and supporting files

This download contains SKILL.md only. Any scripts, references, templates and dependencies are not included. Get the required files from the source, preserving their directory structure, before continuing.

1. Download the file

Download SKILL.md

From the root of a test project, save the file as .skill-downloads/web-scraping-with-firecrawl-mmh8qqii/SKILL.md, or use the command below. This folder is for inspecting the skill before installation.

Command for macOS/Linux or WSL: requires a POSIX shell and curl. On Windows without WSL, use the download button and create the folder manually.

mkdir -p '.skill-downloads/web-scraping-with-firecrawl-mmh8qqii' && curl --fail --show-error --location 'https://skills-guides.com/api/skills/web-scraping-with-firecrawl-mmh8qqii/download' --output '.skill-downloads/web-scraping-with-firecrawl-mmh8qqii/SKILL.md.part' && mv '.skill-downloads/web-scraping-with-firecrawl-mmh8qqii/SKILL.md.part' '.skill-downloads/web-scraping-with-firecrawl-mmh8qqii/SKILL.md'

2. Check prerequisites

Read SKILL.md before using it. If it references scripts or external services, inspect them and prepare the required access in your test environment.

No recognized prerequisites section in this file. This does not mean it is self-contained: libraries, tools and access requirements may be mentioned elsewhere in the content or source repository.

The platforms on this page are catalog indications. The paths below follow tool documentation; they do not prove this skill has been run in those tools. No minimum tool version is confirmed for this listing.

3. Load the skill

After inspection, copy the complete folder into your project using one of the commands below, then open a new tool session. The command stops if a folder with the same name already exists: compare the files before replacing it.

Claude Code
test -f '.skill-downloads/web-scraping-with-firecrawl-mmh8qqii/SKILL.md' && test -s '.skill-downloads/web-scraping-with-firecrawl-mmh8qqii/SKILL.md' && mkdir -p '.claude/skills' && test ! -e '.claude/skills/firecrawl-scrape' && cp -R '.skill-downloads/web-scraping-with-firecrawl-mmh8qqii' '.claude/skills/firecrawl-scrape'

OpenSkills

OpenSkills must already be installed. The local install/read procedure is checked with OpenSkills 1.5.0, which requires Node.js ≥ 20.6.0. Catalog slugs are not resolved automatically.

Official OpenSkills installation
openskills install './.skill-downloads/web-scraping-with-firecrawl-mmh8qqii'

openskills read 'web-scraping-with-firecrawl-mmh8qqii'

Reading should display the installed file content and its base directory. It does not run the skill or install its dependencies.

For an agent that reads AGENTS.md, then sync the index. This command changes AGENTS.md: review the diff before using it.

openskills sync

Manual method or another tool: attach SKILL.md to a conversation, or open it in an agent that can read files. Include any required supporting resources. No universal folder is recognized by every tool.

4. Try a first task

Use a short, synthetic input: an API endpoint, a small document or an interface brief. In a new conversation, attach the file or give the agent its path, then adapt this request:

Read .skill-downloads/web-scraping-with-firecrawl-mmh8qqii/SKILL.md and apply its instructions to this example: [describe a test input]. Identify any missing files, dependencies or access. Produce the result requested by the skill without inventing data or running unreviewed scripts.

Expected result: output matching the skill instructions, or a precise list of missing prerequisites. A read confirmation alone does not validate a first use. If an external resource is unavailable, that path remains untested.

Related skills

Create Interactive Maps with kepler.gl

Data & AI

Create interactive map visualizations and export standalone HTML using the keplergl Python package. Use to plot geospatial data from DataFrames, GeoJSON, or CSV.

Claude CodeCursorCodexintermediateSafe 11,995
Skills Guide Bot

Agent-Driven Parameter Optimization

Data & AI

Guide for optimizing configurable systems with a measurable objective, using bounded trials and evidence-based recommendations.

Claude CodeCursorCodexintermediateSafe 45,609
Skills Guide Bot

ICP Visitor Outreach

Data & AI

Identify signed-up users matching the ideal customer profile but stalled, and draft personalized outreach to re-engage them.

Claude CodeintermediateSafe 6,843
Skills Guide Bot