Automated summary
A tool to scrape Snowflake documentation pages into Markdown files with caching and configurable crawling depth.
Strengths
- Simple setup with automatic dependency installation
- SQLite cache reduces repeated requests and speeds up updates
- Flexible configuration for base path and spider depth
- Structured Markdown output with frontmatter metadata
Limitations
- Only works on docs.snowflake.com
- May download a large number of pages if depth is set high
- Cache expiration is fixed at 7 days with no customization option
When you need local copies of Snowflake documentation sections for offline reference or LLM context.
For scraping other websites or for real-time updates.
Security analysis
SafeThe skill is a documentation scraper that accesses a trusted domain (docs.snowflake.com) and writes to a local directory. It does not execute downloaded content, expose secrets, or perform destructive actions. The first-time setup uses a Python script that installs a tool via standard package managers, which is a common pattern and not inherently risky.
No concerns found
How this analysis is madeExamples
Scrape the Snowflake documentation migration guide with default settings and save it to ./migration-docsUse doc-scraper to scrape the Snowflake SQL reference section at /en/sql-reference/ with spider depth 2, output to ./sql-docsRun a dry run of doc-scraper for the base path /en/sql-reference/ to see which URLs will be scraped without writing files.name: doc-scraper description: Generic web scraper for extracting and organizing Snowflake documentation with intelligent caching and configurable spider depth. Scrapes any section of docs.snowflake.com controlled by --base-path.
Snowflake Documentation Scraper
Scrapes docs.snowflake.com sections to Markdown with SQLite caching (7-day expiration).
Usage
First time setup (auto-installs uv and doc-scraper):
python3 .claude/skills/doc-scraper/scripts/doc_scraper.py
Subsequent runs:
doc-scraper --output-dir=./snowflake-docs
doc-scraper --output-dir=./snowflake-docs --base-path="/en/sql-reference/"
doc-scraper --output-dir=./snowflake-docs --spider-depth=2
Command Options
| Option | Default | Description |
| ---------------- | ----------------- | ------------------------------------- |
| --output-dir | Required | Output directory for scraped docs |
| --base-path | /en/migrations/ | URL section to scrape |
| --spider-depth | 1 | Link depth: 0=seeds, 1=+links, 2=+2nd |
| --limit | None | Cap URLs (for testing) |
| --dry-run | - | Preview without writing |
Output
output-dir/
├── SKILL.md # Auto-generated index
├── scraper_config.yaml # Editable config (auto-created)
├── .cache/ # SQLite cache (auto-managed)
└── en/migrations/*.md # Scraped pages with frontmatter
Configuration
Auto-created at {output-dir}/scraper_config.yaml:
rate_limiting:
max_concurrent_threads: 4
spider:
max_pages: 1000
allowed_paths: ["/en/"]
scraped_pages:
expiration_days: 7
Troubleshooting
| Issue | Solution |
| ---------------- | ------------------------------------- |
| Too many pages | Lower --spider-depth or edit config |
| Missing pages | Increase --spider-depth |
| Cache corruption | Delete {output-dir}/.cache/ (rare) |
From the file to a first result
The download contains exactly the content displayed on this page. This copy may differ from the latest version in the source repository.
View the source and supporting filesThis download contains SKILL.md only. Any scripts, references, templates and dependencies are not included. Get the required files from the source, preserving their directory structure, before continuing.
1. Download the file
Download SKILL.mdFrom the root of a test project, save the file as .skill-downloads/snowflake-documentation-scraper-mm5t89d1/SKILL.md, or use the command below. This folder is for inspecting the skill before installation.
Command for macOS/Linux or WSL: requires a POSIX shell and curl. On Windows without WSL, use the download button and create the folder manually.
mkdir -p '.skill-downloads/snowflake-documentation-scraper-mm5t89d1' && curl --fail --show-error --location 'https://skills-guides.com/api/skills/snowflake-documentation-scraper-mm5t89d1/download' --output '.skill-downloads/snowflake-documentation-scraper-mm5t89d1/SKILL.md.part' && mv '.skill-downloads/snowflake-documentation-scraper-mm5t89d1/SKILL.md.part' '.skill-downloads/snowflake-documentation-scraper-mm5t89d1/SKILL.md'2. Check prerequisites
Read SKILL.md before using it. If it references scripts or external services, inspect them and prepare the required access in your test environment.
No recognized prerequisites section in this file. This does not mean it is self-contained: libraries, tools and access requirements may be mentioned elsewhere in the content or source repository.
The platforms on this page are catalog indications. The paths below follow tool documentation; they do not prove this skill has been run in those tools. No minimum tool version is confirmed for this listing.
3. Load the skill
After inspection, copy the complete folder into your project using one of the commands below, then open a new tool session. The command stops if a folder with the same name already exists: compare the files before replacing it.
Claude Code
test -f '.skill-downloads/snowflake-documentation-scraper-mm5t89d1/SKILL.md' && test -s '.skill-downloads/snowflake-documentation-scraper-mm5t89d1/SKILL.md' && mkdir -p '.claude/skills' && test ! -e '.claude/skills/doc-scraper' && cp -R '.skill-downloads/snowflake-documentation-scraper-mm5t89d1' '.claude/skills/doc-scraper'OpenSkills
OpenSkills must already be installed. The local install/read procedure is checked with OpenSkills 1.5.0, which requires Node.js ≥ 20.6.0. Catalog slugs are not resolved automatically.
Official OpenSkills installationopenskills install './.skill-downloads/snowflake-documentation-scraper-mm5t89d1'openskills read 'snowflake-documentation-scraper-mm5t89d1'Reading should display the installed file content and its base directory. It does not run the skill or install its dependencies.
For an agent that reads AGENTS.md, then sync the index. This command changes AGENTS.md: review the diff before using it.
openskills syncManual method or another tool: attach SKILL.md to a conversation, or open it in an agent that can read files. Include any required supporting resources. No universal folder is recognized by every tool.
4. Try a first task
Use a short, synthetic input: an API endpoint, a small document or an interface brief. In a new conversation, attach the file or give the agent its path, then adapt this request:
Read .skill-downloads/snowflake-documentation-scraper-mm5t89d1/SKILL.md and apply its instructions to this example: [describe a test input]. Identify any missing files, dependencies or access. Produce the result requested by the skill without inventing data or running unreviewed scripts.Expected result: output matching the skill instructions, or a precise list of missing prerequisites. A read confirmation alone does not validate a first use. If an external resource is unavailable, that path remains untested.
Supabase Docs Authoring
Documentation
Write, edit, and review Supabase documentation content including guides, tutorials, reference docs, and partials. Follow style guides and MDX/TOML validation rules.
Create Architecture Decision Record
Documentation
Create a new Architecture Decision Record with sequential numbering, register it in the AgentDB graph, and link related ADRs.
Plan update with deep research
Documentation
Updates a plan document by launching parallel subagents to analyze a topic across all compiler passes, then consolidates findings into the plan doc.