KernelWiki

VerifiedSafe

Knowledge base for optimizing Blackwell and Hopper GPU kernels.

Sby Skills Guide Bot
Data & AIAdvanced
7/28/2026
Claude CodeCursorCodex
#cuda#gpu-kernels#blackwell#hopper#knowledge-base

Recommended for

Automated summary

Queries a structured, cross-referenced knowledge base about optimizing NVIDIA Blackwell (SM100) and Hopper (SM90) GPU kernels.

Strengths

  • Several complementary query paths: natural-language search, page retrieval by id or path, regex grep over page bodies, and pre-built cross-reference indices.
  • Rich filters (type, tag, repo, language, architecture, symptom, confidence) with alias handling, e.g. UMMA→tcgen05 or B200→sm100.
  • Surfaces concrete PR references from CUTLASS, vLLM, SGLang, FlashInfer and PyTorch so answers point at real implementations.
  • Scripts auto-resolve the wiki root, so no environment variable has to be set up.

Limitations

  • Scope is deliberately narrow to Blackwell/Hopper: generic CUDA, host-side framework integration and distributed topics (DeepEP, EPLB, DualPipe) are excluded.
  • Requires a local clone of the repository and Python 3; corpus freshness depends on how often the repo is updated.
  • It is a documentation retrieval tool: it does not compile, run or validate the code it cites.
When to use it

Use it whenever a question involves tcgen05/TMEM/NVFP4, FlashAttention-4, DeepGEMM, FlashMLA, MoE, or Hopper→Blackwell migration, especially when concrete PR references are wanted.

When not to use it

Avoid it for generic CUDA questions unrelated to Blackwell/Hopper tensor cores, or for framework integration, request scheduling and distributed systems topics.

Security analysis

Safe
Quality score90/100

The skill only runs local Python scripts for querying, fetching pages, grepping, and status reporting within its own repository. No destructive commands, network exfiltration, or obfuscated payloads are present. The declared tools (Bash, Read, Grep, Glob) are used for legitimate local knowledge-base access.

No concerns found

How this analysis is made

Examples

TMEM accumulator migration
I'm moving my SM100 GEMM from wgmma register accumulators to tcgen05 TMEM accumulators. Query the wiki for the migration pattern and list the CUTLASS PRs that show it.
FlashAttention-4 PR references
Which vLLM, SGLang and FlashInfer PRs implement FlashAttention-4 for Blackwell, and what do they say about 2-SM cooperative MMA and CLC?
Tail effect on Hopper GEMM
My H100 GEMM kernel has poor SM utilization on the final wave — search the wiki for tail-effect symptoms and the candidate techniques with their confidence levels.

name: KernelWiki description: Use when the user asks about optimizing NVIDIA Blackwell (SM100, B200) or Hopper (SM90, H100) GPU kernels — tcgen05/TMEM/CLC/NVFP4/2-SM cooperative, warp specialization, FlashAttention-4, DeepGEMM, FlashMLA, MoE, grouped GEMM, CuTe-DSL/PTX/Triton on Blackwell, or wants concrete PR references from CUTLASS/SGLang/vLLM/FlashInfer/PyTorch. Do NOT use for generic CUDA Q&A that is not Blackwell/Hopper-specific, host-side framework integration, or distributed systems (DeepEP/EPLB/DualPipe). argument-hint: "[natural-language-question] | [--tag foo --type kernel] | [page-id]" allowed-tools: "Bash Read Grep Glob"

KernelWiki — Blackwell & Hopper Kernel Optimization Wiki

Query a structured, cross-referenced knowledge base of GPU kernel optimization for NVIDIA Blackwell (SM100) and Hopper (SM90). The repository update date is recorded in README.md; run python3 scripts/repo_status.py for current corpus counts.

When To Use This Skill

Trigger this skill when the user asks about:

  • Blackwell/SM100 kernel programming — tcgen05.mma, TMEM, CLC, 2-SM cooperative, NVFP4, FP8/FP4 block scaling, PDL/GDC
  • Kernel implementations — FlashAttention-4, DeepGEMM, FlashMLA, NSA, GatedDeltaNet, NVFP4 GEMM/GEMV, fused MoE, gated dual GEMM
  • Performance patterns — low SM utilization, memory-bound, register pressure, compute-bound, tail effects, pipeline stalls
  • DSLs for Blackwell — CuTe DSL, CUDA C++ with PTX inline, Triton on Blackwell
  • Hopper → Blackwell migration — wgmma → tcgen05, register → TMEM accumulators
  • PR references — "how did vLLM/SGLang/FlashInfer/CUTLASS/PyTorch implement X for SM100?"
  • Competition solutions — GPU Mode NVFP4 hackathon, FlashInfer MLSys 2026 submissions

Do NOT use this skill for:

  • Generic CUDA questions unrelated to Blackwell/Hopper tensor cores
  • Host-side framework integration (model loading, request routing, scheduling policy)
  • Distributed systems topics — DeepEP, EPLB, DualPipe are out of scope

How To Query

All commands below run from the skill directory (the clone root — the directory this SKILL.md lives in). The scripts auto-resolve the wiki root; no environment variable required.

Path 1: Unified search (preferred for natural language)

python3 scripts/query.py "how to fuse gate-up dual GEMM on Blackwell"
python3 scripts/query.py --tag nvfp4 --type kernel
python3 scripts/query.py --repo cutlass --limit 20
python3 scripts/query.py --symptom tail-effect --compact

Filters: --type, --tag, --repo, --language, --architecture, --symptom, --confidence, --limit, --compact, --paths-only. --tag and --architecture accept aliases — --tag UMMA matches tcgen05, --architecture B200 matches sm100, etc.

Path 2: Fetch a specific page by id or path

python3 scripts/get_page.py kernel-flash-attention-4
python3 scripts/get_page.py pr-cutlass-2472
python3 scripts/get_page.py kernel-flash-attention-4 --follow-sources
python3 scripts/get_page.py kernel-flash-attention-4 --body-only

Path 3: Regex text search across wiki bodies and PR pages

python3 scripts/grep_wiki.py "tcgen05\\.fence"
python3 scripts/grep_wiki.py "2-CTA backward" --only wiki
python3 scripts/grep_wiki.py "nvfp4" "block_scale" --any

Path 4: Pre-built cross-reference indices

Auto-generated under queries/:

  • queries/by-problem.md — symptom → pattern page → candidate techniques
  • queries/by-technique.md — 15 techniques with architectures, confidence, reproducibility, source count
  • queries/by-hardware-feature.md — tcgen05/tmem/clc/tma/nvfp4/etc. → related wiki + PR pages
  • queries/by-kernel-type.md — gemm/attention/moe/mla/gated-delta-net → pages
  • queries/by-language.md — cute-dsl/cuda-cpp/ptx/triton → guide page + related kernels/sources
  • queries/by-repo.md — PR pages grouped by source repository

Path 5: Primer, schema, examples

Companion docs under references/:

  • references/primer.md — topic map: hardware features, techniques, symptoms, canonical page IDs. Read this first when the question is broad.
  • references/schema.md — condensed frontmatter schema, confidence rules, reproducibility ladder, controlled vocabulary, canonical aliases.
  • references/examples.md — 10 worked query patterns mapping user questions → command sequences → synthesis.

Output Pattern

When answering from this KB:

  1. Cite specific pages with paths (e.g., wiki/kernels/flash-attention-4.md) and IDs (kernel-flash-attention-4).
  2. Follow sources: fields to trace claims back to PRs/blogs/docs.
  3. Respect confidence levels — verified > source-reported > inferred > experimental. Call out when a claim is experimental or inferred.
  4. Include code snippets from wiki pages when they exist — technique/kernel/language pages are guaranteed snippet-reproducibility (validator-enforced).
  5. Report performance claims with all six fields — gpu, dtype, shape, metric, value, source_id.

Knowledge Base Contents

  • Source PR pages, synthesized wiki pages, blog/doc/contest summaries, candidate ledgers, query indices, and artifact bundles.
  • Verbatim/extracted/derived asset bundles in artifacts/ (PR diffs, kernel files, blog code) — pinned to upstream SHAs via PROVENANCE.yaml
  • Auto-generated query indices in queries/
  • Controlled vocabulary (80+ tags) in data/tags.yaml, alias map in data/aliases.yaml
  • Hybrid version-claim registry — per-page version_sensitive: <id> pointers + data/version-claims.yaml central registry, validated for bidirectional consistency
  • Status script scripts/repo_status.py — current corpus counts
  • Validator scripts/validate.py — schema, link, artifact, and ledger checks
  • Blackwell-first — SM90 pages only appear when they carry explicit blackwell_relevance

To refresh the corpus: run scripts/refresh_candidate_ledger.py, regenerate PR pages and query indices, then validate.

Quality Guarantees

  • Every verified page has official-doc + upstream-code evidence
  • Every technique/kernel/language page has a compilable snippet
  • Every PR page has inclusion_reason and status: merged
  • All Hopper-inclusive pages have explicit blackwell_relevance

From the file to a first result

The download contains exactly the content displayed on this page. This copy may differ from the latest version in the source repository.

View the source and supporting files

This download contains SKILL.md only. Any scripts, references, templates and dependencies are not included. Get the required files from the source, preserving their directory structure, before continuing.

1. Download the file

Download SKILL.md

From the root of a test project, save the file as .skill-downloads/kernelwiki-ms47vofn/SKILL.md, or use the command below. This folder is for inspecting the skill before installation.

Command for macOS/Linux or WSL: requires a POSIX shell and curl. On Windows without WSL, use the download button and create the folder manually.

mkdir -p '.skill-downloads/kernelwiki-ms47vofn' && curl --fail --show-error --location 'https://skills-guides.com/api/skills/kernelwiki-ms47vofn/download' --output '.skill-downloads/kernelwiki-ms47vofn/SKILL.md.part' && mv '.skill-downloads/kernelwiki-ms47vofn/SKILL.md.part' '.skill-downloads/kernelwiki-ms47vofn/SKILL.md'

2. Check prerequisites

Read SKILL.md before using it. If it references scripts or external services, inspect them and prepare the required access in your test environment.

Tools declared by the author (check availability in your agent): Bash Read Grep Glob

No recognized prerequisites section in this file. This does not mean it is self-contained: libraries, tools and access requirements may be mentioned elsewhere in the content or source repository.

The platforms on this page are catalog indications. The paths below follow tool documentation; they do not prove this skill has been run in those tools. No minimum tool version is confirmed for this listing.

3. Load the skill

This file does not provide a usable name/description header for this native procedure. It remains available to download and inspect; use the manual method below.

Manual method or another tool: attach SKILL.md to a conversation, or open it in an agent that can read files. Include any required supporting resources. No universal folder is recognized by every tool.

4. Try a first task

Use a short, synthetic input: an API endpoint, a small document or an interface brief. In a new conversation, attach the file or give the agent its path, then adapt this request:

Read .skill-downloads/kernelwiki-ms47vofn/SKILL.md and apply its instructions to this example: [describe a test input]. Identify any missing files, dependencies or access. Produce the result requested by the skill without inventing data or running unreviewed scripts.

Expected result: output matching the skill instructions, or a precise list of missing prerequisites. A read confirmation alone does not validate a first use. If an external resource is unavailable, that path remains untested.

Related skills