CI Failure Triage

VerifiedSafe

Classifies a CI failure (logs + commit + repo state) as flake, infra, real-break, or dep and emits a typed runx.ci.triage.v1 routing packet. Read-only: opens no item, reruns nothing, pages no one.

Sby Skills Guide Bot
DevOpsIntermediate
7/26/2026
Claude Code
#ci-triage#failure-classification#log-analysis#incident-response#read-only

Recommended for

Automated summary

Classifies a CI failure (logs, commit, repo state) as flake, infra, real-break, or dep and emits a typed runx.ci.triage.v1 routing packet, read-only.

Strengths

  • Every verdict cites the exact log lines (log:L<n>) it is based on.
  • Explicitly refuses to decide (needs_agent) on empty or truncated logs, absent decisive signal, or confidence below min_confidence.
  • Opens no tracking item, reruns no CI, and pages no one: classification stays separate from governed action.
  • Emits a single schema-typed packet (runx.ci.triage.v1) that downstream issue-intake or issue-to-pr runs can consume directly.

Limitations

  • Reasoning is confined to the supplied logs: no investigation beyond the input and no rerun to confirm a flake.
  • Only four verdict categories, with no detailed root-cause diagnosis.
  • Requires a local node executable (run.mjs) run inside a read-only sandbox.
When to use it

Use it when a CI run fails and you need a fast call between a real bug, a dependency failure, infra trouble, or a flake before opening an issue.

When not to use it

Do not use it to fix the defect, rerun CI, or manage the incident: the skill only classifies and routes.

Security analysis

Safe
Quality score85/100

The instruction file is purely a classifier: it takes logs/commit/repo_state, computes a typed verdict, and explicitly commits to opening no items, rerunning nothing, and paging no one. There are no destructive commands, no curl|sh, no secret handling, no base64 payloads, and the sandbox is declared readonly with cwd constrained to the skill directory. The only residual risk is that the actual logic lives in an unshown run.mjs, but nothing in the description suggests network egress or writes, so the listing itself is low-risk.

Findings
  • •The behavior of run.mjs cannot be inspected from SKILL.md; trust rests entirely on the declared `readonly` sandbox with cwd pinned to the skill directory.
  • •No allowed-tools are declared even though a node CLI is invoked — the capability envelope is implicit in the sandbox profile rather than explicit.
  • •It ingests raw CI logs (potentially large / containing sensitive content), though the stated contract is a pure classification with no exfiltration or side effects.
How this analysis is made

Examples

Triage a failing build job
Voici les logs bruts d'un job CI en échec, le SHA testé et l'état du dépôt. Classe l'échec en flake / infra / real-break / dep et renvoie le paquet runx.ci.triage.v1 avec les références log:L<n> qui justifient le verdict.

logs:
<coller les logs>
commit: <sha>
repo_state: clean
Refuse on ambiguous logs
Classifie ces logs tronqués avec min_confidence à 0.8. Si le signal n'est pas décisif, refuse avec needs_agent au lieu de deviner une cause racine.

logs:
<logs tronqués>
Suspected flake
Ces logs montrent un test qui n'échoue que sur un seul runner et passe ailleurs ; détermine s'il s'agit d'un flake, émets le rerun_verdict et cite les lignes de log utilisées.

logs:
<coller les logs>

name: ci-failure-triage description: Classify a CI failure (logs + commit + repo state) as flake, infra, real-break, or dep and emit a typed runx.ci.triage.v1 routing packet for a downstream issue-intake run. Read-only: opens no item, reruns nothing, pages no one. source: type: cli-tool command: node args: - run.mjs timeout_seconds: 30 sandbox: profile: readonly cwd_policy: skill-directory inputs: logs: type: string required: true description: Raw CI failure output (build/test logs) to classify. commit: type: string required: false description: Commit SHA under test, for provenance in the packet. repo_state: type: string required: false description: Short repo state hint (clean/dirty/unknown). min_confidence: type: string required: false description: escalation_policy.min_confidence; below this the run refuses (needs_agent). runx: category: ops input_resolution: required: - logs

ci-failure-triage

CI failure triage is the first decision in incident response: a fast wrong call creates noise, and a slow right call burns the production window. This skill reads a CI failure and makes exactly one call, with cited evidence, so the next governed step starts from a typed decision instead of a raw log dump.

What it does

Given the failure logs (plus optional commit and repo_state) and a min_confidence threshold, it classifies the failure as one of:

| verdict | meaning | consequence emitted | | --- | --- | --- | | real-break | a code defect visible in the logs | routing decision -> issue-to-pr | | dep | a dependency / resolution failure | routing decision -> issue-to-pr | | infra | runner / network / disk / daemon failure | read-only operator page note | | flake | known-flaky / intermittent, dominant signal | read-only rerun verdict |

The output is a typed runx.ci.triage.v1 packet:

{
  "schema": "runx.ci.triage.v1",
  "classification": { "verdict": "real-break", "confidence": 0.9, "evidence_refs": ["log:L2", "log:L3"] },
  "routing_decision": { "recommended_lane": "issue-to-pr", "rationale": "..." },
  "handoff": { "seam": "dispatch-by-naming", "downstream": ["issue-intake", "issue-to-pr", "pr-review-note"] }
}

Boundaries (why an operator can trust it)

  • Read-only. It opens no tracking item, reruns no CI, and pages no operator. It produces a classification and a routing decision; a separate issue-intake / issue-to-pr / pr-review-note run is the governed commencement gate.
  • Evidence-bound. Every verdict cites the exact log lines (log:L<n>) it is based on. It refuses to assert a root cause that is not visible in the supplied logs.
  • It refuses when it should. Empty logs, truncated logs, no decisive signal, or a computed confidence below min_confidence all block the run for a human lane (needs_agent) and emit no routing.

Inputs

  • logs (required): the raw build/test output of the failed CI run.
  • commit (optional): commit SHA under test, recorded for provenance.
  • repo_state (optional): short hint such as clean, dirty, unknown.
  • min_confidence (optional, default 0.6): refuse below this confidence.

Output

A single runx.ci.triage.v1 packet on stdout with classification and exactly one of routing_decision, rerun_verdict, or page_note.

Harness

Two locked cases (runx harness .):

  • real_break_clear_logs -> sealed, verdict: real-break, lane issue-to-pr.
  • ambiguous_truncated_logs -> refused (needs_agent), no routing.

From the file to a first result

The download contains exactly the content displayed on this page. This copy may differ from the latest version in the source repository.

View the source and supporting files

This download contains SKILL.md only. Any scripts, references, templates and dependencies are not included. Get the required files from the source, preserving their directory structure, before continuing.

1. Download the file

Download SKILL.md

From the root of a test project, save the file as .skill-downloads/ci-failure-triage-ms1aw6ad/SKILL.md, or use the command below. This folder is for inspecting the skill before installation.

Command for macOS/Linux or WSL: requires a POSIX shell and curl. On Windows without WSL, use the download button and create the folder manually.

mkdir -p '.skill-downloads/ci-failure-triage-ms1aw6ad' && curl --fail --show-error --location 'https://skills-guides.com/api/skills/ci-failure-triage-ms1aw6ad/download' --output '.skill-downloads/ci-failure-triage-ms1aw6ad/SKILL.md.part' && mv '.skill-downloads/ci-failure-triage-ms1aw6ad/SKILL.md.part' '.skill-downloads/ci-failure-triage-ms1aw6ad/SKILL.md'

2. Check prerequisites

Read SKILL.md before using it. If it references scripts or external services, inspect them and prepare the required access in your test environment.

No recognized prerequisites section in this file. This does not mean it is self-contained: libraries, tools and access requirements may be mentioned elsewhere in the content or source repository.

The platforms on this page are catalog indications. The paths below follow tool documentation; they do not prove this skill has been run in those tools. No minimum tool version is confirmed for this listing.

3. Load the skill

This file does not provide a usable name/description header for this native procedure. It remains available to download and inspect; use the manual method below.

Manual method or another tool: attach SKILL.md to a conversation, or open it in an agent that can read files. Include any required supporting resources. No universal folder is recognized by every tool.

4. Try a first task

Use a short, synthetic input: an API endpoint, a small document or an interface brief. In a new conversation, attach the file or give the agent its path, then adapt this request:

Read .skill-downloads/ci-failure-triage-ms1aw6ad/SKILL.md and apply its instructions to this example: [describe a test input]. Identify any missing files, dependencies or access. Produce the result requested by the skill without inventing data or running unreviewed scripts.

Expected result: output matching the skill instructions, or a precise list of missing prerequisites. A read confirmation alone does not validate a first use. If an external resource is unavailable, that path remains untested.

Related skills