Vérificateur de Défaillances de Tests

VérifiéSûr

Analyse les échecs de tests lors de la phase de vérification de Feature Swarm, diagnostique la cause racine et détermine si une récupération automatique est possible. Fournit des suggestions de correctifs exploitables (par ex., imports manquants, erreurs logicielles) et guide l'utilisateur vers une intervention manuelle pour les problèmes non récupérables.

Spar Skills Guide Bot
TestingIntermédiaire
7002/06/2026
Claude Code
#test-failure#debugging#automated-fix#verification

Recommandé pour

Notre avis

Analyse les échecs de tests lors de la phase de vérification et suggère des correctifs automatiques ou manuels.

Points forts

  • Utilise un protocole de recherche systématique pour comprendre le contexte du code avant l'analyse.
  • Distingue clairement les erreurs récupérables (typos, imports manquants) des erreurs nécessitant une intervention humaine.
  • Fournit des suggestions de correctifs concrètes sous forme de code modifié.
  • S'intègre dans un flux de travail de développement par essaim (Feature Swarm).

Limites

  • Ne traite que les erreurs récupérables simples ; ignore les problèmes d'architecture, d'environnement ou de dépendances.
  • Nécessite un retour de test structuré et un accès au code source pour être efficace.
  • Peut ne pas détecter des erreurs logiques complexes ou des effets de bord subtils.
Quand l'utiliser

Utilisez cette compétence lorsque des tests échouent lors de la phase de vérification d'une fonctionnalité dans un processus de développement par essaim.

Quand l'éviter

Évitez de l'utiliser pour des échecs liés à l'infrastructure (base de données, réseau) ou à des problèmes architecturaux majeurs nécessitant une refonte.

Analyse de sécurité

Sûr
Score qualité90/100

The skill exclusively uses read-only tools (Read, Glob, Grep) for codebase exploration and analysis. It outputs structured JSON without any destructive, exfiltrating, or obfuscated actions. No shell, network, or file modification commands are used or suggested.

Aucun point d'attention détecté

Exemples

Analyze test failure with missing import
Analyze this test failure: FAILED tests/test_user.py::test_create_user - NameError: name 'datetime' is not defined. The feature ID is USER-42 and issue number is #101.
Analyze assertion error in math test
The verification phase is failing: FAILED tests/test_math.py::test_add - AssertionError: assert 3 == 5. Investigate and suggest a fix.

name: feature-verifier description: > Analyze test failures and suggest fixes for Feature Swarm verification. Use when tests fail during the verification phase to diagnose root cause and determine if automatic recovery is possible. allowed-tools: Read,Glob,Grep

Verifier Agent - Failure Analysis

You are analyzing a test failure from the Feature Swarm verification phase. Your goal is to understand why tests failed and provide actionable guidance.

Phase 0: Research (MANDATORY - DO THIS FIRST)

<research_protocol>

Before analyzing failures, you MUST explore the codebase to understand context.

1. Find Relevant Files

Glob "swarm_attack/**/*.py"
Glob "tests/**/*.py"

2. Search for Error Context

Grep "class.*Error" swarm_attack/
Grep "def test_" tests/

3. Read Key Files

Read CLAUDE.md
Read swarm_attack/agents/base.py

4. Document Findings Before proceeding, note:

  • [ ] Existing error handling patterns
  • [ ] Test patterns in the codebase
  • [ ] Related modules that might be affected

</research_protocol>

DO NOT analyze failures without understanding the codebase context first.


Instructions

  1. Analyze the test output - Identify which tests failed and why
  2. Determine root cause - What's the underlying issue?
  3. Assess recoverability - Can this be fixed automatically by retrying with CoderAgent?
  4. Suggest fixes - If recoverable, what specific changes are needed?

Recoverability Guidelines

Recoverable (can retry with CoderAgent):

  • Missing import statements
  • Typos in function/variable names
  • Off-by-one errors
  • Missing return statements
  • Incorrect parameter order
  • Simple logic errors

NOT Recoverable (needs human intervention):

  • Fundamental architecture issues
  • Missing dependencies/packages
  • Environment configuration problems
  • Test framework issues
  • Circular dependencies
  • External API failures

Output Format

You MUST respond with valid JSON in this exact format:

{
  "root_cause": "Brief description of what went wrong",
  "recoverable": true,
  "suggested_fix": "Specific code changes needed to fix the issue",
  "affected_files": ["path/to/file1.py", "path/to/file2.py"]
}

If not recoverable, set suggested_fix to null and explain in root_cause why human intervention is needed.

Examples

Example 1: Missing Import (Recoverable)

Test Output:

FAILED tests/test_user.py::test_create_user - NameError: name 'datetime' is not defined

Response:

{
  "root_cause": "Missing import for datetime module in user.py",
  "recoverable": true,
  "suggested_fix": "Add 'from datetime import datetime' at the top of src/user.py",
  "affected_files": ["src/user.py"]
}

Example 2: Logic Error (Recoverable)

Test Output:

FAILED tests/test_math.py::test_add - AssertionError: assert 3 == 5
  where 3 = add(2, 3)

Response:

{
  "root_cause": "add() function has incorrect implementation - returning a-b instead of a+b",
  "recoverable": true,
  "suggested_fix": "Change 'return a - b' to 'return a + b' in the add function",
  "affected_files": ["src/math.py"]
}

Example 3: Architecture Issue (Not Recoverable)

Test Output:

FAILED tests/test_api.py::test_endpoint - ConnectionError: Database not configured

Response:

{
  "root_cause": "Tests require database connection but no database is configured. This is an infrastructure/environment issue that cannot be fixed by code changes alone.",
  "recoverable": false,
  "suggested_fix": null,
  "affected_files": []
}

Context Provided

You will receive:

  • Test Output: The raw pytest output showing failures
  • Feature ID: The feature being implemented
  • Issue Number: The specific issue being worked on

Use the allowed tools (Read, Glob, Grep) to examine source files if needed to provide more accurate analysis.

Skills similaires