Newman Test Runner

VerifiedSafe

Runs and analyzes Newman (Postman CLI) tests for API validation. Helps when executing Postman collections, testing HTTP endpoints, or integrating API tests into CI/CD pipelines with pass/fail reporting and error extraction.

Sby Skills Guide Bot
TestingIntermediate
6/2/2026
Claude Code
#newman#postman#api-testing#ci-integration

Recommended for

Automated summary

This skill runs and analyzes Newman (Postman CLI) tests for API validation.

Strengths

  • Automates Postman collection execution via command line.
  • Provides detailed result analysis scripts (JSON, JUnit).
  • Integrates smoothly into CI/CD pipelines.
  • Includes collection structure validation.

Limitations

  • Requires Newman and Python to be installed beforehand.
  • Scripts are specific to this skill and may need customization.
  • Does not handle advanced Postman environment or variable management.
When to use it

Use this skill when you need to run API tests from an existing Postman collection, either locally or in a CI pipeline.

When not to use it

Avoid this skill if you do not have a ready Postman collection or if your API tests require complex interactions not supported by Newman.

Security analysis

Safe
Quality score85/100

The skill executes npm install and runs test scripts, but does so in a controlled manner for legitimate API testing purposes. There is no exfiltration, obfuscation, or destructive behavior. It uses Bash, Read, Write tools which are standard for such tasks.

No concerns found

How this analysis is made

Examples

Run API Tests
Run the Newman tests from my Postman collection file and analyze the results.
Validate Postman Collection
Validate my Postman collection structure to ensure it's correct before running tests.
Run Tests in CI
Execute the API tests optimized for CI with JUnit output and collect the results.

name: newman-runner description: Run and analyze Newman (Postman CLI) tests. Use when running API tests, validating Postman collections, testing HTTP endpoints, or when user mentions Newman, Postman tests, API validation. allowed-tools: Bash, Read, Write

Newman Runner

This skill provides tools to run Newman (Postman CLI) tests and analyze the results for API testing and validation.

Instructions

Running Newman Tests

  1. Verify Newman Installation

    • Check if Newman is installed: which newman
    • If not installed, install with: npm install -g newman
  2. Run Collection

    • Use script: scripts/run-newman.sh <collection.json>
    • Or manually: newman run collection.json --reporters cli,json --reporter-json-export output.json
  3. Analyze Results

    • Parse JSON output with: scripts/analyze-newman-results.py output.json
    • Extract: Pass/fail status, response times, error messages, assertions
  4. Run in CI/CD

    • Use scripts/run-newman-ci.sh <collection.json> for CI-optimized execution
    • Produces JUnit XML for CI reporting + JSON for analysis
    • Uses GitHub Actions annotation format for inline error reporting

Available Scripts

  • scripts/run-newman.sh - Run Newman with standard options
  • scripts/run-newman-ci.sh - CI-optimized runner with JUnit output
  • scripts/analyze-newman-results.py - Parse Newman JSON output
  • scripts/validate-collection.sh - Validate Postman collection structure

Advanced Patterns

For OpenAPI-to-Newman pipeline, auth injection, and collection management, see the api-contract-testing skill which builds on this runner.

Examples

Example 1: Run API Tests

# Run Newman tests on Postman collection
./scripts/run-newman.sh my-api-tests.json

# Analyze results
./scripts/analyze-newman-results.py newman-results.json

Example 2: Validate Collection

# Check collection is valid before running
./scripts/validate-collection.sh my-collection.json

Example 3: Run in CI

# CI-optimized run with JUnit output
./scripts/run-newman-ci.sh my-api-tests.json

# Results in:
# test-results/api-contract/newman-results.json  (JSON)
# test-results/api-contract/newman-junit.xml     (JUnit XML)

Requirements

  • Newman installed globally: npm install -g newman
  • Valid Postman collection JSON file
  • Python 3.7+ for analysis scripts

Success Criteria

  • Newman tests run successfully
  • Results parsed and analyzed
  • Pass/fail status clearly reported
  • Error details extracted for failures

From the file to a first result

The download contains exactly the content displayed on this page. This copy may differ from the latest version in the source repository.

View the source and supporting files

This download contains SKILL.md only. Any scripts, references, templates and dependencies are not included. Get the required files from the source, preserving their directory structure, before continuing.

1. Download the file

Download SKILL.md

From the root of a test project, save the file as .skill-downloads/newman-test-runner-mm78noha/SKILL.md, or use the command below. This folder is for inspecting the skill before installation.

Command for macOS/Linux or WSL: requires a POSIX shell and curl. On Windows without WSL, use the download button and create the folder manually.

mkdir -p '.skill-downloads/newman-test-runner-mm78noha' && curl --fail --show-error --location 'https://skills-guides.com/api/skills/newman-test-runner-mm78noha/download' --output '.skill-downloads/newman-test-runner-mm78noha/SKILL.md.part' && mv '.skill-downloads/newman-test-runner-mm78noha/SKILL.md.part' '.skill-downloads/newman-test-runner-mm78noha/SKILL.md'

2. Check prerequisites

Read SKILL.md before using it. If it references scripts or external services, inspect them and prepare the required access in your test environment.

Tools declared by the author (check availability in your agent): Bash, Read, Write

Original excerpt: Requirements
  • Newman installed globally: npm install -g newman
  • Valid Postman collection JSON file
  • Python 3.7+ for analysis scripts

The platforms on this page are catalog indications. The paths below follow tool documentation; they do not prove this skill has been run in those tools. No minimum tool version is confirmed for this listing.

3. Load the skill

After inspection, copy the complete folder into your project using one of the commands below, then open a new tool session. The command stops if a folder with the same name already exists: compare the files before replacing it.

Claude Code
test -f '.skill-downloads/newman-test-runner-mm78noha/SKILL.md' && test -s '.skill-downloads/newman-test-runner-mm78noha/SKILL.md' && mkdir -p '.claude/skills' && test ! -e '.claude/skills/newman-runner' && cp -R '.skill-downloads/newman-test-runner-mm78noha' '.claude/skills/newman-runner'

OpenSkills

OpenSkills must already be installed. The local install/read procedure is checked with OpenSkills 1.5.0, which requires Node.js ≥ 20.6.0. Catalog slugs are not resolved automatically.

Official OpenSkills installation
openskills install './.skill-downloads/newman-test-runner-mm78noha'

openskills read 'newman-test-runner-mm78noha'

Reading should display the installed file content and its base directory. It does not run the skill or install its dependencies.

For an agent that reads AGENTS.md, then sync the index. This command changes AGENTS.md: review the diff before using it.

openskills sync

Manual method or another tool: attach SKILL.md to a conversation, or open it in an agent that can read files. Include any required supporting resources. No universal folder is recognized by every tool.

4. Try a first task

Use a short, synthetic input: an API endpoint, a small document or an interface brief. In a new conversation, attach the file or give the agent its path, then adapt this request:

Read .skill-downloads/newman-test-runner-mm78noha/SKILL.md and apply its instructions to this example: [describe a test input]. Identify any missing files, dependencies or access. Produce the result requested by the skill without inventing data or running unreviewed scripts.

Expected result: output matching the skill instructions, or a precise list of missing prerequisites. A read confirmation alone does not validate a first use. If an external resource is unavailable, that path remains untested.

Related skills