Automated summary
This skill runs and analyzes Newman (Postman CLI) tests for API validation.
Strengths
- Automates Postman collection execution via command line.
- Provides detailed result analysis scripts (JSON, JUnit).
- Integrates smoothly into CI/CD pipelines.
- Includes collection structure validation.
Limitations
- Requires Newman and Python to be installed beforehand.
- Scripts are specific to this skill and may need customization.
- Does not handle advanced Postman environment or variable management.
Use this skill when you need to run API tests from an existing Postman collection, either locally or in a CI pipeline.
Avoid this skill if you do not have a ready Postman collection or if your API tests require complex interactions not supported by Newman.
Security analysis
SafeThe skill executes npm install and runs test scripts, but does so in a controlled manner for legitimate API testing purposes. There is no exfiltration, obfuscation, or destructive behavior. It uses Bash, Read, Write tools which are standard for such tasks.
No concerns found
How this analysis is madeExamples
Run the Newman tests from my Postman collection file and analyze the results.Validate my Postman collection structure to ensure it's correct before running tests.Execute the API tests optimized for CI with JUnit output and collect the results.name: newman-runner description: Run and analyze Newman (Postman CLI) tests. Use when running API tests, validating Postman collections, testing HTTP endpoints, or when user mentions Newman, Postman tests, API validation. allowed-tools: Bash, Read, Write
Newman Runner
This skill provides tools to run Newman (Postman CLI) tests and analyze the results for API testing and validation.
Instructions
Running Newman Tests
-
Verify Newman Installation
- Check if Newman is installed:
which newman - If not installed, install with:
npm install -g newman
- Check if Newman is installed:
-
Run Collection
- Use script:
scripts/run-newman.sh <collection.json> - Or manually:
newman run collection.json --reporters cli,json --reporter-json-export output.json
- Use script:
-
Analyze Results
- Parse JSON output with:
scripts/analyze-newman-results.py output.json - Extract: Pass/fail status, response times, error messages, assertions
- Parse JSON output with:
-
Run in CI/CD
- Use
scripts/run-newman-ci.sh <collection.json>for CI-optimized execution - Produces JUnit XML for CI reporting + JSON for analysis
- Uses GitHub Actions annotation format for inline error reporting
- Use
Available Scripts
scripts/run-newman.sh- Run Newman with standard optionsscripts/run-newman-ci.sh- CI-optimized runner with JUnit outputscripts/analyze-newman-results.py- Parse Newman JSON outputscripts/validate-collection.sh- Validate Postman collection structure
Advanced Patterns
For OpenAPI-to-Newman pipeline, auth injection, and collection management, see the api-contract-testing skill which builds on this runner.
Examples
Example 1: Run API Tests
# Run Newman tests on Postman collection
./scripts/run-newman.sh my-api-tests.json
# Analyze results
./scripts/analyze-newman-results.py newman-results.json
Example 2: Validate Collection
# Check collection is valid before running
./scripts/validate-collection.sh my-collection.json
Example 3: Run in CI
# CI-optimized run with JUnit output
./scripts/run-newman-ci.sh my-api-tests.json
# Results in:
# test-results/api-contract/newman-results.json (JSON)
# test-results/api-contract/newman-junit.xml (JUnit XML)
Requirements
- Newman installed globally:
npm install -g newman - Valid Postman collection JSON file
- Python 3.7+ for analysis scripts
Success Criteria
- Newman tests run successfully
- Results parsed and analyzed
- Pass/fail status clearly reported
- Error details extracted for failures
From the file to a first result
The download contains exactly the content displayed on this page. This copy may differ from the latest version in the source repository.
View the source and supporting filesThis download contains SKILL.md only. Any scripts, references, templates and dependencies are not included. Get the required files from the source, preserving their directory structure, before continuing.
1. Download the file
Download SKILL.mdFrom the root of a test project, save the file as .skill-downloads/newman-test-runner-mm78noha/SKILL.md, or use the command below. This folder is for inspecting the skill before installation.
Command for macOS/Linux or WSL: requires a POSIX shell and curl. On Windows without WSL, use the download button and create the folder manually.
mkdir -p '.skill-downloads/newman-test-runner-mm78noha' && curl --fail --show-error --location 'https://skills-guides.com/api/skills/newman-test-runner-mm78noha/download' --output '.skill-downloads/newman-test-runner-mm78noha/SKILL.md.part' && mv '.skill-downloads/newman-test-runner-mm78noha/SKILL.md.part' '.skill-downloads/newman-test-runner-mm78noha/SKILL.md'2. Check prerequisites
Read SKILL.md before using it. If it references scripts or external services, inspect them and prepare the required access in your test environment.
Tools declared by the author (check availability in your agent): Bash, Read, Write
Original excerpt: Requirements
- Newman installed globally:
npm install -g newman - Valid Postman collection JSON file
- Python 3.7+ for analysis scripts
The platforms on this page are catalog indications. The paths below follow tool documentation; they do not prove this skill has been run in those tools. No minimum tool version is confirmed for this listing.
3. Load the skill
After inspection, copy the complete folder into your project using one of the commands below, then open a new tool session. The command stops if a folder with the same name already exists: compare the files before replacing it.
Claude Code
test -f '.skill-downloads/newman-test-runner-mm78noha/SKILL.md' && test -s '.skill-downloads/newman-test-runner-mm78noha/SKILL.md' && mkdir -p '.claude/skills' && test ! -e '.claude/skills/newman-runner' && cp -R '.skill-downloads/newman-test-runner-mm78noha' '.claude/skills/newman-runner'OpenSkills
OpenSkills must already be installed. The local install/read procedure is checked with OpenSkills 1.5.0, which requires Node.js ≥ 20.6.0. Catalog slugs are not resolved automatically.
Official OpenSkills installationopenskills install './.skill-downloads/newman-test-runner-mm78noha'openskills read 'newman-test-runner-mm78noha'Reading should display the installed file content and its base directory. It does not run the skill or install its dependencies.
For an agent that reads AGENTS.md, then sync the index. This command changes AGENTS.md: review the diff before using it.
openskills syncManual method or another tool: attach SKILL.md to a conversation, or open it in an agent that can read files. Include any required supporting resources. No universal folder is recognized by every tool.
4. Try a first task
Use a short, synthetic input: an API endpoint, a small document or an interface brief. In a new conversation, attach the file or give the agent its path, then adapt this request:
Read .skill-downloads/newman-test-runner-mm78noha/SKILL.md and apply its instructions to this example: [describe a test input]. Identify any missing files, dependencies or access. Produce the result requested by the skill without inventing data or running unreviewed scripts.Expected result: output matching the skill instructions, or a precise list of missing prerequisites. A read confirmation alone does not validate a first use. If an external resource is unavailable, that path remains untested.
ClickHouse Performance Comparison
Testing
Evaluate ClickHouse performance test results, check PR performance changes, compare with history, and assess whether a result is actionable.
Analyze CI Performance Reports
Testing
Analyze CI performance comparison reports for a ClickHouse PR. Cross-references master history to distinguish real regressions from flaky tests.
Santa Method
Testing
Multi-agent adversarial verification with two independent reviewers. Output is checked twice and iteratively fixed until both pass before shipping.