Automated summary
This skill guides users through optimizing vector index parameters (e.g., HNSW, quantization) to balance latency, recall, and memory usage in production.
Strengths
- Provides concrete benchmarking and validation steps
- Covers parameter sweeping for HNSW and quantization techniques
- Includes safety and rollback guidance for production changes
Limitations
- Assumes basic familiarity with vector search concepts
- Does not cover end-to-end retrieval system design beyond index tuning
- Requires access to workload metrics and ground truth data for validation
Use when you need to tune HNSW parameters, implement quantization, or scale vector search to billions of vectors with strict latency/recall goals.
Do not use if you only need exact search on small datasets (use a flat index) or if you lack workload metrics to validate recall.
Security analysis
SafeThe skill is a knowledge resource on tuning vector indexes, containing no executable instructions or dangerous operations. It advises caution but does not perform any actions.
No concerns found
How this analysis is madeExamples
I need to tune HNSW parameters (efConstruction, M, efSearch) for a 10M vector dataset with 768-dimensional embeddings. Target: 95% recall at <50ms latency and 10GB memory budget. Help me run a parameter sweep and interpret results.My vector index uses 1M 512-dimensional float vectors but memory is too high. Which quantization method (e.g., PQ, SQ, binary) should I choose to reduce memory by 4x while keeping recall above 90%? Provide a benchmarking plan.We're scaling our vector search to 1B vectors with HNSW. How should I shard the index across multiple nodes and tune efConstruction/efSearch to maintain sub-100ms latency? Include memory estimates and cost considerations.name: vector-index-tuning description: "Optimize vector index performance for latency, recall, and memory. Use when tuning HNSW parameters, selecting quantization strategies, or scaling vector search infrastructure." metadata: author: ncdevshiv version: "1.0" category: other updated: 2026-02-25 risk: unknown source: community
Vector Index Tuning
Guide to optimizing vector indexes for production performance.
Use this skill when
- Tuning HNSW parameters
- Implementing quantization
- Optimizing memory usage
- Reducing search latency
- Balancing recall vs speed
- Scaling to billions of vectors
Do not use this skill when
- You only need exact search on small datasets (use a flat index)
- You lack workload metrics or ground truth to validate recall
- You need end-to-end retrieval system design beyond index tuning
Instructions
- Gather workload targets (latency, recall, QPS), data size, and memory budget.
- Choose an index type and establish a baseline with default parameters.
- Benchmark parameter sweeps using real queries and track recall, latency, and memory.
- Validate changes on a staging dataset before rolling out to production.
Refer to resources/implementation-playbook.md for detailed patterns, checklists, and templates.
Safety
- Avoid reindexing in production without a rollback plan.
- Validate changes under realistic load before applying globally.
- Track recall regressions and revert if quality drops.
Resources
resources/implementation-playbook.mdfor detailed patterns, checklists, and templates.
From the file to a first result
The download contains exactly the content displayed on this page. This copy may differ from the latest version in the source repository.
View the source and supporting filesThis download contains SKILL.md only. Any scripts, references, templates and dependencies are not included. Get the required files from the source, preserving their directory structure, before continuing.
1. Download the file
Download SKILL.mdFrom the root of a test project, save the file as .skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md, or use the command below. This folder is for inspecting the skill before installation.
Command for macOS/Linux or WSL: requires a POSIX shell and curl. On Windows without WSL, use the download button and create the folder manually.
mkdir -p '.skill-downloads/vector-index-tuning-mm5t8ce5' && curl --fail --show-error --location 'https://skills-guides.com/api/skills/vector-index-tuning-mm5t8ce5/download' --output '.skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md.part' && mv '.skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md.part' '.skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md'2. Check prerequisites
Read SKILL.md before using it. If it references scripts or external services, inspect them and prepare the required access in your test environment.
No recognized prerequisites section in this file. This does not mean it is self-contained: libraries, tools and access requirements may be mentioned elsewhere in the content or source repository.
The platforms on this page are catalog indications. The paths below follow tool documentation; they do not prove this skill has been run in those tools. No minimum tool version is confirmed for this listing.
3. Load the skill
After inspection, copy the complete folder into your project using one of the commands below, then open a new tool session. The command stops if a folder with the same name already exists: compare the files before replacing it.
Claude Code
test -f '.skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md' && test -s '.skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md' && mkdir -p '.claude/skills' && test ! -e '.claude/skills/vector-index-tuning' && cp -R '.skill-downloads/vector-index-tuning-mm5t8ce5' '.claude/skills/vector-index-tuning'Cursor
test -f '.skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md' && test -s '.skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md' && mkdir -p '.cursor/skills' && test ! -e '.cursor/skills/vector-index-tuning' && cp -R '.skill-downloads/vector-index-tuning-mm5t8ce5' '.cursor/skills/vector-index-tuning'OpenSkills
OpenSkills must already be installed. The local install/read procedure is checked with OpenSkills 1.5.0, which requires Node.js ≥ 20.6.0. Catalog slugs are not resolved automatically.
Official OpenSkills installationopenskills install './.skill-downloads/vector-index-tuning-mm5t8ce5'openskills read 'vector-index-tuning-mm5t8ce5'Reading should display the installed file content and its base directory. It does not run the skill or install its dependencies.
For an agent that reads AGENTS.md, then sync the index. This command changes AGENTS.md: review the diff before using it.
openskills syncManual method or another tool: attach SKILL.md to a conversation, or open it in an agent that can read files. Include any required supporting resources. No universal folder is recognized by every tool.
4. Try a first task
Use a short, synthetic input: an API endpoint, a small document or an interface brief. In a new conversation, attach the file or give the agent its path, then adapt this request:
Read .skill-downloads/vector-index-tuning-mm5t8ce5/SKILL.md and apply its instructions to this example: [describe a test input]. Identify any missing files, dependencies or access. Produce the result requested by the skill without inventing data or running unreviewed scripts.Expected result: output matching the skill instructions, or a precise list of missing prerequisites. A read confirmation alone does not validate a first use. If an external resource is unavailable, that path remains untested.
Create Interactive Maps with kepler.gl
Data & AI
Create interactive map visualizations and export standalone HTML using the keplergl Python package. Use to plot geospatial data from DataFrames, GeoJSON, or CSV.
Agent-Driven Parameter Optimization
Data & AI
Guide for optimizing configurable systems with a measurable objective, using bounded trials and evidence-based recommendations.
ICP Visitor Outreach
Data & AI
Identify signed-up users matching the ideal customer profile but stalled, and draft personalized outreach to re-engage them.