Is HNSW better than IVFFlat for vector indexes?

Generally, yes. HNSW offers a superior speed-recall tradeoff and can be built on empty tables, making it the 'Golden Path' for most production semantic search workloads.

How does this skill help with RAG performance?

It provides optimized query patterns, indexing strategies, and re-ranking techniques that ensure your retrieval step is both fast and highly relevant for Large Language Models.

Why should I use pgvector for semantic search?

pgvector allows you to store and query AI embeddings directly alongside your application data in PostgreSQL, eliminating the need for a separate vector database and simplifying your architecture.

What is the benefit of using the halfvec type?

The halfvec type reduces storage and index sizes by 50% compared to standard vectors with minimal impact on search recall, allowing you to fit more embeddings in memory.

pgvector Semantic Search

Name: pgvector Semantic Search
Author: timescale

bytimescale

•

1,486

•

Database Management

Implements and optimizes high-performance vector similarity search in PostgreSQL using pgvector for AI and RAG applications.

This skill provides specialized guidance for architecting and optimizing semantic search workflows within PostgreSQL. It helps users navigate the complexities of vector operations, from selecting memory-efficient data types like halfvec to configuring high-performance HNSW indexes and implementing advanced binary quantization for massive datasets. Whether you are building a Retrieval Augmented Generation (RAG) pipeline or a recommendation engine, this skill ensures your database remains fast, accurate, and scalable.

Key Features

01Memory-optimized storage using halfvec and binary quantization

02Advanced filtered search strategies using iterative scans

03Expert HNSW and IVFFlat index configuration and tuning

04Performance benchmarking for speed-recall tradeoffs

05Efficient distance operator selection (Cosine, L2, Inner Product)

061,486 GitHub stars

Use Cases

01Scaling semantic search to handle millions of high-dimensional embeddings

02Optimizing database memory residency for low-latency AI queries

03Building production-grade RAG pipelines using PostgreSQL

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add timescale/pg-aiguide pgvector-semantic-search

For use in Claude.ai and ChatGPT

Download Skill