Which embedding model should I choose for high-accuracy RAG?

For maximum accuracy, text-embedding-3-large is recommended for general tasks, while voyage-2 is highly effective for specialized domains like code and legal documentation.

How does this skill help with indexing large documents?

It provides reusable templates for recursive character splitting and semantic chunking to ensure documents are broken into meaningful context windows.

Can I use this for local, open-source embedding models?

Yes, it includes specific implementation patterns for Sentence Transformers and BGE models to support local and privacy-conscious vector search.

What is the benefit of dimension reduction in embeddings?

Using Matryoshka embeddings allows you to reduce vector sizes (e.g., from 3072 to 512) to save on storage and compute costs while maintaining high retrieval performance.

Embedding Strategies

Name: Embedding Strategies
Author: EricGrill

byEricGrill

•

Data Science & ML

Optimizes vector embedding selection and text chunking strategies for production-grade RAG and semantic search applications.

This skill provides a comprehensive framework for developers building high-performance AI-driven search and retrieval systems. It simplifies the selection process between leading embedding models from OpenAI, Voyage, and Hugging Face, while offering production-ready templates for sophisticated chunking methods including token-based, semantic, and recursive splitting. By implementing these patterns, developers can significantly improve retrieval accuracy, reduce vector storage costs through dimension reduction, and handle complex domain-specific data like code or multilingual content more effectively.

Key Features

012 GitHub stars

02Matryoshka representation patterns for efficient dimension reduction

03Retrieval quality evaluation metrics to benchmark search performance

04Domain-specific pipelines for code and multilingual data indexing

05Advanced chunking templates including recursive and semantic splitting

06Comparative analysis of industry-leading embedding models (OpenAI, Voyage, BGE)

Use Cases

01Optimizing RAG system accuracy by selecting the ideal chunk size and overlap

02Building specialized search engines for technical documentation and codebases

03Implementing cost-effective vector search using embedding dimension reduction

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add ericgrill/agents-skills-plugins embedding-strategies

For use in Claude.ai and ChatGPT

Download Skill