Retrieval & Agents

Chunking

Splitting documents into smaller passages before indexing them, a foundational step that makes or breaks a RAG system.

Chunking breaks long documents into bite-sized passages so each can be embedded and retrieved on its own. The size and boundaries matter a lot: chunks too large dilute relevance and waste context, too small lose the surrounding meaning. Good chunking, often along natural boundaries like paragraphs or sections, is one of the highest-leverage tuning decisions in a retrieval system.