Stop Chunking Like It's 2022 — Yuval Belfer, AI21 Labs
Fixed chunking is a flawed assumption in RAG. The optimal chunk size is query-dependent. By implementing multiscale indexing and combining results using RRF, systems can achieve 20-40% higher recall.
Read article