Day 3 - Chunking - RAG

A Redis engineer encountered issues with embedding model queries due to a single passage point. Chunking is necessary to retrieve specific parts of the passage. There are two methods: discrete chunking and semantic chunking. Discrete chunking can be further divided into fixed and overlapping chunking. The engineer is exploring optimal chunk sizes, such as 25 characters or until a sentence is completed.