My RAG chat application is not finding the correct embedded chunks when responding to a chat query?
Carlos_Dataglue
Registered Posts: 2 ✭
Answers
-
I have a RAG application with over 125,000 embeddings. When querying the chatbox, it cannot find the correct chunk to respond to the query. I'm confident the answer is within the embedded chunks, but the RAG chatbox wont pick the right chunk to use for completion; therefore it fails to find the correct response.
Anyone use keyword search ? How to improve the accuracy in a RAG chatbox response? We have the unique identifier as a metadata field as well. Yet, we do not know how to query the metadata field or use it to limit the chunks retrieved by the RAG.