I feel like retrieval approaches, despite how good your ranking mechanisms are, end up biasing LLMs into what a heuristics-based system with way worse understanding of the domain says. I guess is a trade off between speed and quality, but letting the LLM explore without a bias (based on my personal experience) seems to generally provide much better results in terms of quality for the final output.
comandillos
as a recovering RAG-enthusiast, I will share a quote from a peer that has really stuck with me:
comments (2)
comandillos
"why not use grep?"
brrrrrm