comments (2)

  • I feel like retrieval approaches, despite how good your ranking mechanisms are, end up biasing LLMs into what a heuristics-based system with way worse understanding of the domain says. I guess is a trade off between speed and quality, but letting the LLM explore without a bias (based on my personal experience) seems to generally provide much better results in terms of quality for the final output.

    comandillos

  • as a recovering RAG-enthusiast, I will share a quote from a peer that has really stuck with me:

    "why not use grep?"

    brrrrrm