Shahul Es Avatar

Shahul Es

1 episode

Practical AI Practical AI #284

Metrics Driven Development

Play
2024-08-29T20:45:00Z #ai +1 🎧 30,159

How do you systematically measure, optimize, and improve the performance of LLM applications (like those powered by RAG or tool use)? Ragas is an open source effort that has been trying to answer this question comprehensively, and they are promoting a “Metrics Driven Development” approach. Shahul from Ragas joins us to discuss Ragas in this episode, and we dig into specific metrics, the difference between benchmarking models and evaluating LLM apps, generating synthetic test data and more.

Player art
  0:00 / 0:00