RAG continues to rise (Practical AI #264)

Changelog Master Feed

Daniel & Chris delight in conversation with “the funniest guy in AI”, Demetrios Brinkmann. Together they explore the results of the MLOps Community’s latest survey. They also preview the upcoming AI Quality Conference.

Join the discussion

Changelog++ members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

• The Hacker Mindset – “The Hacker Mindset” written by Garrett Gee, a seasoned white hat hacker with over 20 years of experience, is available for pre-order now. This book reveals the secrets of white hat hacking and how you can apply them to overcome obstacles and achieve your goals. In a world where hacking often gets a bad rap, this book shows you the white hat side – the side focused on innovation, problem-solving, and ethical principles.
• Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today.
• Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs.

Featuring:

• Demetrios Brinkmann – Twitter
• Chris Benson – Twitter, GitHub, LinkedIn, Website
• Daniel Whitenack – Twitter, GitHub, Website

Show Notes:

• MLOps Community
• AI Quality Conference
• Evaluation Survey
• RAG failover talk from Jerry Lui
• Prompt Templates the Song

Something missing or broken? PRs welcome!

Luvut

1. Welcome to Practical AI (00:00:00)

2. Welcome back Demetrios! (00:00:43)

https://cdn.changelog.com/uploads/avatars/people/0PYWO/avatar_large.jpg

3. The fall of fine-tuning, the rise of RAG (00:01:40)

4. RAG as a Service (00:03:12)

5. Traditional workloads vs AI workloads (00:03:40)

6. MLOps surveys (00:05:24)

7. Sponsor: Hacker Mindset (00:09:50)

https://thehackermindset.com

8. Effect of expertise (00:11:01)

9. Andreessen Horowitz survey (00:15:30)

10. Single points of failure (00:18:30)

11. What data do we use? (00:22:22)

12. Spread out community (00:25:54)

13. Correcting retrieval (00:29:28)

14. RBAC (00:32:55)

15. Sponsor: Changelog News (00:35:48)

https://changelog.com/news

16. Escaping transformers (00:37:31)

17. Neuromorphic computing (00:39:52)

18. MLOps in-person conference (00:44:35)

19. Outro (00:47:32)