RAG Inventor Talks Agents, Grounded AI, and Enterprise Impact
People
-
Jon Turow Host
-
Douwe Kiela Guest
Listen on
What does it take to invent a foundational AI paradigm — and then build a company to bring it to the enterprise? In this episode of Founded & Funded, Madrona Partner Jon Turow sits down with Douwe Kiela, co-founder and CEO of Contextual AI and the co-inventor of RAG (Retrieval Augmented Generation). They dive into the origins of RAG, its misunderstood role in the enterprise, and how Contextual is redefining what production-grade AI systems can do. Douwe shares what most companies get wrong about RAG, why chunking shouldn't matter, how to think about hallucinations, and what founders need to know in the era of RAG agents. Transcript: https://madrona.com/rag-inventor-talks-agents-grounded-ai-and-enterprise-impact Chapters: (00:00) Introduction (01:27) The Origin of RAG (04:00) Challenges and Innovations in RAG (09:49) Enterprise Adoption and Use Cases (20:46) Scaling and Innovations at Contextual AI (23:39) The Future of RAG Agents (24:43) Challenges in Enterprise Data (26:34) Building a Research-Driven Company (27:55) The Intersection of Research and Product (32:10) Advice for Founders and AI Companies (38:14) Understanding and Addressing Hallucinations (40:50) Company Building is Harder Than You'd Think (42:00) The Importance of Evaluation in AI (44:14) Concluding Thoughts
Chapters
- 0:00 Introduction and Ambition
- 0:36 Introducing Douwe Kiela and Contextual AI
- 0:59 The Genesis of RAG
- 1:59 The Origin Story of RAG: Grounding and Data Sources
- 5:49 Multimodality in RAG's Early Conception
- 6:37 Addressing Knowledge Cutoffs and Model Freshness
- 7:00 The Role of Lightweight Models and Retrievers
- 7:44 RAG in the Context of Other AI Techniques
- 8:11 RAG vs. Fine-Tuning and Long Context
- 12:22 The Seduction and Misunderstanding of RAG
- 12:45 RAG's Ease of Use and Comparison to Long Context
- 14:11 Enterprise Aha Moments and Time to Value