Cohere's Ivan Zhang on Foundation Models, Retrieval-Augmented Generation, and Feedback Loops

Cohere's Ivan Zhang on Foundation Models, Retrieval-Augmented Generation, and Feedback Loops

Aug 23, 2023 · 21 min

People

Listen on

Suggest an edit

In this episode, Madrona Partner Jon Turow and Cohere CTO and Co-founder Ivan Zhang dive into the world of foundation models for the enterprise. Cohere was founded in 2019 — a time when even the most passionate believers did not realize how soon the world would be struck by the capabilities of foundation models. The company announced a $270 million raise in June – which put it at an over $2 billion valuation — and — Ivan's co-founder Aidan Gomez was a co-author of the seminal paper "Attention Is All You Need," which actually introduced the Transformer, the architecture behind foundation models. Notwithstanding the big numbers, Cohere keeps itself scrappy and hungry, having still only raised a fraction of what others in the space have to date. In this episode, Ivan shares about his decision not to finish school and instead gain practical experience working in startups and publishing research to basically prove that he could without a degree. He dishes about applying that same renegade spirit to hiring, shares his thoughts about the importance of feedback loops with customers as well as the difference between fine-tuning and teaching a model how to retrieve the right knowledge, and so much more. You can read a transcript of this conversation here: https://www.madrona.com/cohere-ivan-zhang/

Cohere Jon Turow Mission Ivan API Service Ivan Zhang Google Cloud Coral Garnick Duckin Aidan Gomez

Chapters

  1. 0:00 Introduction and Cohere's Mission
  2. 3:43 Ivan's Journey into Deep Learning and Founding Cohere
  3. 10:18 Early Days of Research and GCP's Role
  4. 11:29 The Renegade Spirit at Cohere
  5. 13:50 From Autocomplete to API Service

Conversation

No comments yet.