Ben Lorica and Paco Nathan on text-to-video, Gemini, model hubs, synthetic data, and beyond.
Subscribe: Apple • Spotify • Overcast • Google • AntennaPod • Podcast Addict • Amazon • RSS.
Paco Nathan is the founder of Derwen, a boutique consultancy focused on Data and AI. This episode explores recent developments in AI, including text-to-video models like Sora, frameworks for productionizing AI models, analyses of systems like Google’s Gemini, techniques to improve foundation models, AMD’s software innovations for AI acceleration, and knowledge graph augmentations of language models.
Key sections from the video version:
- Sora and Text-to-Video Models
- Navigating the Landscape of AI Production: Endpoint Arbitrage, Performance Metrics, and Decision-Making Frameworks
- Examining Google’s Gemini AI system
- Improving Foundation Models Using Synthetic Data and Preference Learning
- AMD’s Software Evolution and Its Potential in AI
- Augmenting Language Models with Knowledge Graphs
Relevant Links:
- The Impact of Sora and AI on Video Production
- Navigating the Landscape of AI Production: Unify’s Model Hub ; DSPy Assertions
- Five Reasons Developers Should Be Excited About Gemini
- Improving Foundation Models Using Synthetic Data and Preference Learning: Preference Tuning LLMs ; Data Curation and Open Science ; Andrew Ng on Direct Preference Optimization ; Synthetic Data for Finetuning ; From Supervised Fine-Tuning to Online Feedback
- AMD’s Expanding Role in Shaping the Future of LLMs
- Augmenting Language Models with Knowledge Graphs: Microsoft’s GrapRAG ; Nebula Graph RAG ; Graphs for Inference
Related content:
- A video version of this conversation is available on our YouTube channel.
- What Every Competent GDBMS Should Do (aka The Goals & Vision of Kùzu)
- What is Graph Intelligence?
- Emil Eifrem: The Future of Graph Databases
- Sudhir Hasbe: Trends in Data Management: From Source to BI and Generative AI
- Philipp Moritz and Goku Mohandas: Navigating the Nuances of Retrieval Augmented Generation
- Building a Fleet of Custom LLMs
- Ivy: Streamlining AI Model Deployment and Development
- Brian Raymond: ETL for LLMs
- Jerry Liu: An Open Source Data Framework for LLMs
If you enjoyed this episode, please support our work by encouraging your friends and colleagues to subscribe to our newsletter:
