Ben Lorica and Paco Nathan on Open LLMs, AI Agents, Data Engineering, and Knowledge Bases.
Subscribe: Apple • Spotify • Overcast • Pocket Casts • AntennaPod • Podcast Addict • Amazon • RSS.
Paco Nathan is the founder of Derwen, a boutique consultancy focused on Data and AI. This episode is part of our series of monthly roundups and covers: Llama 3 and other recent LLMs, the rise of open foundation models, the evolution of AI agents, and the importance of data engineering. We also explore the limitations of leaderboards in evaluating AI models and touch upon the ethical and societal implications of AI development.
Relevant Links:
- LLM models: Llama 3 Unpacked ; Architectural Enhancements in Recent Open LLMs
- LLM Models for edge devices: Apple OpenELM; Microsoft Phi-3
- AI Agents: Challenges, Trends, and the Future of Autonomous Systems
- AI leaderboards are no longer useful. It’s time to switch to Pareto curves.
- Cyc: the next-generation of enterprise AI
- TikTok’s Ticking Clock
- Recommendations: Ethics.Dev (Ben) and Entity Resolved Knowledge Graphs: A Tutorial (Paco)
Interview highlights – key sections from the video version:
-
- Monthly Roundup of new open and proprietary LLMs
- Narrowing gap between open and prorpietary LLMs
- The Rise of AI Agents
- Remembering Doug Lenat: Pioneering Work on Cyc and Generative AI Approaches
- TikTok
- Limitations of Leaderboards and the Importance of Empirical Evaluation in Machine Learning
- Recommendations
Related content:
- A video version of this conversation is available on our YouTube channel.
- Ben Lorica and Paco Nathan: Monthly Roundup – New LLMs, GTC 2024, Constraint-Driven Innovation, Model Safety, and GraphRAG
- Ben Lorica and Paco Nathan: Monthly Roundup – From Text-to-Video Models to Knowledge Graphs
- Semih Salihoglu: The Intersection of LLMs, Knowledge Graphs, and Query Generation
- 2024 Themes and Trends in AI
If you enjoyed this episode, please support our work by encouraging your friends and colleagues to subscribe to our newsletter: