Hagay Lupesko on Democratizing LLMs and the Rise of Open Foundation Models for Enterprises.
Subscribe: Apple • Spotify • Overcast • Pocket Casts • AntennaPod • Podcast Addict • Amazon • RSS.
In this episode, Hagay Lupesko, Senior Director of Engineering at Databricks MosaicAI, explores the creation and aspirations behind DBRX, an innovative open Large Language Model (LLM) designed to bridge the gap between quality and cost-effectiveness for AI applications. The discussion highlights the critical role of high-quality training data and technical innovations, like the mixture-of-experts model, in enhancing model performance, especially in coding and mathematical tasks. By focusing on the open-source community’s power and the importance of efficient deployment strategies, DBRX represents a significant step forward in making advanced AI accessible and adaptable for a wide range of applications, promising a future of continuous improvement and collaboration in AI development.
Interview highlights – key sections from the video version:
- Inspiration and Goals of DBRX
- Addressing the Need for Open LLMs
- The Importance of Provider Commitment to Open LLMs
- Mixture of Experts (MoE) Architecture in DBRX
- Data Curation and Training Process
- Enterprise Optimization and Rag Applications
- Model Size, Efficiency, and Deployment
- Comparing DBRX with Other LLMs
- Sustainability and Funding of Open LLMs
- DBRX Licensing and Community Impact
- Future Directions for DBRX
- DBRX and the Databricks Lakehouse Platform
- Hybrid Rag and LLM Tool Usage
- The Potential of Knowledge Graphs
- Vector Databases and the Rag Ecosystem
- Getting Involved with DBRX and Community Engagement
Related content:
- A video version of this conversation is available on our YouTube channel.
- Introducing DBRX: A New State-of-the-Art Open LLM
- Llama 3 Unpacked
- Nvidia’s GTC 2024 Announcements
- Open LLMs: A Tale Of Two Licenses
- Jamba: The LLM with Mamba Mentality
- The Efficient Frontier of LLMs: Better, Faster, Cheaper
- Mistral’s Impact on the AI Landscape
- Hagay Lupesko: Custom Foundation Models
If you enjoyed this episode, please support our work by encouraging your friends and colleagues to subscribe to our newsletter: