Sarmad Qadri on developer tools for building generative AI applications.
Subscribe: Apple • Spotify • Overcast • Google • AntennaPod • Podcast Addict • Amazon • RSS.
Sarmad Qadri, founder and CEO of LastMile, a startup building an AI developer platform for engineering teams. This conversation delves into key artificial intelligence and machine learning themes, focusing on injecting software engineering rigor into the development of LLM and GenAI applications.
Interview highlights – key sections from the video version:
- LastMile AI – the origin story
- GenAI signature of an application
- An Overview and a Demo of aiconfig – a Flexible Tooling for Production-Ready AI
- aiconfig and emerging design patterns (mixture of experts and beyond)
- Retrieval augmented generation (RAG)
- Evaluating RAG setups
- Staffing GenAI projects
- Open source LLMs and existing endpoints like Anyscale
- Status of their RAG tool (semantic retrieval)
- Orchestration
- ETL tools for GenAI applications
- Risk mitigation
Related content:
- A video version of this conversation is available on our YouTube channel.
- Philipp Moritz and Goku Mohandas: Navigating the Nuances of Retrieval Augmented Generation
- Waleed Kadous: Best Practices for Building LLM-Backed Applications
- Malte Pietsch: Orchestration for LLM and RAG applications
- Ivy: Streamlining AI Model Deployment and Development
- Best Practices in Retrieval Augmented Generation
- Yucheng Low: Versioning and MLOps for Generative AI
- Expanding access to Frontier Models with software and hardware optimizations
- Open Source Principles in Foundation Models
- Michele Catasta: Software Development with AI and LLMs
If you enjoyed this episode, please support our work by encouraging your friends and colleagues to subscribe to our newsletter: