The AI Infrastructure Revolution: From Cloud Computing to Data Center Design

Bryan Cantrill on Optimizing Infrastructure for AI Workloads.

Subscribe: Apple • Spotify • Overcast • Google • AntennaPod • Podcast Addict • Amazon •  RSS.

Bryan Cantrill, CTO and Co-founder of Oxide Cloud Computer, leads a startup delivering integrated hardware and software solutions for enterprises seeking cloud computing systems with hyperscaler agility. Oxide specializes in vertically integrated, scale-ready cloud infrastructure tailored for mainstream business needs.

Subscribe to the Gradient Flow Newsletter

Advances in cloud computing, hardware infrastructure, and software-defined systems are providing the foundation for rapid AI innovation. However, these technologies also introduce new challenges around efficiency, costs, security and infrastructure management that AI engineering teams must address. This episode explores the evolving landscape of infrastructure for AI, key innovations like new data center designs and virtualization, and how the economics and optimization of these systems will impact the advancement of artificial intelligence.

 

Interview highlights – key sections from the video version:

• 1. The evolution of computer technology and the rise of elastic infrastructure
  2. The Pain Points of Today’s Commodity Server Infrastructure
  3. The need for integrated hardware and software co-design
  4. Bridging the gap between on-premises and cloud computing
  5. AMD’s APU brings promise for AI workloads
  6. The future of hardware for ML
  7. Early customers and use cases for Oxide Computer’s cloud native hardware
  8. The Benefits of Onshoring Manufacturing
  9. Oxide Computer General Availability for Data Center Racks

 

Related content:

• A video version of this conversation is available on our YouTube channel.
• Beyond Nvidia: Exploring New Horizons in LLM Inference
• Sharon Zhou and Greg Diamos: Enabling AMD for Large Language Models
• Nir Shavit: LLMs on CPUs, Period
• Philipp Moritz and Goku Mohandas: Navigating the Nuances of Retrieval Augmented Generation
• Apple’s AI Leap: Bridging the Gap in On-Device Intelligence
• Daniel Lenton: Ivy – The One-Stop Interface for AI Model Deployment and Development
• Waleed Kadous: Best Practices for Building LLM-Backed Applications

---

If you enjoyed this episode, please support our work by encouraging your friends and colleagues to subscribe to our newsletter: