Blazing fast bulk data transfers between any cloud

Paras Jain and Sarah Wooders on Skyplane, an inter-cloud broker for data-intensive applications.

Subscribe: Apple • Spotify • Stitcher • Google • AntennaPod • Podcast Addict • Amazon •  RSS.

Paras Jain and Sarah Wooders are graduate students at UC Berkeley’s Sky Computing Lab. They are part of the team behind Skyplane, and open source project that accelerates wide-area transfers in the cloud via overlay routing and parallelism. Skyplane moves terabytes of data reliably and efficiently (>20Gbps) at up to 4x lower costs.

Subscribe to the Gradient Flow Newsletter

Interview highlights – key sections from the video version:

1. What is Skyplane?
2. Who is using Skyplane and how are they using it?
3. How does one use Skyplane?
4. Skyplane’s secret sauce
5. Encryption and data transfers
6. Skyplane and machine learning workloads
7. Skyplane roadmap
8. Sky storage
9. Support for other cloud platforms

Related content:

• A video version of this conversation is available on our YouTube channel.
• Zongheng Yang: Running Machine Learning Workloads On Any Cloud
• Vector Database Primer
• FREE Report: 2023 Trends in Data, Machine Learning, and AI
• Specialized Hardware for AI: Rethinking Assumptions and Implications for the Future
• Percy Liang: Evaluating Language Models
• Jesse Anderson and Evan Chan: 2023 Trends in Data Engineering and Infrastructure
• Machine Learning Trends You Need To Know
• Mark Chen of OpenAI:  How DALL·E works

---

If you enjoyed this episode, please support our work by encouraging your friends and colleagues to subscribe to our newsletter:

---

[Image: Skyplane, used with permission.]