The Data Exchange Podcast: Sijie Guo on how Apache Pulsar is able to handle both queuing and streaming, and both online and offline applications.
In this episode of the Data Exchange I speak with Sijie Guo, founder of StreamNative, a new startup focused on making enterprise messaging technologies – specifically Apache Pulsar – easy to use on the cloud. Sijie was previously a cofounder of Streamlio (acquired by Splunk) and prior to that he led the messaging team at Twitter. He is also the main organizer behind the Pulsar Summit (April in San Francisco), a new conference whose Call for Speakers closes on January 31st.
I’ve written about the importance of foundational data technologies, and data ingestion and messaging are the starting point for modern data applications. As data and machine learning continue to grow in importance, it’s critical for companies to make sure they have the right messaging systems in place.
Our conversation spanned many topics, including:
- The role of messaging in modern data applications and platforms.
- The two main types of messaging applications: queuing and streaming.
- Apache Pulsar as a unified messaging platform, able to handle both queuing and streaming, and both online and offline applications.
- A status update on Apache Pulsar.
Our goal in this podcast is to build a community of people interested in Data, Machine Learning and AI. If you have suggestions for us on what to recommend (books, conferences, links), and guests to book, please visit TheDataExchange.media site and fill out the “contact” form.
- A recent thread on Hacker News compared Apache Pulsar with other popular systems including Kafka (here).
- “One simple chart: Who is interested in Apache Pulsar?”
- “Apache Pulsar Versus Apache Kafka”
- Karthik Ramasamy: “Architecting and building end-to-end streaming applications”
- Sijie Guo on ”Comparing Pulsar and Kafka: unified queuing and streaming”
- Becoming a machine learning company means investing in foundational technologies
[Image from pxfuel.]