An Open Source Data Framework for LLMs

Jerry Liu on helping developers augment LLMs with their own private data.

Subscribe: Apple • Spotify • Stitcher • Google • AntennaPod • Podcast Addict • Amazon •  RSS.

Jerry Liu is CEO and co-founder of LlamaIndex, an open source project and startup that builds tools that enable teams to augment LLMs with their own private data.  LlamaIndex has become one of my favorite new open source projects. It is a data framework that connects various data sources and formats to large language models (LLMs). It facilitates data ingestion, indexing, and retrieval, making it easier for developers to tailor LLMs to specific needs, improve performance, manage costs, and ensure data compliance. LlamaIndex was developed to bridge the gap between enterprise data and LLMs, enabling enhanced use of AI technologies in both personal and commercial applications. It is a robust, easy-to-use framework that can augment LLMs with context and knowledge.

 

Subscribe to the Gradient Flow Newsletter

---

Interview highlights – key sections from the video version:

1. LlamaIndex – origin story
2. LlamaIndex and Vector Databases
3. LlamaIndex and LangChain
4. LlamaIndex – who are the typical users?
5. Prototypical uses cases
6. How does LlamaIndex integrate an LLM input prompt and provide context with my private data?
7. The emerging stack around embedding-based lookups
8. LlamaIndex and next-gen AI applications
9. Metadata filters
10. Customizing LlamaIndex
11. Revisiting the Modern Data Stack
12. Incremental updates and streaming
13. What about enterprise features?
14. Decoupling of state and compute
15. Custom LLMs
16. LlamaIndex roadmap

---

Jerry Liu will be speaking at the AI Conference in San Francisco (Sep 26-27). Use the discount code FriendsofBen18 to save 18% on your registration.

---

Related content:

• A video version of this conversation is available on our YouTube channel.
• Building LLM-powered Apps: What You Need to Know
• Navigating the Future of Search
• Vector Database Primer
• Andrew Feldman: The Rise of Custom Foundation Models
• Jonas Andrulis: Building and Deploying Foundation Models for Enterprises
• Amin Ahmad: LLMs Are the Key to Unlocking the Next Generation of Search
• Bob van Luijt: An open source, production grade vector search engine
• Frank Liu: A Cloud Native Vector Database Management System
• Dylan Patel: The Open Source Stack Unleashing a Game-Changing AI Hardware Shift

---

If you enjoyed this episode, please support our work by encouraging your friends and colleagues to subscribe to our newsletter: