Building AI Agents that actually automate Knowledge Work - Jerry Liu, LlamaIndex

Jerry Liu from LlamaIndex presents a framework for building AI agents that automate knowledge work over unstructured documents. He distinguishes between assistive agents (chat interfaces that help humans get information) and automation agents (background processes that handle routine tasks). The approach requires a comprehensive document toolbox with parsing capabilities for complex PDFs, Excel sheets, and other formats, plus appropriate agent architectures ranging from constrained to unconstrained workflows. Real-world applications include financial due diligence, enterprise search, and technical data sheet processing, with LlamaIndex providing cloud services for document parsing that outperform existing benchmarks.