Agentic AI is driving a fundamental shift in data infrastructure requirements, demanding real-time data interaction measured in milliseconds rather than minutes. Organizations need to modernize their data platforms to serve diverse teams including ML engineers, developers, and automated agents using technologies like Apache Iceberg. The biggest challenges lie in operational readiness including lineage tracking, resource efficiency, security, and discovery rather than technology selection. Success requires balancing open-source innovation with cloud provider operational expertise to avoid vendor lock-in while ensuring scalability and reliability.
Table of contents
The AI data layer must serve polyglot, multi-persona teamsYour biggest challenge? “Day two” operationsThe right balance between open source and cloud partnersThe agentic AI skills gap is realSort: