In 2023, an AI-powered Chief of Staff tool for engineering leaders reached 10,000 users within a year. Insights gathered during its development led to the creation of Outropy, a developer platform to build AI products, focusing on sustainable and reliable AI systems. The journey involved navigating challenges with generative AI, understanding the role of agents versus microservices, and optimizing performance and scalability. The transition to using Temporal for stateful workflows and the evolution of AI product development is a highlight, offering valuable lessons in structuring AI applications.
Table of contents
Structuring an AI ApplicationWhat are agents, really?Agents are not MicroservicesAgents are more like objectsImplementing Agentic MemoryHandling Events in Natural LanguageScaling to 10,000 UsersThe Zero-one-infinity ruleAgents as Distributed ObjectsSort: