Building AI agents for 127 million customers
This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).
Nubank's engineering team shares five hard-won lessons from building production AI agents for 127 million customers. Key insights include: adopting an evals-first approach using TNPS and LLM-as-a-judge instead of traditional NPS; defining agents through the ReAct paradigm with distinct prompt, tool, and data layers; using
Table of contents
1. The “Evals-First” Approach: From NPS to TNPS2. Redefining the Agent: The React Paradigm3. Stop Writing Prompts: The Era of Prompt Optimization4. Don’t Fine-Tune Unless You’re Chasing the Last 5%5. Move Logic to Tools: LLM Reasoning is Not Business LogicThe Blueprint: Automated Simulation and Bug-BashingConclusion: The Future of Autonomous FinanceSort: