Clay, a B2B SaaS platform for go-to-market teams, runs 300 million AI agent runs per month and relies on LangSmith for observability, evaluation, and cost monitoring. Key challenges included unpredictable quality at scale, cost reconciliation across multiple model providers, and rapid model evaluation. LangSmith integration

8m read timeFrom blog.langchain.com
Post cover image
Table of contents
From chat completions to 300 million agent runsThe challenge: quality, cost, and model proliferation at scaleLangSmith as the observability layer: from day zero to productionAchieving near-perfect cost reconciliation at massive scaleLooking ahead: Agents with longer time horizonsConclusion

Sort: