Polly, the AI assistant built into LangSmith, is now generally available across all pages of the platform. Previously limited to trace pages, thread views, and the playground, Polly now appears in every LangSmith workflow including experiments, datasets, annotation queues, and evaluators. Key new capabilities include persistent conversation context across navigation, the ability to take actions (update prompts, create datasets, write evaluator code, filter views, compare experiments), thread analysis for understanding user sentiment and conversation outcomes, and assisted evaluator authoring. The goal is to reduce the manual effort of debugging long agent traces and interpreting experiment results.
Sort: