MLflow 3.6 introduces automatic tracing integrations for TypeScript and JavaScript LLM frameworks including Vercel AI SDK, LangChain.js, LangGraph.js, Mastra, Anthropic, and Gemini. These integrations use OpenTelemetry to send traces to MLflow's tracking server, capturing prompt/response payloads, token usage, tool results, and errors. Setup requires minimal configuration—typically just pointing an OTLP endpoint to your MLflow server and wrapping SDK clients. MLflow can be deployed via Docker Compose or managed cloud services, eliminating the need for a Python environment alongside JavaScript stacks.

4m read timeFrom mlflow.org
Post cover image
Table of contents
Set up MLflow ​Vercel AI SDK / Next.js ​Mastra ​LangChain.js / LangGraph.js ​OpenAI SDK ​Anthropic SDK ​Gemini SDK ​Next Steps ​

Sort: