OpenLLMetry is an open source project by TraceLoop that extends OpenTelemetry to provide observability for AI agent workflows. It supports instrumentation for 30+ LLMs (including Anthropic, Google Gemini, OpenAI), popular vector databases (Pinecone, ChromaDB, Elasticsearch), and AI frameworks (LangChain, Haystack). Available as SDKs for Python, JavaScript/TypeScript, Ruby on Rails, and Go, it enables tracing across multi-step agentic workflows via MCP server handoffs, cost tracking by token usage, RAG debugging, and performance monitoring. TraceLoop also offers a commercial platform with LLM evaluations, prompt registry, and drift detection.
Sort: