comet-ml/opik: Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Opik is an open-source platform developed by Comet for evaluating, testing, and monitoring large language model (LLM) applications. It offers tools such as tracing, automated evaluations, and dashboards to optimize LLM systems in development and production. Users can log traces, automate evaluations, and monitor applications through dashboards, with the option to integrate Opik into CI/CD pipelines.