Opik is an open-source platform by Comet providing tracing, LLM-as-a-judge evaluation, and monitoring for LLM applications, RAG systems, and agentic workflows.

It supports PyTest CI/CD integration, online evaluation rules, and production dashboards handling 40M+ traces per day. Deployment options include Comet.com cloud, Docker Compose via a shell script, and Kubernetes for self-hosting.

Topics

Agentic Workflows LLM Observability Opik RAG Systems Prompt Optimization

View on GitHub All Bookmarks

Discover Similar Content

William's Bookmark Library

/**/

GitHub - comet-ml/opik: Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

github.comSaved July 6, 20269 min

comet-ml · via GitHub

Summary

Opik is an open-source platform by Comet providing tracing, LLM-as-a-judge evaluation, and monitoring for LLM applications, RAG systems, and agentic workflows.

Topics

Agentic Workflows LLM Observability Opik RAG Systems Prompt Optimization

View on GitHub All Bookmarks