All About AI Observability (The Context Window #03)

Name: All About AI Observability (The Context Window #03)
Uploaded: 2026-04-23T07:26:12.000Z
Channel: Grafana

Ai observability Grafana Llm evaluation Opentelemetry Ai debugging Llm as judge Machine learning ops Ai testing Observability Ai quality assurance

Grafana April 23, 2026

AI summary

This Grafana podcast episode explores AI observability: why observing AI systems is challenging, how to debug AI when issues arise, and using evaluations to build confidence in AI application quality. The hosts and guests explain concepts like LLM as judge, demonstrate setting up AI observability in Grafana Cloud, and show how OpenTelemetry forms the foundation for AI monitoring. Targeted at software engineers and developer advocates working with AI in production.