grafana/o11y-bench
o11y-bench: an open agentic observability benchmark. Measures how well AI agents perform 63 real-world observability tasks across logs, metrics, traces, dashboards, and incident workflows.
Published 4/24/2026 by Yasir Ekinci
harbor run -d grafana/o11y-benchgrafana/o11y-bench
o11y-bench is an open agentic observability benchmark from Grafana.
It measures how well AI agents perform 63 real-world observability tasks across logs, metrics, traces, dashboards, and incident workflows.
Source, documentation, and usage instructions are available in the public GitHub repository:
| Task |
|---|
grafana/promql-order-latency-vs-traffic |
grafana/dashboard-repair-cache-review |
grafana/cache-rollout-trigger-check |
grafana/deployment-blast-radius-check |
grafana/audit-service-overview-variable |
grafana/logql-deployment-rollout-events |
grafana/find-slow-traces |
grafana/search-dashboards |
grafana/promql-discover-http-metric |
grafana/promql-capacity-analysis |
grafana/promql-subquery-peak-error-rate |
grafana/trace-error-analysis |
grafana/dashboard-add-deployment-annotation |
grafana/logql-unwrap-orders-p95-latency |
grafana/traceql-error-chain-orders |
grafana/traceql-discover-orders-error-attributes |
grafana/retry-backlog-incident |
grafana/dashboard-create-cache-incident-review |
grafana/find-slow-requests |
grafana/check-service-health |
grafana/traceql-cache-refresh-hotspot |
grafana/dashboard-update-add-service-variable |
grafana/cache-refresh-lag-handoff |
grafana/list-services-traces |
grafana/query-cpu-metrics |
grafana/traceql-structural-query |
grafana/cache-incident-blast-radius |
grafana/traceql-error-span-analysis |
grafana/traceql-checkout-p99-by-service |
grafana/logql-multi-stage-pipeline |
grafana/promql-error-rate |
grafana/promql-cache-refresh-lag-peak |
grafana/traceql-tail-latency-bottleneck |
grafana/dashboard-create-service-overview |
grafana/audit-service-overview-datasources |
grafana/logql-retry-vs-real-errors |
grafana/traceql-find-service-traces |
grafana/traceql-cross-service-analysis |
grafana/slow-path-hotspot-correlation |
grafana/promql-cache-lag-vs-user-latency |
grafana/logql-cache-refresh-peak-lag |
grafana/inspect-dashboard-queries |
grafana/traceql-metrics-error-rate-by-service |
grafana/promql-topk-5xx-share |
grafana/logql-payment-warning-volume |
grafana/payment-error-blast-radius |
grafana/get-datasource-details |
grafana/logql-parse-json-logs |
grafana/dashboard-add-cache-lag-panels |
grafana/payments-path-root-cause |
grafana/dependency-outage-false-lead |
grafana/logql-retry-backlog-warnings |
grafana/promql-retry-backlog-triage |
grafana/incident-triage |
grafana/query-memory-usage |
grafana/promql-burn-rate-assessment |
grafana/list-datasources |
grafana/promql-offset-traffic-compare |
grafana/promql-label-matchers-service-errors |
grafana/promql-highest-backend-error-ratio |
grafana/dashboard-add-retry-backlog-panels |
grafana/service-degradation-rca |
grafana/logql-top-5xx-endpoint |
Displaying 63 of 63 tasks