Monitor Databricks with Grafana Cloud for instant visibility into your workloads

Grafana Labs has released a Databricks integration for Grafana Cloud that pulls metrics from Databricks workspaces without requiring custom exporters or manual dashboard setup. The integration provides three prebuilt dashboards covering billing/DBU consumption, job and pipeline reliability, and SQL warehouse performance. It also includes 14 out-of-the-box alerting rules organized by team persona (FinOps, SRE, Analytics). Under the hood, it uses an open source databricks-prometheus-exporter embedded in Grafana Alloy, which queries Databricks System Tables via a SQL Warehouse. Setup takes roughly 10 minutes and requires OAuth2 service principal credentials. Notable caveats include a 24–48 hour billing data lag inherent to Databricks, a 10-minute scrape interval with 90–120 second query times, and potential permission issues with the pipeline table.