Deutsche Börse Group built a generative AI-powered tool to migrate 2,000+ Zeppelin notebooks from Cloudera to Databricks, driven by Cloudera's 2027 decommissioning of Zeppelin. The approach separates deterministic structural conversion (paragraph-to-cell mapping, interpreter translation, metadata reformatting) from logic reconstruction, which is delegated to Databricks Genie via context-aware prompts. Built as a Databricks App with a shadcn UI frontend, the tool reduces per-notebook migration time from hours to 15–20 minutes and enables business users to migrate their own notebooks without deep Databricks expertise. SQL, Python logic, visualizations, and business-specific code are intentionally left untouched by the converter and handled by Genie instead.

5m read timeFrom databricks.com
Post cover image
Table of contents
The notebook migration problemBuilding the converter on Databricks AppsWhat we chose not to automateThe result: hours to minutesWhat we learnedWhat's next

Sort: