A Ruby/Rails maintenance service (Bonsai by FastRuby.io) built an internal LLM-powered workflow to automate quarterly client reports. The system mirrors the original manual process with three layers: Data Providers (Jira, GitHub, static analysis tools), Curators (LLM-assisted summarization per report section), and Reviewers (LLM quality gates returning structured JSON with accuracy, completeness, and quality scores). A human engineer does a final review of the polished draft. Key lessons: structured workflows beat autonomous agents for predictable tasks, mapping existing human processes to AI outperforms AI-first design, and explicit review steps are essential for client-facing output quality.

8m read timeFrom ombulabs.ai
Post cover image
Table of contents
IntroductionWhat Is Bonsai?The Original (Very Human) WorkflowMapping the Process to an AI-Powered WorkflowData ProvidersCuratorsReviewers: The Quality GateFrom JSON to ReportWhy This Project MattersWhat We Learned

Sort: