Lenny and prompt engineer Mike Taylor explored how close AI is to replacing product managers by testing AI's performance on three challenging PM tasks: developing a product strategy, defining KPIs, and estimating ROI. AI outperformed humans in two out of three tasks, largely due to effective prompt engineering. The study indicates AI's improving capabilities and potential to handle more PM tasks in the future. Blind tests and prompt adjustments were key to realistic assessments of AI’s performance.

31m read timeFrom lennysnewsletter.com
Post cover image
Table of contents
Task # 1: Developing a product strategyTask #2: Defining performance metricsTask #3: Estimate ROIWhat comes next?Bonus: How I created the prompts for these tasks👀 Hiring? Or looking for a new job?
2 Comments

Sort: