My thousand dollar iPhone can't do math
This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).
An iPhone 16 Pro Max produced incorrect numerical outputs when running MLX-based LLMs, while the same code worked perfectly on an iPhone 15 Pro and MacBook Pro. Through systematic debugging involving breakpoint analysis and tensor output comparison across devices, the issue was traced to a hardware defect in the A18 chip's
Table of contents
TL;DR:How did I get there?Finding the smoking gun: breakpoints in MLX's implementations of GemmaWelp, now it's definitely out of my expertiseWhat's going on?Sort: