LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!

This guide demonstrates how to run large language models (LLMs) on mobile devices using React Native. It walks through the creation of a mobile app that allows users to chat with AI models locally, ensuring privacy and offline functionality. The tutorial also covers choosing the right model sizes, understanding GGUF quantization formats, setting up the React Native environment, and implementing features such as a chat interface, model downloading, and state management. Additional advanced features like generation on the fly, auto-scrolling, and inference speed tracking are also discussed.