Language modeling is all about how computers understand and generate human language. It’s a key part of making AI systems that can communicate with us effectively. In recent years, ChatGPT has been a…

The AI Newsletter (tai) is a curated newsletter that delivers insights, articles, and resources on artificial intelligence (AI) and machine learning (ML). Covering topics such as deep learning, natural language processing, and computer vision, the newsletter offers  insights and updates on the latest advancements in AI research and technology. Developers can stay informed about the latest trends and developments in AI and ML by subscribing to The AI Newsletter.

Towards AI

This post discusses bigram language modeling, its implementation, and its comparison to a neural network model. It also provides an overview of the training loop and inference process.

Bigram Language Modeling From Scratch