An transformer based LLM. Written completely in Rust - tekaratzas/RustGPT

Hacker News is a community-driven platform for sharing and discussing technology news, startups, and programming-related topics. Through user submissions and comments, Hacker News offers insights into emerging technology trends, industry developments, and entrepreneurial ventures. Readers can participate in discussions, share their insights, and stay informed about the latest advancements in technology and innovation.

Hacker News

A complete transformer-based Large Language Model implementation built from scratch in pure Rust using only ndarray for matrix operations. The project includes pre-training on factual text, instruction tuning for conversational AI, interactive chat mode, and full backpropagation with gradient clipping. Features a modular architecture with 3 transformer blocks, custom tokenization, Adam optimizer, and comprehensive test coverage, demonstrating key ML concepts without external ML frameworks.

tekaratzas/RustGPT: An transformer based LLM. Written completely in Rust

<p>i dont mean to judge but rust or python doesnt really make a difference since the underlying libs in python are written in c/c++, doesnt really put a lot of meaning into writting lib in rust beside making it torturous, for these types of matters, the training algorthm is more important imo</p>
