Nvidia AI Released Llama-Minitron 3.1 4B: A New Language Model Built by Pruning and Distilling Llama 3.1 8B

Nvidia has released the Llama-3.1-Minitron 4B, a smaller and more efficient version of the Llama-3.1 8B language model, by using pruning and knowledge distillation techniques. This model offers high performance with reduced computational resources and excels in various benchmarks for reasoning, coding, and math. It is optimized for deployment with Nvidia's TensorRT-LLM toolkit, enhancing its inference performance and efficiency, making it a viable option for resource-constrained environments.