Best of GPU — February 2025

1. 1
   Article

   Noted·1y

   Self-Host DeepSeek with Ollama and Open WebUI

   DeepSeek R1 is an advanced AI model developed by the Chinese company DeepSeek, released in 2023. It is designed to run efficiently on lower-grade hardware thanks to distilled versions available on Ollama. The post provides instructions for installing DeepSeek R1 using Open WebUI and highlights the model's capabilities in natural language understanding and problem-solving. By sharing its technology openly, DeepSeek aims to drive innovation in AGI systems.

   193

   6
2. 2
   Article

   DEV·1y

   How to Install DeepSeek-R1 32B on Windows: System Requirements, Docker, Ollama, and WebUI Setup

   This guide provides detailed instructions for installing DeepSeek-R1 32B on Windows using three different methods: Docker, Ollama, and WebUI. It includes the system requirements for both minimum and recommended setups, steps for installing each method, and considerations for choosing the best installation method based on user needs and hardware capabilities.

   75
3. 3
   Article

   Community Picks·1y

   allenai/olmocr: Toolkit for linearizing PDFs for LLM datasets/training

   olmOCR, developed by the AllenNLP team at AI2, is a toolkit for training language models to process PDFs. It includes strategies for natural text parsing, evaluation tools, basic filtering, and fine-tuning codes. Installation requires a recent NVIDIA GPU and setting up dependencies. The toolkit supports single and multi-node processing, with the ability to read PDFs from AWS S3 and use beaker for efficient processing.

   12