Jeff Geerling is a software developer, author, and open-source contributor known for his expertise in infrastructure automation and Drupal development. Readers can learn about DevOps practices, Ansible automation, and web development with Drupal. With blog posts, tutorials, and open-source projects, Jeff Geerling shares  insights and best practices for building and managing web infrastructure.

Jeff Geerling

A stable patch for the `amdgpu` Linux kernel driver now allows AMD RX series GPUs (400 to 7000) to work with Raspberry Pi 5, supporting both Vulkan graphics and compute API. This guide provides steps to install `llama.cpp` with Vulkan support on the Pi 5. While larger models face performance issues due to inefficient memory access translations by the `amdgpu` driver, smaller models perform well. The compact, power-efficient setup only uses about 10-12W when idle, making it an attractive option for local machine learning tasks.

LLMs accelerated with eGPU on a Raspberry Pi 5

Installing llama.cpp with Vulkan support on the Pi 5