In this blog we explore how FFmpeg uses Vulkan Compute to seamlessly accelerate encoding and decoding of even professional-grade video on consumer GPUs — unlocking GPU compute parallelism at scale, without specialized hardware. This approach complements Vulkan Video's fixed-function codec support, extending acceleration to formats and workflows it doesn't cover.

The Khronos Group is a consortium of technology companies and industry experts that develops open standards for graphics, compute, and vision processing. Through initiatives like Vulkan, OpenGL, and WebGL, Khronos Group defines cross-platform APIs for accelerating graphics rendering and computational tasks across diverse hardware platforms. Developers can learn about Khronos Group's standards, participate in working groups, and leverage open APIs for building high-performance graphics and compute applications.

Khronos

FFmpeg now uses Vulkan Compute shaders to implement fully GPU-resident video codec acceleration — covering FFv1, ProRes, ProRes RAW, and DPX in the FFmpeg 8.1 release, with VC-2, JPEG, and APV in progress. The post explains why hybrid CPU/GPU approaches historically failed (round-trip latency), how each codec's serial vs. parallel structure is tackled in compute shaders, and why Vulkan's portability and expanding feature set make it preferable to vendor-specific compute APIs. The approach complements Vulkan Video's fixed-function hardware decoders, extending GPU acceleration to professional formats and workflows those ASICs don't cover.

Video Encoding and Decoding with Vulkan Compute Shaders in FFmpeg