Meta released OpenZL, an open source lossless compression framework for structured data that achieves format-specific compression performance while maintaining a single universal decompressor. The framework applies configurable transformation sequences based on data structure descriptions, uses an offline trainer to optimize

12m read timeFrom engineering.fb.com
Post cover image
Table of contents
A Decade of LessonsMake the Structure ExplicitAn Example Compression Using OpenZLGenerate a Compressor AutomaticallyEmbracing Changes: Re-Training and In-Flight ControlThe Advantages of the Universal DecoderResults With OpenZLGetting Started With OpenZLWhere We’re Going

Sort: