unknown

Refinery 3.0 achieved 70% CPU and 60% memory reduction through strategic optimization of Go code. The key improvement was avoiding full deserialization of trace spans by selectively extracting only needed fields from serialized data, keeping the rest in compact MessagePack format. This eliminated thousands of heap allocations per span and reduced garbage collection overhead from 25% to minimal levels. Additional optimizations included direct binary-to-binary transcoding for OTLP formats, buffer pooling, and metrics instrumentation improvements. The approach demonstrates that significant performance gains are possible without language rewrites by focusing on doing only necessary work.

How We Saved 70% of CPU and 60% of Memory in Refinery’s Go Code, No Rust Required

A supportive squad for Go developers who want to dive deeper into what makes Go special. We focus on the language's clean simplicity, powerful concurrency, and reliable performance.

Go Developers

<p>I think it’s great to optimize something with new techniques an avoid rewrite on rust kkk, today seems like everyone needs to rewrite in rust for gain performance instead of use the brain to bring better solutions</p>


<p>First, I think it’s great that the author found and reported such an optimization. It’s a testament to their deep engineering expertise.
However, if someone is applying patches to the application’s internal code, as in this post, it would be better to submit a PR directly to the tinylib/msgp library.</p>
