Shulou(Shulou.com)06/03 Report--

This article mainly introduces "how to customize the Go compiler". In the daily operation, I believe many people have doubts about how to customize the Go compiler. The editor consulted all kinds of materials and sorted out simple and easy-to-use operation methods. I hope it will be helpful to answer the doubts about "how to customize the Go compiler". Next, please follow the editor to study!

01 Uber's use of Go

Uber has thousands of back-end services implemented using Go that run on millions of CPU cores. Therefore, it is very important for Uber to have a detailed and accurate understanding of CPU bottlenecks. This is not only to reduce service delay, but also to improve the efficiency of computer operation. The scale of Uber requires an in-depth understanding of the impact of code and microstructure.

02 customized Go compiler

In fact, it is a bit inaccurate to customize the Go compiler. Mainly based on the above scale and requirements, although Go has built-in Profiler, this CPU Profiler has serious limitations on Linux-based systems (perhaps in other operating systems, but Uber uses Linux, and other machines do not test and verify), and the built-in Profiler lacks many of the details needed to grasp CPU bottlenecks.

Based on these issues, Uber fork created a github.com/golang/go code and built a custom Go Profiler on it to better meet the needs of Uber and the scale of Uber's business operations.

Specifically, Uber enhances it by integrating rich hardware performance monitoring features into Go's default pprof parser. This provides several key benefits:

Be able to obtain more accurate and accurate Go program analysis files (profiles)

Ability to monitor various CPU events, such as cache loss, NUMA communication, CPU branch error prediction, etc.

Ability to monitor Go programs at a very high sampling frequency (up to 10 microseconds)

So, Uber's custom "Go compiler" is really just an enhancement to Profiler. Note that the use of Profiler does not need to change, that is, the external interfaces, tools used, and analysis remain the same (such as stack properties, call diagrams, flame diagrams, etc.), but more data is added.

The enhanced version of Profiler,Uber is called pprof++, a solution with hardware performance counters.

To specify which CPU events have been added, Uber gives a diagram that exposes some of the most common events.

At this point, the study on "how to customize the Go compiler" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.