Shulou(Shulou.com)06/03 Report--

The application fields of Hadoop in Baidu mainly include: big data mining and analysis, log analysis platform, data warehouse system, user behavior analysis system, advertising platform and other storage and computing services. At present, Baidu's Hadoop cluster scale has exceeded dozens, the number of single cluster nodes exceeds 5000, and the amount of data processed per day exceeds 8000TB. At the same time, Baidu has also developed its own log analysis platform, data warehouse system, and unified C++ programming interface on the basis of Hadoop, and has deeply transformed Hadoop and developed HCE (Hadoop C++ Extend System) system with stronger performance.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.