Shulou(Shulou.com)06/03 Report--

This article introduces the relevant knowledge of "what is the main information revealed by the top 100 libraries". In the operation of actual cases, many people will encounter such a dilemma. Next, let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

Top 10 most popular Java class libraries

Hadoop won the top spot in this year's ranking of Java class libraries, and the second-largest class library last year has finally been corrected this year.

Apache Hadoop is an open source software framework that supports data-intensive distributed applications and is released under the Apache 2.0 license agreement. It supports applications that run on large clusters built by commodity hardware. The core design of Hadoop's framework is: HDFS and MapReduce. HDFS provides storage for huge amounts of data, while MapReduce provides computing for huge amounts of data.

This year's second place is a new star-Apache Camel,Apache Camel is a rule-based routing and mediation engine that provides the implementation of Java objects for enterprise integration patterns and configures routing and mediation rules through application interfaces.

Last year's first fasterXML/Jackson dropped to 10th place this year.

Jackson is a JSON library that can easily transform JSON into the object model of Java and the object model of Java into a string of JSON.

The main information revealed by the top 100 libraries

The decline of JUnit. For us, the biggest surprise this year is the decline of JUnit. Although it wasn't the first place in 2018, we didn't expect it to fall all the way from third to 33rd.

The rise of Apache. As you can see, there are some interesting new names in this year's list, the most striking of which is Apache. Free, open source, and cross-platform software topped the top five, including its Hadoop package, integration framework Camel, Commons compression API, memory-centric distributed database Ignite, and HTTP package.

Enterprise single sign-on. There is a new name in the top 10: Apereo. This package provides an open source project for implementing SSO solutions in the enterprise. As we know, it can be difficult to implement SSO solutions internally, so this open source framework is widely used.

There are more new names on the list. Apereo is not the only new name we have seen this year. A long list of packages has entered our top Java list, such as:

# 13-org.pentaho-provides data management and analysis.

# 16-com.facebook.buck-A system that encourages the creation of small reusable modules on a variety of platforms and languages.

# 21-com.yahoo.vespa-Yahoo's data processing class library.

# 28-org.killbill.billing-an open source billing and payment platform.

# 56-com.baidu.disconf-Baidu's distributed configuration management platform.

There can be no winners without losers, which makes the bags at the bottom of our list as important as the ones at the top. We decided to focus on libraries that fell from 2018 to the bottom of the 2019 list. These include:

# 79-org.glassfish.jersey-for developing RESTful Web services with Java. It provides support for JAX-RS API and acts as a JAX-RS reference implementation, ranking # 65 last year.

# 81-org.jboss.netty-A non-blocking Ithumb O client-server framework for developing Java network applications, such as protocol servers and clients. Asynchronous event-driven network application frameworks and tools for simplifying network programming, ranked # 22 last year.

# 85-org.apache.curator-Apache ZooKeeper's Java library, ranked # 29 last year

# 87-org.assertj.core-Rich type assertion library, ranked # 56 last year

# 88-org.xml.sax-Java SAX parsing, ranked # 71 last year

# 93-com.codahale.metrics-A measurement class library for monitoring indicators, ranked # 42 last year.

# 97-org.joda.time-A standard date and time library, ranked # 44 last year.

# 99-org.apache.kafka-an open source stream processing platform written by Scala and Java. The goal of the project is to provide a unified, high-throughput, low-latency platform for processing real-time data, ranking # 69 last year. Those organizations that contribute a lot

To gain insight into our top-level Java packages, we look at each package one by one, trying to understand what Java developers are building and how to build them. When we browse the list, many vendors / owners appear multiple times to provide a variety of packages for different purposes.

That's why we decided to look at our entire dataset more widely, not only to understand who is the most popular package, but also to understand who is the organization, company, and even individual behind the most frequently used packages.

The top 10 organizations that have contributed more are as follows:

They are apache, springframework, google, jboss, amazonaws, junit, facebook, yahoo, eclipse, pentaho

In addition, among the top 100 class libraries, we found that there are 4 class libraries from 3 Chinese enterprises, they are:

Com.baidu.disconf (distributed configuration Management platform) from Baidu

Weixin.popular.bean from Wechat (Wechat SDK)

From Alibaba's com.alibaba.otter (Alibaba distributed database synchronization system) and com.alibaba.jstorm (Alibaba stream processing framework)

Among them, the highest ranking is Alibaba's otter, ranking 19th.

Analytical method.

Just like last year, we use Google BigQuery and GitHub's API to get the numbers we want. We extracted the top-level repositories and extracted the Java packages used by these repositories.

BigQuery is a fully managed PB-level low-cost enterprise data warehouse specially designed by Google for data analysis requirements. The service allows developers to use Google's architecture to run SQL statements to operate on super-large databases. BigQuery can scan 1 TB of data in seconds and 1 PB of data in minutes.

Of the 30073 Java source files extracted from GitHub, we filtered out Android, Arduino, duplicate and obsolete repos. After getting the source file for each project, we extract the unique import statement to ensure that each project is evaluated only once. The final step is to check the results again to make sure there are no Android, Arduino, deprecated, or standard Java packages, and then export the final number for processing.

This is the end of the content of "what is the main information revealed by the top 100 libraries". Thank you for your reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.