Shulou(Shulou.com)06/01 Report--

Slurm was installed some time ago, and it feels good to use it. Compared with all kinds of complexity of SGE, Slurm is simple and clear, and gives people a fresh feeling of turning complexity into simplicity. Let's first introduce the past lives and present lives of slurm and SGE.

SGE was formerly known as CODINE/GRD. After its acquisition in 2000, Sun changed its name to Sun Gride Engine and opened source in 2001. This is another major contribution of Sun to the open source world. Unfortunately, Sun died too early. Then SGE thrived in the arms of Sun, but unfortunately Sun was acquired by Oracle in 2010. Sun made a great contribution to the industry, and losing Sun is a great loss to the industry. In order to pay homage to Sun, the renamed SGE is still called SGE in this paper.

Oracle treats Sun's legacy like a mercenary stepfather treats his children, selling it, shutting it down, and mysql's tragedy repeats itself in SGE, where Oracle renamed SGE to OGE (Oracle Gride Engine) and canceled open source as a paid project. This is the darkest day for SGE. Many users protested Oracle's practice and switched to other operating systems. SGE lost a lot of users and its prospects were bleak. In order to save the SGE project, the SGE community set up Son of Gride Engine and Open Grid Scheduler projects respectively, and continued to develop open source and independently.

Then a company named Univa announced that it had hired the core members of the original SGE project, and Fritz Ferstl, the founder of the Univa Grid Engine,SGE project on the basis of SGE, served as the company's CTO and continued to lead the Univa Grid Engine project. In October 2013, Univa announced that it had been licensed by Oracle to provide a commercial version of OGE. Open Grid Scheduler, on the other hand, is supported by Oracle to continue to open source, but its technical support services are charged. The Son of Gride Engine project, which fully complies with the GPL agreement, continues to be open source and free, but is suspected because it is not supported by Oracle and lacks the participation of the original SGE core engineers.

In fact, the Open Grid Scheduler source code and the commercial version of OGE are the same, there is no difference, so recognition and acceptance is relatively high.

In the darkest days of SGE, most of the lost users switched to Slurm and Torque,Slurm. Since 2011, the rapid development of Slurm has been greatly improved, and it has been recognized and used by most HPC, including Tianhe No.2. The Slurm project was developed jointly by several companies such as Lawrence Livermore National Laboratory in 2002, and Morris Jette, the leader of the Slurm project, was in charge of the development and management of the project at Lawrence Livermore National Laboratory at that time.

Slurm gives people the impression that it is tailor-made for HPC and does not support windows. It is small, lean and easy to use, with a clear structure and clear at a glance. SGE is large and comprehensive, in addition to various types of Unix and Linux also support Windows, support across multiple domains / multiple network segments, complex and obscure.

The new version of Slurm uses Munge for authentication, which is simple and convenient, and this feature is very suitable for HPC with a large number of nodes, while SGE still uses CA certificate authentication, which is complex and not easy to use. In addition, Slurm is very convenient in defining the list of hosts, which is better than SGE.

Not finished, to be continued.

Related articles:

Details: setup and installation of SGE

Details: setup and installation of slurm

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.