Shulou(Shulou.com)05/31 Report--

This article mainly introduces "how to run ElasticSearch on YARN". In daily operation, I believe many people have doubts about how to run ElasticSearch on YARN. The editor consulted all kinds of materials and sorted out simple and easy-to-use operation methods. I hope it will be helpful to answer the doubts of "how to run ElasticSearch on YARN"! Next, please follow the editor to study!

The main purpose of this is to unify resource management (cpu and memory). When the integrated platform, spark,es, mr and so on are all running together, do a good job in resource scheduling.

Before the story begins, download the plug-in.

Plug-in address

The installation mainly refers to the official documentation.

[root@master nq] # hadoop jar elasticsearch-yarn-2.1.0.BUILD-SNAPSHOT.jar No command specifiedUsage:-download-es: Downloads Elasticsearch.zip-install: Installs/Provisions Elasticsearch-YARN into HDFS-install-es: Installs/Provisions Elasticsearch into HDFS-start: Starts provisioned Elasticsearch in YARN-status: Reports status of Elasticsearch in YARN-stop: Stops Elasticsearch in YARN-help : Prints this helpConfiguration options can be specified _ after_ each command See the documentation for more information. [root@master nq] #

The installation process is relatively simple, just go through it according to the order of the documentation, and what may happen is the problem of HDFS permissions.

When you are finished, you can see 2 files under HDFS

Logs and apps can also be seen here on YARN.

Visit OK from ES

[root@master nq] # curl localhost:9200 {"status": 200," name ":" Shadowmage "," cluster_name ":" elasticsearch "," version ": {" number ":" 1.4.0 "," build_hash ":" bc94bd81298f81c656893ab1ddddd30a99356066 "," build_timestamp ":" 2014-11-05T14:26:12Z "," build_snapshot ": false "lucene_version": "4.10.2"}, "tagline": "You Know, for Search"} [root@master nq] #

All right, we're done. As soon as I was about to laugh, I found two serious problems, and then the smile froze.

How to install plug-ins?

Where's the data? Local or hdfs

After a struggle, I came up with two ways.

Package the plug-in into the zip package.

The first step in the installation process, (- download-es), downloads the es to the current dowanloads directory

Go to dowanloads to decompress elasticsearch-1.4.0.zip, and then get plug-ins such as head into it and compress it.

Replace the zip package on HDFS

Stop & start

Use the plugin command to install.

Jps-v | grep elastic./bin/plugin-install mobz/elasticsearch-head

Jps finds the directory where ES is running (- Des.path.home), and then there is no more. Familiar head. At this point, in fact, whether the index file is stored in HDFS is also clear.

At this point, the study on "how to run ElasticSearch on YARN" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.