Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

How to build stand-alone and Cluster in Alluxio

2025-04-05 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)06/01 Report--

This article mainly shows you "how to build a stand-alone and cluster in Alluxio". The content is simple and clear. I hope it can help you solve your doubts. Let me lead you to study and learn this article "how to build a stand-alone and cluster in Alluxio".

Alluxio installation and deployment

1. Create a directory:

1. Mkdir / data/alluxio

2. Cd / data/alluxio

Download the alluxio-1.2.0-hadoop2.6-bin.tar.gz version and unzip it in the cd / data/alluxio/ directory

3. Tar-zvxf alluxio-1.2.0-hadoop2.6-bin.tar.gz

4. Cd / data/alluxio/alluxio-1.2.0

two。 Initialize, start:

Initialize to local mode:

1.. / bin/alluxio bootstrap-conf localhost

2.. / bin/alluxio format

Start / stop:

3.. / bin/alluxio-start.sh local. / bin/alluxio-start.sh all

4.. / alluxio-stop.sh all

Create a working directory:

5.. / bin/alluxio fs mkdir / data/

6.. / bin/alluxio fs mkdir / data/spark/

Cluster building:

1. Configuration file modification

Under the alluxio/conf directory, copy the alluxio-env.sh.template to alluxio-env.sh. Make sure that JAVA_HOME points to a valid installation path. Set ALLUXIO_MASTER_ADDRESS to the hostname of the machine running Alluxio Master. Add the IP addresses of all worker nodes to the alluxio/conf/workers file.

Alluxio-env.sh add:

Export JAVA_HOME=/home/ys/java/jdk1.7.0_60export ALLUXIO_MASTER_ADDRESS=host01 # host01 as a master node

Add a work node to the workers file

Host01host02

2. Start

Start separately and run on their respective machines

On the master machine:

. / alluxio-start.sh master

. / alluxio-start.sh worker

On the worker machine:

. / alluxio-start.sh worker

3. Verify whether the cluster is built successfully.

Create a file on the master node, which can be seen on the worker node, indicating that the construction is successful.

. / alluxio fs ls /

. / alluxio fs mkdir / data

These are all the contents of the article "how to build a stand-alone and cluster in Alluxio". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report