Shulou(Shulou.com)06/02 Report--

hadoop

---------------------

Reliable, scalable, distributed computing framework, open source software

four modules

1、common

hadoop0-common

2、hdfs

3、mapreduce

4、yarn

---------------------

Fully distributed:

1、hdfs

NameNode

DataNode

secondaryNode

Startup script: start-all.sh(start-dfs.sh)

2、Yarn

ResourceManager

NodeManager

Startup script: start-all.sh(start-yarn.sh)

3、hadoop-deamons.sh

hdfs.sh

yarn.sh

----------------------------

Modify blocksize, default is 128m

[hdfs-site.xml]

dfs.blocksize=8m

Test put file> 8m. View size via webui

----------------------------------

Configure client to derive static ip

IP network segment required| gateway| sub-gateway

1. View Gateway

vmware VM---> Edit Menu---> VM Network Edit---> Open Window---> Select vmware Virtual NIC-->NAT Settings---> View Gateway ip

2. Check the available IP segments

vmware Virtual Machine---> Edit Menu---> Virtual Machine Network Editor----> Open Window---> Select vmware Virtual NIC--->DHCP Settings---> View Network Segments

Choose an available IP.

4. Configure ubuntu's static ip:

iface eth0 inet static

address eth0 192.168.92.154

netmask 255.255.255.0

gateway 192.168.92.2

dns-nameservers 192.168.92.2

auto eth0

Effective static IP address: sudo /etc/init.d/networking restart

-----------------------------------------------------

client shutdown command

1、sudo poweroff

2、sudo shutdown -h o

----------------------

Configure ubuntu text startup mode

1、sudo nano /etc/default/grub

GRUB_CMDLINE_LINUX_DEFAULI="text" //Change to text mode

GRUB_TERMINAL=console //Open the comment

2. Execution: sudo update-grub

3. Restart sudo reboot

Startx ---> is to bring ubuntu back to the desktop

5、

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.