Saturday, 30 September 2017

[Hadoop] Install Hadoop as Standalone in CentOS 7

1. Install RSync

#> yum -y install rsync




2. Download Hadoop

http://hadoop.apache.org/releases.html

#> cd /usr/local
#> wget http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.8.1/hadoop-2.8.1.tar.gz



3. Unzip Hadoop file

#> tar zxf hadoop-2.8.1.tar.gz




4. Setup environment variables

#> cd /usr/local/hadoop-2.8.1/etc/hadoop
#> vi hadoop-env.sh
#> vi ~/.bash_profile








5. Configure core-site.xml file

#> cd /usr/local/hadoop-2.8.1/etc/hadoop
#> vi core-site.xml




6. Configure hdfs-site.xml

#> cd /usr/local/hadoop-2.8.1/etc/hadoop
#> vi hdfs-site.xml







7. Create SSH key

#> ssh-keygen -t rsa
#> cp ~/.ssh/id_rsa.pub ~/.ssh/authorized_keys





8. Test SSH

#> ssh localhost




9. Format NameNode

#> hadoop namenode -format






10. Startup Hadoop

#> start-all.sh





11. Connect on Web browser

http://hadoophost:50070

No comments:

Post a Comment