Hadoop installation on windows without cygwin in 10 mints #hadoop #jps


#

Hadoop installation on windows without cygwin in 10 mints Hadoop installation on windows 7 or 8

Download
Before starting make sure you have this two softwares

Extract downloaded tar file

Configuration
Step 1 – Windows path configuration
set HADOOP_HOME path in enviornment variable for windows
Right click on my computer properties advanced system settings advance tab environment variables click on new

Set hadoop bin directory path
Find path variable in system variable click on edit at the end insert ‘; (semicolon)’ and paste path upto hadoop bin directory in my case it’s a

Edit hadoop -2.7.1/etc/hadoop/mapred-site.xml. paste the following lines and save it.

Edit hadoop -2.7.1/etc/hadoop/hdfs-site.xml. paste the following lines and save it, please create data folder somewhere and in my case i have created it in my HADOOP_HOME directory

Edit hadoop -2.7.1/etc/hadoop/yarn-site.xml. paste the following lines and save it.

Step 3 – Start everything

Very Important step

Before starting everything you need to add some [dot].dll and [dot].exe files of windows please download bin folder from my github repository sardetushar_gitrepo_download

bin folder – this contains .dll and .exe file (winutils.exe for hadoop 2.7.1)

Now delete you existing bin folder and replace with new one (downloaded from my repo )

( my github ) etc folder is just given for reference you need to modify your configuration parameters according to your environment path

Open cmd and type ‘ hdfs namenode -format ’ – after execution you will see below logs

Open cmd and point to sbin directory and type ‘ start-all.cmd ’

It will start following process

In next tutorial we will see how to run mapreduce programs in windows using eclipse and this hadoop setup


Leave a Reply

Your email address will not be published. Required fields are marked *