Posts

Showing posts with the label BDA

To study basic commands of Hadoop

Practical - 3 To study basic commands of Hadoop. Download Practical # 1. Print the Hadoop version hadoop version # 2. List the contents of the root directory in HDFS #hadoop fs -ls / # 3. Report the amount of space used and # available on currently mounted filesystem #hadoop fs -df hdfs:/ # 4. Count the number of directories,files and bytes under # the paths that match the specified file pattern #hadoop fs -count hdfs:/ # 5. Run a DFS filesystem checking utility #hadoop fsck – / # 6. Run a cluster balancing utility #hadoop balancer # 7. Create a new directory named “hadoop” below the # /user/training directory in HDFS. Since you’re # currently logged in with the “training” user ID, # /user/training is your home directory in HDFS. #hadoop fs -mkdir /user/training/hadoop # 8. Add a sample text file from the local directory # named “data” to the new directory you created in HDFS # during the previous step. #hadoop fs -put data/sample.txt /user/training/hadoop # 9...

How To install Hadoop on Windows and Linux

Image
Practical - 2 To Install Hadoop on Windows & Linux. Download Practical Fig.  1 - Extracted Hadoop 2.6.0 folder Configuration: Step –1 Windows Path Configuration Set HADOOP_HOME path in environment variable for windows Right click on my computer > properties > advanced system settings > advance tab > environment variables > click on new Fig.  2 – Creating New User Variable Set hadoop bin directory path Find path variable in system variable > click on edit > at the end insert ‘; (semicolon)’ and paste path up tohadoop bin.  Step –2 Hadoop Configuration Edit  hadoop-2.6.0/etc/hadoop/core-site.xml, paste the following lines and save it. Fig.  3 – Edited core-site.xml Edit  hadoop-2.6.0/etc/hadoop/mapred-site.xml , paste the following lines and save it. Fig.  4 – Edited mapred-site.xml ...