首页 > Web开发 > 详细

Hadoop上传、下载以及word count简单示例

时间:2016-04-09 02:06:44      阅读:259      评论:0      收藏:0      [点我收藏+]

1.启动 start-dfs.sh?

bubuko.com,布布扣
启动start-yarn.sh
bubuko.com,布布扣

2.输入http://hadoop-0000:50070/,查看HDFS

bubuko.com,布布扣

?

3. ?上传一个文件,比如JDK

hadoop fs -put jdk-8u77-linux-x64.tar.gz hdfs://hadoop-0000:9000/

bubuko.com,布布扣

?

4.查看HDFS

bubuko.com,布布扣
5.下载一个文件

hadoop fs -get hdfs://hadoop-0000:9000/jdk-8u77-linux-x64.tar.gz

bubuko.com,布布扣
?

6. 创建两个目录

hadoop fs -mkdir /wordcount
hadoop fs -mkdir /wordcount/input

bubuko.com,布布扣
?bubuko.com,布布扣

7.新建一个文件,输入一些数据,保存
bubuko.com,布布扣

上传

hadoop fs -put wordcount.txt /wordcount/input

bubuko.com,布布扣
?bubuko.com,布布扣
8.测试wordcount

hadoop jar hadoop-mapreduce-examples-2.6.4.jar wordcount /wordcount/input /wordcount/output

bubuko.com,布布扣
?

9.查看输出

hadoop fs -ls /wordcount/output

bubuko.com,布布扣
?bubuko.com,布布扣
?
bubuko.com,布布扣
10.查看结果

hadoop fs -cat /wordcount/output/part-r-00000

bubuko.com,布布扣
?

?

??

?

?

?

?

?

Hadoop上传、下载以及word count简单示例

原文:http://agilestyle.iteye.com/blog/2289530

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!