首页 > 其他 > 详细

hadoop&spark mapreduce对比 & 框架设计和理解

时间:2015-01-17 02:09:35      阅读:353      评论:0      收藏:0      [点我收藏+]

Hadoop MapReduce:

bubuko.com,布布扣

MapReduce在每次执行的时候都要从磁盘读数据,计算完毕后都要把数据放到磁盘

bubuko.com,布布扣

spark map reduce:

bubuko.com,布布扣

bubuko.com,布布扣

bubuko.com,布布扣

?

?

bubuko.com,布布扣

RDD is everything for dev:

bubuko.com,布布扣

Basic Concepts:

bubuko.com,布布扣

bubuko.com,布布扣

Graph RDD:

bubuko.com,布布扣

Spark Runtime:

bubuko.com,布布扣

schedule:

bubuko.com,布布扣

Depency Type:

bubuko.com,布布扣

Scheduler Optimizations:

bubuko.com,布布扣

Event Flow:

bubuko.com,布布扣

Submit Job:

bubuko.com,布布扣

New Job Instance:

bubuko.com,布布扣

Job In Detail:

bubuko.com,布布扣

executor.launchTask:

bubuko.com,布布扣

Standalone:

bubuko.com,布布扣

?

?

Work Flow:

bubuko.com,布布扣

Standalone detail:

bubuko.com,布布扣

Driver application to Clustor:

bubuko.com,布布扣

Worker Exception:

bubuko.com,布布扣

Executor Exception:

bubuko.com,布布扣

Master Exception:

bubuko.com,布布扣

Master HA:

bubuko.com,布布扣

bubuko.com,布布扣

hadoop&spark mapreduce对比 & 框架设计和理解

原文:http://stark-summer.iteye.com/blog/2176583

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!