首页 > 其他 > 详细

2.1.4、SparkEnv中创建BroadcastManager

时间:2019-03-30 00:51:38      阅读:191      评论:0      收藏:0      [点我收藏+]

在SparkEnv中创建BroadcastManager, 

// 此处只是声明, 只有调用initialize, 才会生效
val broadcastManager = new BroadcastManager(isDriver, conf, securityManager)

 

initialize()

  // Called by SparkContext or Executor before using Broadcast
  private def initialize() {
    synchronized {
      if (!initialized) {
        broadcastFactory = new TorrentBroadcastFactory
        broadcastFactory.initialize(isDriver, conf, securityManager)
        initialized = true
      }
    }
  }

 

2.1.4、SparkEnv中创建BroadcastManager

原文:https://www.cnblogs.com/chengbao/p/10624951.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!