首页 > Web开发 > 详细

【Jstorm-0.9.6.2基本安装】

时间:2016-07-07 02:13:52      阅读:513      评论:0      收藏:0      [点我收藏+]


bubuko.com,布布扣
?

一、下载

[root@hadoop0 bigdata]# ls

apache-flume-1.6.0-bin ? ? ? ? apache-hive-2.0.1-bin.tar.gz ? ?hbase-1.1.5-bin.tar.gz ?jstorm-0.9.6.2.zip ?sqoop-1.4.6 ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? stomr096 ? ? ? ? ? ? ? ? ?tomcat7

apache-flume-1.6.0-bin.tar.gz ?apache-tomcat-7.0.69.zip ? ? ?hbase-1.1.5 ?hive2.0 ? ? ? ? ? ? ? ? kafka ? ? ? ? ? ? ? sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz ?taokeeper-monitor.tar.gz ?zookeeper

?

?

?

二、解压缩

[root@hadoop0 bigdata]# unzip jstorm-0.9.6.2.zip?

Archive: ?jstorm-0.9.6.2.zip

? ?creating: jstorm-0.9.6.2/

? ?creating: jstorm-0.9.6.2/data/

[root@hadoop0 jstorm-0.9.6.2]# ls

bin ?conf ?data ?example ?history.md ?jstorm-client-0.9.6.2.jar ?jstorm-client-extension-0.9.6.2.jar ?jstorm-server-0.9.6.2.jar ?jstorm-ui-0.9.6.2.war ?lib ?LICENSE ?logs ?README.md ?RELEASE

?

?

三、安装

?

1)安装Server

配置$JSTORM_HOME/conf/storm.yaml

[root@hadoop0 conf]# cat storm.yaml

########### These MUST be filled in for a storm configuration

?storm.zookeeper.servers:

? ? ?- "localhost"

?

?storm.zookeeper.root: "/jstorm"

?

# %JSTORM_HOME% is the jstorm home directory

?storm.local.dir: "%JSTORM_HOME%/data"

?

?java.library.path: "/usr/local/lib:/opt/local/lib:/usr/lib"

?

?

?supervisor.slots.ports:

? ? - 6800

? ? - 6801

? ? - 6802

? ? - 6803

?

# Default disable user-define classloader

# If there are jar conflict between jstorm and application,?

# please enable it?

?topology.enable.classloader: false

?

# enable supervisor use cgroup to make resource isolation

# Before enable it, you should make sure:

# ? ? ? 1. Linux version (>= 2.6.18)

# ? ? ? 2. Have installed cgroup (check the file‘s existence:/proc/cgroups)

# ? ? ? 3. You should start your supervisor on root

# You can get more about cgroup:

# ? http://t.cn/8s7nexU

?supervisor.enable.cgroup: false

?

?

### Netty will send multiple messages in one batch ?

### Setting true will improve throughput, but more latency

?storm.messaging.netty.transfer.async.batch: true

?

### if this setting ?is true, it will use disruptor as internal queue, which size is limited

### otherwise, it will use LinkedBlockingDeque as internal queue , which size is unlimited

### generally when this setting is true, the topology will be more stable,

### but when there is a data loop flow, for example A -> B -> C -> A

### and the data flow occur blocking, please set this as false

?topology.buffer.size.limited: true

?

### default worker memory size, unit is byte

?worker.memory.size: 2147483648

?

# Metrics Monitor

# topology.performance.metrics: it is the switch flag for performance?

# purpose. When it is disabled, the data of timer and histogram metrics?

# will not be collected.

# topology.alimonitor.metrics.post: If it is disable, metrics data

# will only be printed to log. If it is enabled, the metrics data will be

# posted to alimonitor besides printing to log.

?topology.performance.metrics: true

?topology.alimonitor.metrics.post: false

?

# UI MultiCluster

# Following is an example of multicluster UI configuration

?ui.clusters:

? ? ?- {

? ? ? ? ?name: "jstorm",

? ? ? ? ?zkRoot: "/jstorm",

? ? ? ? ?zkServers:

? ? ? ? ? ? ?[ "localhost"],

? ? ? ? ?zkPort: 2181,

? ? ? ?}

?

?

配置项:

?

storm.zookeeper.servers: 表示zookeeper 的地址,

nimbus.host: 表示nimbus的地址

storm.zookeeper.root: 表示JStorm在zookeeper中的根目录,当多个JStorm共享一个zookeeper时,需要设置该选项,默认即为“/jstorm”

storm.local.dir: 表示JStorm临时数据存放目录,需要保证JStorm程序对该目录有写权限

java.library.path: Zeromq 和java zeromq library的安装目录,默认"/usr/local/lib:/opt/local/lib:/usr/lib"

supervisor.slots.ports: 表示Supervisor 提供的端口Slot列表,注意不要和其他端口发生冲突,默认是68xx,而Storm的是67xx

topology.enable.classloader: false, 默认关闭classloader,如果应用的jar与JStorm的依赖的jar发生冲突,比如应用使用thrift9,但jstorm使用thrift7时,就需要打开classloader。建议在集群级别上默认关闭,在具体需要隔离的topology上打开这个选项。

?

2)安装UI

mv jstorm-0.9.6.2/jstorm-ui-0.9.6.2.war ?tomcat7/webapps/

?

四、启动

[root@hadoop0 bigdata]# cd zookeeper/

[root@hadoop0 zookeeper]# ls

bin ? ? ? ? ?dist-maven ? ? ? LICENSE.txt ? ? ? ? ? src

build.xml ? ?docs ? ? ? ? ? ? NOTICE.txt ? ? ? ? ? ?zookeeper-3.4.6.jar

CHANGES.txt ?ivysettings.xml ?README_packaging.txt ?zookeeper-3.4.6.jar.asc

conf ? ? ? ? ivy.xml ? ? ? ? ?README.txt ? ? ? ? ? ?zookeeper-3.4.6.jar.md5

contrib ? ? ?lib ? ? ? ? ? ? ?recipes ? ? ? ? ? ? ? zookeeper-3.4.6.jar.sha1

[root@hadoop0 zookeeper]# cd bin/

[root@hadoop0 bin]# ./zkServer.sh ?start

JMX enabled by default

Using config: /opt/bigdata/zookeeper/bin/../conf/zoo.cfg

Starting zookeeper ... STARTED

[root@hadoop0 bin]# cd ../../jstorm-0.9.6.2/bin/

[root@hadoop0 bin]# ./jstorm nimbus &

[1] 22494

[root@hadoop0 bin]# ./jstorm supervisor ?&

[2] 32600

[root@hadoop0 bin]# ./startup.sh?

Using CATALINA_BASE: ? /opt/bigdata/tomcat7

Using CATALINA_HOME: ? /opt/bigdata/tomcat7

Using CATALINA_TMPDIR: /opt/bigdata/tomcat7/temp

Using JRE_HOME: ? ? ? ?/opt/jdk1.7.0_79

Using CLASSPATH: ? ? ? /opt/bigdata/tomcat7/bin/bootstrap.jar:/opt/bigdata/tomcat7/bin/tomcat-juli.jar

Tomcat started.

[root@hadoop0 bin]#?

?

?

?

五、验证

进程


bubuko.com,布布扣
?

WEBUI刚启动


bubuko.com,布布扣
?

?

服务启动


bubuko.com,布布扣

【Jstorm-0.9.6.2基本安装】

原文:http://gaojingsong.iteye.com/blog/2308837

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!