Discussion:
Storm UI Internal Server Error for remote cluster
Chun Yuen Lim
2015-05-03 22:19:41 UTC
Permalink
I'm following
http://jayatiatblogs.blogspot.com/2011/11/storm-installation.html .
I try to configuring Apache Storm remote cluster in Amazon Web Services and
I face the error below in my Storm UI:

org.apache.thrift7.transport.TTransportException:
java.net.ConnectException: Connection refused
at org.apache.thrift7.transport.TSocket.open(TSocket.java:183)
at
org.apache.thrift7.transport.TFramedTransport.open(TFramedTransport.java:81)
at backtype.storm.thrift$nimbus_client_and_conn.invoke(thrift.clj:75)
at backtype.storm.ui.core$cluster_configuration.invoke(core.clj:472)
at backtype.storm.ui.core$fn__8260.invoke(core.clj:844)

This is my storm.yaml file for my master node at 10.0.0.230:

########### These MUST be filled in for a storm configuration
storm.zookeeper.servers:
- "10.0.0.230"
# - "localhost"
#
storm.zookeeper.port: 2181

nimbus.host: "127.0.0.1"
nimbus.thrift.port: 6627
# nimbus.task.launch.secs: 240

# supervisor.worker.start.timeout.secs: 240
# supervisor.worker.timeout.secs: 240

ui.port: 8772

storm.local.dir: "/home/ubuntu/storm/data"

java.library.path: "/usr/lib/jvm/java-7-oracle"

# supervisor.slots.ports:
# - 6700
# - 6701
# - 6702
# - 6703
# - 6704

# worker.childopts: "-Xmx768m"
# nimbus.childopts: "-Xmx512m"
# supervisor.childopts: "-Xmx256m"

Below is my storm.yaml file for slave node at 10.0.0.79:

########### These MUST be filled in for a storm configuration
storm.zookeeper.server:
- "10.0.0.230"
# - "localhost"
storm.zookeeper.port: 2181

# nimbus.host: "localhost"
nimbus.host: "10.0.0.230"
nimbus.thrift.port: 6627
#
#ui.port: 8772
#
storm.local.dir: "/home/ubuntu/storm/data"
java.library.path: "/usr/lib/jvm/java-7-oracle"

supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703
# - 6704
#
# worker.childopts: "-Xmx768m"
# nimbus.childopts: "-Xmx512m"
# supervisor.childopts: "-Xmx256m"

Below is my zoo.cfg file for master node:

tickTime=2000
initLimit=10
syncLimit=5
dataDir=/home/ubuntu/zookeeper-data
dataLogDir=/home/ubuntu/zookeeper/log/data_log
clientPort=2181
server.1=10.0.0.230:2888:3888
autopurge.snapRetainCount=3
autopurge.purgeInterval=24

I had use zkServer.sh start, storm nimbus & storm ui in master node; storm
supervisor in slave node. The myid for master node is 1 & the myid for
slave node is 2.

What is the cause of error? how to solve it?
Harsha
2015-05-03 23:48:56 UTC
Permalink
hi, you nimbus.host is listening on localhost nimbus.host: "127.0.0.1" .
Storm UI makes calls to nimbus to get storm cluster and topology info.
Make sure your nimbus and nimbus thrift port is reachable from storm ui
host. -Harsha
Post by Chun Yuen Lim
I'm following
http://jayatiatblogs.blogspot.com/2011/11/storm-installation.html . I
try to configuring Apache Storm remote cluster in Amazon Web Services
java.net.ConnectException: Connection refused at
org.apache.thrift7.transport.TSocket.open(TSocket.java:183) at
org.apache.thrift7.transport.TFramedTransport.open(TFramedTransport.java:81)
at backtype.storm.thrift$nimbus_client_and_conn.invoke(thrift.clj:75)
at backtype.storm.ui.core$cluster_configuration.invoke(core.clj:472)
at backtype.storm.ui.core$fn__8260.invoke(core.clj:844)
########### These MUST be filled in for a storm configuration
storm.zookeeper.servers: - "10.0.0.230" # - "localhost" #
storm.zookeeper.port: 2181
nimbus.host: "127.0.0.1" nimbus.thrift.port: 6627 #
nimbus.task.launch.secs: 240
# supervisor.worker.start.timeout.secs: 240 #
supervisor.worker.timeout.secs: 240
ui.port: 8772
storm.local.dir: "/home/ubuntu/storm/data"
java.library.path: "/usr/lib/jvm/java-7-oracle"
# supervisor.slots.ports: # - 6700 # - 6701 # - 6702 # - 6703 # - 6704
# worker.childopts: "-Xmx768m" # nimbus.childopts: "-Xmx512m" #
supervisor.childopts: "-Xmx256m"
########### These MUST be filled in for a storm configuration
storm.zookeeper.server: - "10.0.0.230" # - "localhost"
storm.zookeeper.port: 2181
# nimbus.host: "localhost" nimbus.host: "10.0.0.230"
"/usr/lib/jvm/java-7-oracle"
supervisor.slots.ports: - 6700 - 6701 - 6702 - 6703 # - 6704 # #
worker.childopts: "-Xmx768m" # nimbus.childopts: "-Xmx512m" #
supervisor.childopts: "-Xmx256m"
tickTime=2000 initLimit=10 syncLimit=5
dataDir=/home/ubuntu/zookeeper-data
dataLogDir=/home/ubuntu/zookeeper/log/data_log clientPort=2181
server.1=10.0.0.230:2888:3888 autopurge.snapRetainCount=3
autopurge.purgeInterval=24
I had use zkServer.sh start, storm nimbus & storm ui in master node;
storm supervisor in slave node. The myid for master node is 1 & the
myid for slave node is 2.
What is the cause of error? how to solve it?
Chun Yuen Lim
2015-05-04 06:34:48 UTC
Permalink
My zookeeper is reside in the same node with nimbus, so I just use
127.0.0.1. However, I solve the issue already, I don't know why, but the
problem solved when I delete the
dataLogDir=/home/ubuntu/*zookeeper/log/data_log
*in my zoo.cfg

Loading...