Discussion:
Storm elasticsearch Integration Issue
(too old to reply)
praveen puskar
2018-09-21 10:13:03 UTC
Permalink
Hi,

I am using transport client in Apache Storm trident to create a bulk update
request to elastic search. Then i came across "Storm ElasticSearch
integration", while trying out i spent much time resolving compilation
issue.

The official documentation says :

EsConfig esConfig = new EsConfig(clusterName, new String[]{"localhost:9300"});


But going through the git source code and history of EsConfig class. The *class
no more takes cluster-name as an argument*, and was removed in this commit
<https://github.com/apache/storm/commit/2b4565c668c16c366e086214d11f3ec2e1d4769c#diff-18885d882badc5341e2a79a40567f26b>
and committed on Mar 13, 2017

Is there a different group where i should report this issue ?
--
Kind Regards
Praveen Puskar





Please save TREE. Save the Environment. Make a contribution in retarding
Global Warming.

Please do not print this email unless it is absolutely necessary.
praveen puskar
2018-09-21 10:28:28 UTC
Permalink
Forgot to provide link to the official documnetation :
http://storm.apache.org/releases/1.1.2/storm-elasticsearch.html
Post by praveen puskar
Hi,
I am using transport client in Apache Storm trident to create a bulk
update request to elastic search. Then i came across "Storm ElasticSearch
integration", while trying out i spent much time resolving compilation
issue.
EsConfig esConfig = new EsConfig(clusterName, new String[]{"localhost:9300"});
But going through the git source code and history of EsConfig class. The *class
no more takes cluster-name as an argument*, and was removed in this commit
<https://github.com/apache/storm/commit/2b4565c668c16c366e086214d11f3ec2e1d4769c#diff-18885d882badc5341e2a79a40567f26b>
and committed on Mar 13, 2017
Is there a different group where i should report this issue ?
--
Kind Regards
Praveen Puskar
Please save TREE. Save the Environment. Make a contribution in retarding
Global Warming.
Please do not print this email unless it is absolutely necessary.
--
Regards
Praveen Puskar



Please save TREE. Save the Environment. Make a contribution in retarding
Global Warming.

Please do not print this email unless it is absolutely necessary.
Yu Watanabe
2018-09-21 23:05:31 UTC
Permalink
Hello.

From elasticsearch point of view , it makes sense not specifying the
cluster name when configuring the spout. You all need to know is the target
data node when sending bulk requests.

Looks like the official document , even in the latest snapshot, is not
updated.

http://storm.apache.org/releases/2.0.0-SNAPSHOT/storm-elasticsearch.html

EsConfig params
ArgDescriptionType
clusterName Elasticsearch cluster name String (required)
nodes Elasticsearch nodes in a String array, each element should follow
{host}:{port} pattern String array (required)
additionalParameters Additional Elasticsearch Transport Client
configuration parameters Map (optional)
Client maintained by elastic might be a second choice for you.

https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html#storm-cfg-spout

Thanks,
Yu
Post by praveen puskar
http://storm.apache.org/releases/1.1.2/storm-elasticsearch.html
Post by praveen puskar
Hi,
I am using transport client in Apache Storm trident to create a bulk
update request to elastic search. Then i came across "Storm ElasticSearch
integration", while trying out i spent much time resolving compilation
issue.
EsConfig esConfig = new EsConfig(clusterName, new String[]{"localhost:9300"});
But going through the git source code and history of EsConfig class. The *class
no more takes cluster-name as an argument*, and was removed in this commit
<https://github.com/apache/storm/commit/2b4565c668c16c366e086214d11f3ec2e1d4769c#diff-18885d882badc5341e2a79a40567f26b>
and committed on Mar 13, 2017
Is there a different group where i should report this issue ?
--
Kind Regards
Praveen Puskar
Please save TREE. Save the Environment. Make a contribution in retarding
Global Warming.
Please do not print this email unless it is absolutely necessary.
--
Regards
Praveen Puskar
Please save TREE. Save the Environment. Make a contribution in retarding
Global Warming.
Please do not print this email unless it is absolutely necessary.
--
Yu Watanabe
枡蟺 裕

LinkedIn : jp.linkedin.com/in/yuwatanabe1
Loading...