Best NLP tool for Apache Spark
I wish to build a NLP based application on Apache Spark which is focused on extracting keyphrases from customer reviews and based on that finding the sentiments of each keyphrase. Can anyone help me in deciding the best NLP tool for spark ? I have used NLTK(natural Language Toolkit) in Spark and looking for a better one.
apache-spark nlp bigdata nltk
asked Nov 16 '18 at 11:56
Nagesh Singh ChauhanNagesh Singh Chauhan
16716
add a comment |
I wish to build a NLP based application on Apache Spark which is focused on extracting keyphrases from customer reviews and based on that finding the sentiments of each keyphrase. Can anyone help me in deciding the best NLP tool for spark ? I have used NLTK(natural Language Toolkit) in Spark and looking for a better one.
apache-spark nlp bigdata nltk
asked Nov 16 '18 at 11:56
Nagesh Singh ChauhanNagesh Singh Chauhan
16716
well, for what task of NLP? doc. classification? information extraction? clustering documents?
– David Batista
Nov 16 '18 at 11:58
Creating an ETL which focusses mostly on extracting keywords from paragraphs and getting the sentiments out of it. For example extracting keywords from a customer review and then getting sentiment out of it.
– Nagesh Singh Chauhan
Nov 16 '18 at 12:01
"extracting keywords from a customer review and then getting sentiment out of it", you mean keywords are attributes or characteristics of a product, and then you want to infer the sentiment over each of these attributes, as in, Aspect-based Sentiment Analysis?
– David Batista
Nov 16 '18 at 16:17
exactly,based on the keywords I want to infer sentiments
– Nagesh Singh Chauhan
Nov 17 '18 at 12:48
ok, so first suggestion, why not edit your question accordingly, and being specific about what you want and then that you want do to it at large-scale?
– David Batista
Nov 17 '18 at 13:12
add a comment |
I wish to build a NLP based application on Apache Spark which is focused on extracting keyphrases from customer reviews and based on that finding the sentiments of each keyphrase. Can anyone help me in deciding the best NLP tool for spark ? I have used NLTK(natural Language Toolkit) in Spark and looking for a better one.
apache-spark nlp bigdata nltk
asked Nov 16 '18 at 11:56
Nagesh Singh ChauhanNagesh Singh Chauhan
16716
I wish to build a NLP based application on Apache Spark which is focused on extracting keyphrases from customer reviews and based on that finding the sentiments of each keyphrase. Can anyone help me in deciding the best NLP tool for spark ? I have used NLTK(natural Language Toolkit) in Spark and looking for a better one.
apache-spark nlp bigdata nltk
apache-spark nlp bigdata nltk
asked Nov 16 '18 at 11:56
Nagesh Singh ChauhanNagesh Singh Chauhan
16716
asked Nov 16 '18 at 11:56
Nagesh Singh ChauhanNagesh Singh Chauhan
16716
edited Nov 19 '18 at 4:33
Nagesh Singh Chauhan
asked Nov 16 '18 at 11:56
Nagesh Singh ChauhanNagesh Singh Chauhan
16716
asked Nov 16 '18 at 11:56
Nagesh Singh ChauhanNagesh Singh Chauhan
16716
asked Nov 16 '18 at 11:56
Nagesh Singh ChauhanNagesh Singh Chauhan
16716
16716
well, for what task of NLP? doc. classification? information extraction? clustering documents?
– David Batista
Nov 16 '18 at 11:58
Creating an ETL which focusses mostly on extracting keywords from paragraphs and getting the sentiments out of it. For example extracting keywords from a customer review and then getting sentiment out of it.
– Nagesh Singh Chauhan
Nov 16 '18 at 12:01
"extracting keywords from a customer review and then getting sentiment out of it", you mean keywords are attributes or characteristics of a product, and then you want to infer the sentiment over each of these attributes, as in, Aspect-based Sentiment Analysis?
– David Batista
Nov 16 '18 at 16:17
exactly,based on the keywords I want to infer sentiments
– Nagesh Singh Chauhan
Nov 17 '18 at 12:48
ok, so first suggestion, why not edit your question accordingly, and being specific about what you want and then that you want do to it at large-scale?
– David Batista
Nov 17 '18 at 13:12
add a comment |
well, for what task of NLP? doc. classification? information extraction? clustering documents?
– David Batista
Nov 16 '18 at 11:58
Creating an ETL which focusses mostly on extracting keywords from paragraphs and getting the sentiments out of it. For example extracting keywords from a customer review and then getting sentiment out of it.
– Nagesh Singh Chauhan
Nov 16 '18 at 12:01
"extracting keywords from a customer review and then getting sentiment out of it", you mean keywords are attributes or characteristics of a product, and then you want to infer the sentiment over each of these attributes, as in, Aspect-based Sentiment Analysis?
– David Batista
Nov 16 '18 at 16:17
exactly,based on the keywords I want to infer sentiments
– Nagesh Singh Chauhan
Nov 17 '18 at 12:48
ok, so first suggestion, why not edit your question accordingly, and being specific about what you want and then that you want do to it at large-scale?
– David Batista
Nov 17 '18 at 13:12
well, for what task of NLP? doc. classification? information extraction? clustering documents?
– David Batista
Nov 16 '18 at 11:58
well, for what task of NLP? doc. classification? information extraction? clustering documents?
– David Batista
Nov 16 '18 at 11:58
Creating an ETL which focusses mostly on extracting keywords from paragraphs and getting the sentiments out of it. For example extracting keywords from a customer review and then getting sentiment out of it.
– Nagesh Singh Chauhan
Nov 16 '18 at 12:01
Creating an ETL which focusses mostly on extracting keywords from paragraphs and getting the sentiments out of it. For example extracting keywords from a customer review and then getting sentiment out of it.
– Nagesh Singh Chauhan
Nov 16 '18 at 12:01
"extracting keywords from a customer review and then getting sentiment out of it", you mean keywords are attributes or characteristics of a product, and then you want to infer the sentiment over each of these attributes, as in, Aspect-based Sentiment Analysis?
– David Batista
Nov 16 '18 at 16:17
"extracting keywords from a customer review and then getting sentiment out of it", you mean keywords are attributes or characteristics of a product, and then you want to infer the sentiment over each of these attributes, as in, Aspect-based Sentiment Analysis?
– David Batista
Nov 16 '18 at 16:17
exactly,based on the keywords I want to infer sentiments
– Nagesh Singh Chauhan
Nov 17 '18 at 12:48
exactly,based on the keywords I want to infer sentiments
– Nagesh Singh Chauhan
Nov 17 '18 at 12:48
ok, so first suggestion, why not edit your question accordingly, and being specific about what you want and then that you want do to it at large-scale?
– David Batista
Nov 17 '18 at 13:12
ok, so first suggestion, why not edit your question accordingly, and being specific about what you want and then that you want do to it at large-scale?
– David Batista
Nov 17 '18 at 13:12
add a comment |
1 Answer
1
active
oldest
votes
I would suggest you to try Spark-NLP, and use a combination of the TextMatcher and the Sentiment Detector-
More docs here,
https://nlp.johnsnowlabs.com/components.html
best,
Alberto.
answered Dec 3 '18 at 0:14
AlbertoAndreottiAlbertoAndreotti
1216
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53337427%2fbest-nlp-tool-for-apache-spark%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
I would suggest you to try Spark-NLP, and use a combination of the TextMatcher and the Sentiment Detector-
More docs here,
https://nlp.johnsnowlabs.com/components.html
best,
Alberto.
answered Dec 3 '18 at 0:14
AlbertoAndreottiAlbertoAndreotti
1216
add a comment |
I would suggest you to try Spark-NLP, and use a combination of the TextMatcher and the Sentiment Detector-
More docs here,
https://nlp.johnsnowlabs.com/components.html
best,
Alberto.
answered Dec 3 '18 at 0:14
AlbertoAndreottiAlbertoAndreotti
1216
add a comment |
I would suggest you to try Spark-NLP, and use a combination of the TextMatcher and the Sentiment Detector-
More docs here,
https://nlp.johnsnowlabs.com/components.html
best,
Alberto.
answered Dec 3 '18 at 0:14
AlbertoAndreottiAlbertoAndreotti
1216
I would suggest you to try Spark-NLP, and use a combination of the TextMatcher and the Sentiment Detector-
More docs here,
https://nlp.johnsnowlabs.com/components.html
best,
Alberto.
answered Dec 3 '18 at 0:14
AlbertoAndreottiAlbertoAndreotti
1216
answered Dec 3 '18 at 0:14
AlbertoAndreottiAlbertoAndreotti
1216
answered Dec 3 '18 at 0:14
AlbertoAndreottiAlbertoAndreotti
1216
answered Dec 3 '18 at 0:14
AlbertoAndreottiAlbertoAndreotti
1216
1216
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53337427%2fbest-nlp-tool-for-apache-spark%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
well, for what task of NLP? doc. classification? information extraction? clustering documents?
– David Batista
Nov 16 '18 at 11:58
Creating an ETL which focusses mostly on extracting keywords from paragraphs and getting the sentiments out of it. For example extracting keywords from a customer review and then getting sentiment out of it.
– Nagesh Singh Chauhan
Nov 16 '18 at 12:01
"extracting keywords from a customer review and then getting sentiment out of it", you mean keywords are attributes or characteristics of a product, and then you want to infer the sentiment over each of these attributes, as in, Aspect-based Sentiment Analysis?
– David Batista
Nov 16 '18 at 16:17
exactly,based on the keywords I want to infer sentiments
– Nagesh Singh Chauhan
Nov 17 '18 at 12:48
ok, so first suggestion, why not edit your question accordingly, and being specific about what you want and then that you want do to it at large-scale?
– David Batista
Nov 17 '18 at 13:12