大数据分析，谁用过spark架构的，欢迎讨论。

是 否 +2 论坛币

k人 参与回答

经管之家送您一份

应届毕业生专属福利!

求职就业群

赵安豆老师微信：zhaoandou666

经管之家联合CDA

送您一个全额奖学金名额~ !

立即领取

感谢您参与论坛问题回答

经管之家送您两个论坛币！

+2 论坛币

spark是基于内存的mapreduce，其响应速度高于Hadoop很多，那么，它是否适合用作实时分析架构呢？

扫码加我 拉你入群

请注明：姓名-公司-职位

以便审核进群资格，未注明则拒绝

分享0 收藏0 回帖

关键词：大数据分析 Spark 数据分析 SPAR Park

Spark streaming uses micro-batching to achieve near real-time processing. If latency must be under 1 sec, you should consider Storm Core. There are many factors you should consider, e.g. latency, data processing requirement (machine learning, SQL access, graph processing etc.), YARN support, other language compatibility and maturity. The following links may help.

http://statrgy.com/2015/05/14/storm-vs-spark/
http://realtime-cachedmind.tumblr.com/post/89974796387/real-time-processing-storm-trident-vs
http://ingest.tips/2015/06/24/real-time-analytics-with-kafka-and-spark-streaming/