[Ankit Jain]Mastering Apache Storm

相似文件 换一批

是 否 +2 论坛币

k人 参与回答

经管之家送您一份

应届毕业生专属福利!

求职就业群

赵安豆老师微信：zhaoandou666

经管之家联合CDA

送您一个全额奖学金名额~ !

立即领取

感谢您参与论坛问题回答

经管之家送您两个论坛币！

+2 论坛币

本帖隐藏的内容

Mastering Apache Storm 2017.pdf (6.7 MB, 需要: 10 个论坛币)

2017-8-21 22:35:15 上传

需要: 10 个论坛币  [购买]

1. Mastering Apache Storm
   
2. By 作者: Ankit Jain
   
3. 
   
4. ISBN-10 书号: 1787125637
   
5. ISBN-13 书号: 9781787125636
   
6. Release 出版日期: 2017-09-11
   
7. pages 页数: (315)
   
8. List Price: $49.99
   
9. 
   
10. 
    
11. Book Description
    
12. 
    
13. Key Features
    
14. Exploit the various real-time processing functionalities offered by Apache Storm such as parallelism, data partitioning, and more
    
15. Integrate Storm with other Big Data technologies like Hadoop, HBase, and Apache Kafka
    
16. An easy-to-understand guide to effortlessly create distributed applications with Storm
    
17. 
    
18. Book Description
    
19. Apache Storm is a real-time Big Data processing framework that processes large amounts of data reliably, guaranteeing that every message will be processed. Storm allows you to scale your data as it grows, making it an excellent platform to solve your big data problems. This extensive guide will help you understand right from the basics to the advanced topics of Storm.
    
20. 
    
21. The book begins with a detailed introduction to real-time processing and where Storm fits in to solve these problems. You’ll get an understanding of deploying Storm on clusters by writing a basic Storm Hello World example. Next we’ll introduce you to Trident and you’ll get a clear understanding of how you can develop and deploy a trident topology. We cover topics such as monitoring, Storm Parallelism, scheduler and log processing, in a very easy to understand manner. You will also learn how to integrate Storm with other well-known Big Data technologies such as HBase, Redis, Kafka, and Hadoop to realize the full potential of Storm.
    
22. 
    
23. With real-world examples and clear explanations, this book will ensure you will have a thorough mastery of Apache Storm. You will be able to use this knowledge to develop efficient, distributed real-time applications to cater to your business needs.
    
24. 
    
25. What you will learn
    
26. Understand the core concepts of Apache Storm and real-time processing
    
27. Follow the steps to deploy multiple nodes of Storm Cluster
    
28. Create Trident topologies to support various message-processing semantics
    
29. Make your cluster sharing effective using Storm scheduling
    
30. Integrate Apache Storm with other Big Data technologies such as Hadoop, HBase, Kafka, and more
    
31. Monitor the health of your Storm cluster
    
32. Contents
    
33. Chapter 1. Real-Time Processing And Storm Introduction
    
34. Chapter 2. Storm Deployment, Topology Development, And Topology Options
    
35. Chapter 3. Storm Parallelism And Data Partitioning
    
36. Chapter 4. Trident Introduction
    
37. Chapter 5. Trident Topology And Uses
    
38. Chapter 6. Storm Scheduler
    
39. Chapter 7. Monitoring Of Storm Cluster
    
40. Chapter 8. Integration Of Storm And Kafka
    
41. Chapter 9. Storm And Hadoop Integration
    
42. Chapter 10. Storm Integration With Redis, Elasticsearch, And Hbase
    
43. Chapter 11. Apache Log Processing With Storm
    
44. Chapter 12. Twitter Tweet Collection And Machine Learning

复制代码

扫码加我 拉你入群

请注明：姓名-公司-职位

以便审核进群资格，未注明则拒绝

分享0 收藏15 回帖

关键词：Mastering apache Master Storm Aster

1. package com.stormadvance.storm_example;
   
2. 
   
3. import org.apache.storm.topology.BasicOutputCollector;
   
4. import org.apache.storm.topology.OutputFieldsDeclarer;
   
5. import org.apache.storm.topology.base.BaseBasicBolt;
   
6. import org.apache.storm.tuple.Tuple;
   
7. 
   
8. public class SampleBolt extends BaseBasicBolt {
   
9.         private static final long serialVersionUID = 1L;
   
10. 
    
11.         public void execute(Tuple input, BasicOutputCollector collector) {
    
12.                 // fetched the field "site" from input tuple.
    
13.                 String test = input.getStringByField("site");
    
14.                 // print the value of field "site" on console.
    
15.                 System.out.println("######### Name of input site is : " + test);
    
16.         }
    
17. 
    
18.         public void declareOutputFields(OutputFieldsDeclarer declarer) {
    
19.         }
    
20. }

复制代码

1. package com.stormadvance.storm_example;
   
2. 
   
3. import java.util.HashMap;
   
4. import java.util.Map;
   
5. import java.util.Random;
   
6. 
   
7. import org.apache.storm.spout.SpoutOutputCollector;
   
8. import org.apache.storm.task.TopologyContext;
   
9. import org.apache.storm.topology.OutputFieldsDeclarer;
   
10. import org.apache.storm.topology.base.BaseRichSpout;
    
11. import org.apache.storm.tuple.Fields;
    
12. import org.apache.storm.tuple.Values;
    
13. 
    
14. public class SampleSpout extends BaseRichSpout {
    
15.         private static final long serialVersionUID = 1L;
    
16. 
    
17.         private static final Map<Integer, String> map = new HashMap<Integer, String>();
    
18.         static {
    
19.                 map.put(0, "google");
    
20.                 map.put(1, "facebook");
    
21.                 map.put(2, "twitter");
    
22.                 map.put(3, "youtube");
    
23.                 map.put(4, "linkedin");
    
24.         }
    
25.         private SpoutOutputCollector spoutOutputCollector;
    
26. 
    
27.         public void open(Map conf, TopologyContext context,
    
28.                         SpoutOutputCollector spoutOutputCollector) {
    
29.                 // Open the spout
    
30.                 this.spoutOutputCollector = spoutOutputCollector;
    
31.         }
    
32. 
    
33.         public void nextTuple() {
    
34.                 // Storm cluster repeatedly calls this method to emita continuous
    
35.                 // stream of tuples.
    
36.                 final Random rand = new Random();
    
37.                 // generate the random number from 0 to 4.
    
38.                 int randomNumber = rand.nextInt(5);
    
39.                 spoutOutputCollector.emit(new Values(map.get(randomNumber)));
    
40.                 try{
    
41.                 Thread.sleep(5000);
    
42.                 }catch(Exception e) {
    
43.                         System.out.println("Failed to sleep the thread");
    
44.                 }
    
45.         }
    
46. 
    
47.         public void declareOutputFields(OutputFieldsDeclarer declarer) {
    
48. 
    
49.                 // emit the tuple with field "site"
    
50.                 declarer.declare(new Fields("site"));
    
51.         }
    
52. }

复制代码

1. package com.stormadvance.storm_example;
   
2. 
   
3. import org.apache.storm.Config;
   
4. import org.apache.storm.StormSubmitter;
   
5. import org.apache.storm.generated.AlreadyAliveException;
   
6. import org.apache.storm.generated.AuthorizationException;
   
7. import org.apache.storm.generated.InvalidTopologyException;
   
8. import org.apache.storm.topology.TopologyBuilder;
   
9. 
   
10. public class SampleStormClusterTopology {
    
11.         public static void main(String[] args) throws AlreadyAliveException,
    
12.                         InvalidTopologyException {
    
13.                 // create an instance of TopologyBuilder class
    
14.                 TopologyBuilder builder = new TopologyBuilder();
    
15.                 // set the spout class
    
16.                 builder.setSpout("SampleSpout", new SampleSpout(), 2);
    
17.                 // set the bolt class
    
18.                 builder.setBolt("SampleBolt", new SampleBolt(), 4).shuffleGrouping(
    
19.                                 "SampleSpout");
    
20.                 Config conf = new Config();
    
21.                 conf.setNumWorkers(3);
    
22.                 // This statement submit the topology on remote
    
23.                 // args[0] = name of topology
    
24.                 try {
    
25.                         StormSubmitter.submitTopology(args[0], conf,
    
26.                                         builder.createTopology());
    
27.                 } catch (AlreadyAliveException alreadyAliveException) {
    
28.                         System.out.println(alreadyAliveException);
    
29.                 } catch (InvalidTopologyException invalidTopologyException) {
    
30.                         System.out.println(invalidTopologyException);
    
31.                 } catch (AuthorizationException e) {
    
32.                         // TODO Auto-generated catch block
    
33.                         e.printStackTrace();
    
34.                 }
    
35.         }
    
36. 
    
37. }

复制代码

1. package com.stormadvance.storm_example;
   
2. 
   
3. import org.apache.storm.Config;
   
4. import org.apache.storm.LocalCluster;
   
5. import org.apache.storm.generated.AlreadyAliveException;
   
6. import org.apache.storm.generated.InvalidTopologyException;
   
7. import org.apache.storm.topology.TopologyBuilder;
   
8. 
   
9. public class SampleStormTopology {
   
10.         public static void main(String[] args) throws AlreadyAliveException,
    
11.                         InvalidTopologyException {
    
12.                 // create an instance of TopologyBuilder class
    
13.                 TopologyBuilder builder = new TopologyBuilder();
    
14.                 // set the spout class
    
15.                 builder.setSpout("SampleSpout", new SampleSpout(), 2);
    
16.                 // set the bolt class
    
17.                 builder.setBolt("SampleBolt", new SampleBolt(), 4).shuffleGrouping(
    
18.                                 "SampleSpout");
    
19.                 Config conf = new Config();
    
20.                 conf.setDebug(true);
    
21.                 // create an instance of LocalCluster class for
    
22.                 // executing topology in local mode.
    
23.                 LocalCluster cluster = new LocalCluster();
    
24.                 // SampleStormTopology is the name of submitted topology
    
25.                 cluster.submitTopology("SampleStormTopology", conf,
    
26.                                 builder.createTopology());
    
27.                 try {
    
28.                         Thread.sleep(100000);
    
29.                 } catch (Exception exception) {
    
30.                         System.out.println("Thread interrupted exception : " + exception);
    
31.                 }
    
32.                 // kill the SampleStormTopology
    
33.                 cluster.killTopology("SampleStormTopology");
    
34.                 // shutdown the storm test cluster
    
35.                 cluster.shutdown();
    
36.         }
    
37. }

复制代码

package com.stormadvance.storm_example;

import org.apache.storm.Config;
import org.apache.storm.StormSubmitter;
import org.apache.storm.generated.AlreadyAliveException;
import org.apache.storm.generated.AuthorizationException;
import org.apache.storm.generated.InvalidTopologyException;
import org.apache.storm.topology.TopologyBuilder;

public class SampleStormClusterTopology {
        public static void main(String[] args) throws AlreadyAliveException,
                        InvalidTopologyException {
                // create an instance of TopologyBuilder class
                TopologyBuilder builder = new TopologyBuilder();
                // set the spout class
                builder.setSpout("SampleSpout", new SampleSpout(), 2);
                // set the bolt class
                builder.setBolt("SampleBolt", new SampleBolt(), 4).shuffleGrouping(
                                "SampleSpout");
                Config conf = new Config();
                conf.setNumWorkers(3);
                // This statement submit the topology on remote
                // args[0] = name of topology
                try {
                        StormSubmitter.submitTopology(args[0], conf,
                                        builder.createTopology());
                } catch (AlreadyAliveException alreadyAliveException) {
                        System.out.println(alreadyAliveException);
                } catch (InvalidTopologyException invalidTopologyException) {
                        System.out.println(invalidTopologyException);
                } catch (AuthorizationException e) {
                        // TODO Auto-generated catch block
                        e.printStackTrace();
                }
        }

}

看看      

不知是啥子，看看