【GitHub】Spark Scala Learning Note

是 否 +2 论坛币

k人 参与回答

经管之家送您一份

应届毕业生专属福利!

求职就业群

赵安豆老师微信：zhaoandou666

经管之家联合CDA

送您一个全额奖学金名额~ !

立即领取

感谢您参与论坛问题回答

经管之家送您两个论坛币！

+2 论坛币

1. Introduction
   
2. 1. Develope Envirinment Setup
   
3. 2. Scala Basic
   
4. 2.1. For And Yield
   
5. 2.2. Functions
   
6. 2.3. Class and Case Class
   
7. 2.3.1. Basic Class and Constructor
   
8. 2.3.2. Abstract Class
   
9. 2.3.3. Case Class
   
10. 2.4. Object, Compaion Object
    
11. 2.5. Traits
    
12. 2.6. Pattern Matching
    
13. 2.6.1. Matching on Value
    
14. 2.6.2. Matching on Type
    
15. 2.6.3. Matching on Class Members
    
16. 2.7. Exception
    
17. 2.8. Data Structure
    
18. 2.8.1. Option
    
19. 2.8.2. Map
    
20. 2.8.3. Tuple
    
21. 2.9. Functional Combinator
    
22. 2.9.1. map
    
23. 3. Design Pattern
    
24. 3.1. Factory
    
25. 3.2. Singleton
    
26. 3.3. Adaptor
    
27. 3.4. Decorate
    
28. 4. Loading Data from Spark Client to Cluster
    
29. 4.1. Data From S3
    
30. 4.2. Reading CSV
    
31. 4.3. Using Parquet
    
32. 4.4. Loading More Than 22 Features into a Class
    
33. 4.5. Caching
    
34. 5. Algorithm
    
35. 5.1. Linear Regression
    
36. 5.1.1. Creating LabeledPoint
    
37. 5.1.2. Preparing the Training and Test Data
    
38. 5.1.3. Scaling the Features
    
39. 5.1.4. Training the Model
    
40. 5.1.5. Predicting Against Test Data
    
41. 6. Appendix
    
42. 6.1. Language Questions
    
43. 6.1.1. Differences between val, var and def
    
44. 6.1.2. Differences between trait and abstract class
    
45. 6.1.3. Differences between an ```object``` and a ```class```.
    
46. 6.1.4. Companion Object
    
47. 6.1.5. Difference between the following terms and types in Scala: Nil, Null, None, Nothing
    
48. 6.1.6. Difference between Call by Name and Call by Value
    
49. 6.1.7. Option monad
    
50. 6.2. Functional Programming Questions
    
51. 6.3. Reactive Programming Questions
    
52. 6.4. Coding Questions
    
53. Published with GitBook

复制代码

本帖隐藏的内容

• Spark Scala Learning Note.pdf (877.39 KB)
  2017-2-21 07:35:06 上传
• https://www.gitbook.com/book/jiaminglin/spark-scala-learning-note/details
  

扫码加我 拉你入群

请注明：姓名-公司-职位

以便审核进群资格，未注明则拒绝

分享0 收藏0 回帖

关键词：Learning earning GitHub SCALA Spark Object Design

1. For And Yield
   
2. object ForAndYield extends App{
   
3.   val vec1 = for(i <- 1 to 5) yield i
   
4.   println("Vector 1: "+vec1)
   
5. 
   
6.   val vec2 = for(i <- 1 to 5) yield i*i
   
7.   println("Vector 2: "+vec2)
   
8. 
   
9.   val a = Vector(1,2,3,4,5)
   
10.   val vec3 = for(e <- a) yield e
    
11.   println("Vector 3: "+vec3)
    
12. 
    
13.   val vec4 = for(e <- a; if e>2) yield e
    
14.   println("Vector 4: "+vec4)
    
15. 
    
16. }

复制代码

1. Functions
   
2. def addOne(num: Int ): Int = num + 1
   
3. 
   
4. 
   
5. Usage
   
6. val add = addOne(2)
   
7. println(add)
   
8. 
   
9. 
   
10. Output
    
11. 3
    
12. 
    
13. 
    
14. Multiple expressions
    
15. def timesTwo(i: Int): Int = {
    
16.   println("hello world")
    
17.   i * 2
    
18. }
    
19. 
    
20. 
    
21. Partial Application
    
22. def add(m: Integer, n: Integer) = m + n
    
23. 
    
24. val add2 = add(2, _:Int)
    
25. 
    
26. 
    
27. Usage
    
28. add2(3)
    
29. 
    
30. 
    
31. Output
    
32. 5 //2+3
    
33. 
    
34. 
    
35. Variable Length Argument
    
36. def captializeAll(args: String*){
    
37.     args.map{ arg =>
    
38.         arg.capitalize
    
39.     }
    
40. }
    
41. 
    
42. 
    
43. Usage
    
44. captializeAll("robin", "Jiaming", "lin")
    
45. 
    
46. 
    
47. Output
    
48. ArrayBuffer(Robin, Jiaming, Lin)

复制代码

看看！

ding!!!!!!!!!!!