17/03 - Harnessing the power of Spark and Cassandra in your Spri

1 .Harnessing the Power of Spark + Cassandra within your Spring App Steve Pember CTO, ThirdChannel @svpember 

2 .RELATIONAL DATABASES ARE FANTASTIC @spring_io #springio17 

3 .SQL MAKES YOU STRONG 

4 .

5 .

6 .

7 .

8 .@spring_io #springio17 

9 . Agenda • Spark • Cassandra • Spark + Cassandra • Working with Spark + Cassandra • Demo @spring_io #springio17 

10 . Apache Spark • Distributed Execution Engine @spring_io #springio17 

11 .

12 . Apache Spark • Distributed Execution Engine • What about Hadoop? @spring_io #springio17 

13 . Hadoop
 Spark • Map / Reduce • More than Map/ • Storage via HDFS Reduce • Each calculation • No dependent step written to storage disk mechanism • Clustered Calculations, each step in memory @spring_io #springio17 

14 . Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident @spring_io #springio17 

15 .@spring_io #springio17 

16 .@spring_io #springio17 

17 . Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture @spring_io #springio17 

18 .@spring_io #springio17 

19 .Your Spring App @spring_io #springio17 

20 . Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure @spring_io #springio17 

21 .THE SPARKCONTEXT SUBMITS JOBS TO THE CLUSTER @spring_io #springio17 

22 .OPERATIONS ARE PERFORMED AGAINST RDDS @spring_io #springio17 

23 . Resilient Distributed Dataset • Immutable • Partitioned • Parallel operations • Created by performing operations on other RDDs • Reusable & Composable @spring_io #springio17 

24 .@spring_io #springio17 

25 . Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure • APIs @spring_io #springio17 

26 .MORE THAN MAP/REDUCE @spring_io #springio17 

27 . RDD operations • map • reduce • aggregate • filter • flatmap • join • … plus many more @spring_io #springio17 

28 .@spring_io #springio17 

29 . Apache Spark • Distributed Execution Engine • What about Hadoop? • Creation was a Happy Accident • Architecture • Programatic structure • APIs • Additional Modules @spring_io #springio17