search menu icon-carat-right cmu-wordmark

Introduction to Scala and Spark

May 2016 Presentation
Brad Rubin (University of St. Thomas)

This presentation describes features of the Scala programming language that make it the first choice for the Apache Spark programming model.

Publisher:

Software Engineering Institute

This presentation was created for a conference series or symposium and does not necessarily reflect the positions and views of the Software Engineering Institute.

Abstract

In this presentation, I will first describe the Scala programming language and its position in the language space. I will then describe the Apache Spark programming model and its role in the Big Data space. Next, I will discuss the Scala features that make it the first choice for Spark programming, briefly commenting on the Python and Java alternatives. I will also cover some basic programming tools helpful for doing Scala-based Spark development. Finally, I will discuss my experience teaching these technologies in a graduate software engineering course.