PDF slides: Spark (based on slides by Matei Zaharia & Xiangrui Meng & Reynold Xin)

[an error occurred while processing this directive]

Practicum Instructions: Google Doc

For technical background material, there are four papers,

• Spark: Cluster Computing with Working Sets
• Apache Spark: A Unified Engine for Big Data Processing
• Clash of the Titans: MapReduce vs. Spark for Large Scale Data Analytics
• Pregel: A System for Large-Scale Graph Processing
• MLI: An API for Distributed Machine Learning
• Matrix Factorization Techniques for Recommender Systems

• Big Data Processing with Apache Spark
• Introducing Dataframes
• How to install Spark and Jupyter Notebook on a local machine