Spark Python Notebooks This is a collection of IPython notebook / Jupyter notebooks intended to train the reader on different Apache Spark concepts, from basic to advanced, by using the Python language. If Python is not your language, and it is R, you may want to have a look at our R on Apache Spark (SparkR) notebooks instead. Additionally, if your are interested in being introduced to some basic Data Science Engineering, you might find these series of tutorials interesting. There we explain different concepts and applications using Python and R. Instructions A good way of using these notebooks is by first cloning the repo, and then starting your own IPython notebook / Jupyter in pySpark mode . For example, if we have a standalone Spark installation running in our localhost with a maximum of 6Gb per node assigned to IPython: MASTER="spark://127.0.0.1:7077" SPARK_EXECUTOR_MEMORY="...