datafellas/spark-notebook-demo repository overview

⁠Description

This image provided by the Data Fellas (http://data-fellas.guru) company provides several facilities for you to start using the Spark Notebook⁠ in complex environments including

• Apache Spark
• Apache Cassandra
• Apache Kafka.

They are organized in demos, the Data Fellas company delivers to several meetups or events and are available in the demo folder.

⁠Setup

docker pull datafellas/spark-notebook-demo 
docker run --rm -it -p 7894:9000 datafellas/spark-notebook-demo bash
./run.sh

⁠Usage

When the container is ready, you can access all the examples provided by the open source project but you will be mostly interested by the following ones which will use most of the additional softwares: http://localhost:7894/tree/demo/.

⁠Troubleshooting

⁠On Mac

Please follow instructions here: https://docs.docker.com/mac/started/⁠

⁠Sleep time

There is a 60 seconds sleep time in the run command, this is for Cassandra and Kafka being up before creating topics and keyspace.

⁠read tcp 192.168.99.100:2376

You're out of luck. Apparently on Mac (see comments below) you have no other chances than restarting the VM and the instances.

Note: this mainly appear on Mac OS X after a long IDLE time.