Which of the many Spark/Scala kernels for Jupyter/IPython to choose?

Lunigorn picture Lunigorn · Sep 30, 2015 · Viewed 16.3k times · Source

There are a lot of Scala/Spark kernels for IPython/Jupyter:

  1. IScala
  2. ISpark
  3. Jupyter Scala
  4. Apache Toree(prev Spark Kernel)

Does anybody know wich of them is most compatible with IPython/Jupyter and most comfortable to use with:

  1. Scala
  2. Spark(Scala)

Answer

Al M picture Al M · Oct 1, 2015

I can't speak for all of them, but I use Spark Kernel and it works very well for using both Scala and Spark.

I found IScala and Jupyter Scala less stable and less polished. Jupyter Scala always prints every variable value after I execute a cell; I don't want to see this 99% of the time.

Spark Kernel is my favourite. Both for Spark and plain old Scala.