How can I get Zeppelin to restart cleanly on an EMR cluster?

amazon-web-services hadoop pyspark amazon-emr apache-zeppelin
Andy Jobe picture Andy Jobe · Feb 3, 2017 · Viewed 11.7k times · Source

I am running an EMR cluster and trying to use a Zeppelin notebook for data analysis.

Versions: Release label:emr-5.2.1
Hadoop distribution: Amazon 2.7.3
Hive 2.1.0
Spark 2.0.2
Zeppelin 0.6.2

I am consistently having problems with Zeppelin hanging up while running a query and I can never recover it. I have tried:
- restarting the interpreter
- SSH'ing into the master node and running zeppelin_daemon.sh restart (have tried running as hadoop / root / zeppelin, and also running the script with options reload, start/stop, upstart)

Every time I use the daemon shell script, it tells me that it has stopped/started OK, but then I get this when I run a status:
Zeppelin running but process is dead [FAILED]

The only thing that I can seem to do is kill my cluster and stand up a new one, which is crazy on many levels.

So...what is the officially supported way to restart Zeppelin???

Answer

soaptree picture soaptree · Oct 17, 2017

I ssh'ed into the master node, then ran 

$ sudo stop zeppelin
zeppelin stop/waiting

$ sudo start zeppelin
zeppelin start/running, process 24434

Immediately after, refreshing Zeppelin gave me a 503, but after ~2 minutes or so, the UI was available again. I checked the logs in /var/log/zeppelin and it takes some time to configure settings.

Related questions

Hadoop/Hive : Loading data from .csv on a local machine

As this is coming from a newbie... I had Hadoop and Hive set up for me, so I can run Hive queries on my computer accessing data on AWS cluster. Can I run Hive queries with .csv data stored on …

Read More
Deleting file/folder from Hadoop

I'm running an EMR Activity inside a Data Pipeline analyzing log files and I get the following error when my Pipeline fails: Exception in thread "main" org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://10.208.42.127:9000/home/hadoop/temp-output-s3copy already exists …

Read More
How to specify AWS Access Key ID and Secret Access Key as part of a amazon s3n URL

I am passing input and output folders as parameters to mapreduce word count program from webpage. Getting below error: HTTP Status 500 - Request processing failed; nested exception is java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must …

Read More