Top "Yarn" questions

YARN Resourcemanager not connecting to nodemanager

thanks in advance for any help I am running the following versions: Hadoop 2.2 zookeeper 3.4.5 Hbase 0.96 Hive 0.12 When I go to …

hadoop mapreduce yarn resourcemanager

"sparkContext was shut down" while running spark on a large dataset

When running sparkJob on a cluster past a certain data size(~2,5gb) I am getting either "Job cancelled because SparkContext …

scala apache-spark yarn apache-spark-sql

Do exit codes and exit statuses mean anything in spark?

I see exit codes and exit statuses all the time when running spark on yarn: Here are a few: CoarseGrainedExecutorBackend: …

hadoop apache-spark pyspark spark-dataframe yarn

How to submit a spark job on a remote master node in yarn client mode?

I need to submit spark apps/jobs onto a remote spark cluster. I have currently spark on my machine and …

hadoop apache-spark cluster-computing yarn

How to specify which java version to use in spark-submit command?

I want to run a spark streaming application on a yarn cluster on a remote server. The default java version …

java yarn spark-streaming

How to keep YARN's log files?

Suddenly, my YARN cluster has stopped working, everything I submit fails with "Exit code 1". I want to track down that …

hadoop yarn

How to set the VCORES in hadoop mapreduce/yarn?

The following are my configuration : **mapred-site.xml** map-mb : 4096 opts:-Xmx3072m reduce-mb : 8192 opts:-Xmx6144m **yarn-site.xml** resource memory-mb : 40GB …

hadoop mapreduce yarn hcatalog

Spark Job running on Yarn Cluster java.io.FileNotFoundException: File does not exits , eventhough the file exits on the master node

I am fairly new to Spark . I tried searching but I couldn't get a proper solution . I have installed hadoop 2.7.2 …

hadoop apache-spark yarn spark-streaming

What is the maximum container(s) in a single-node cluster (hadoop)?

I am new in hadoop and i am not yet familiar to its configuration. I just want to ask the …

apache hadoop mapreduce yarn hadoop2

Hive Runtime Error while processing row in Hive

I've got issue while Querying on ORC file format table I was trying below query: INSERT INTO TABLE <db_…

hadoop hive yarn hadoop2