What is a container in YARN?

hadoop mapreduce yarn
rahul picture rahul · Jan 16, 2013 · Viewed 52.4k times · Source

What is a container in YARN? Is it same as the child JVM in which the tasks on the nodemanager run or is it different?

Answer

Lorand Bendig picture Lorand Bendig · Jan 16, 2013

It represents a resource (memory) on a single node at a given cluster.
A container is

  • supervised by the node manager
  • scheduled by the resource manager

One MR task runs in such container(s).

Related questions

Container is running beyond memory limits

In Hadoop v1, I have assigned each 7 mapper and reducer slot with size of 1GB, my mappers & reducers runs fine. My machine has 8G memory, 8 processor. Now with YARN, when run the same application on the same machine, I …

Read More
Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0

I have setup a 2 node cluster of Hadoop 2.3.0. Its working fine and I can successfully run distributedshell-2.2.0.jar example. But when I try to run any mapreduce job I get error. I have setup MapRed.xml and other configs for …

Read More
MapReduce job hangs, waiting for AM container to be allocated

I tried to run simple word count as MapReduce job. Everything works fine when run locally (all work done on Name Node). But, when I try to run it on a cluster using YARN (adding mapreduce.framework.name=yarn to …

Read More