Got InterruptedException while executing word count mapreduce job

hadoop mapreduce cloudera hortonworks-data-platform hortonworks-sandbox
PUSHPAK GOHEY picture PUSHPAK GOHEY · Sep 6, 2016 · Viewed 14.4k times · Source

I have installed Cloudera VM version 5.8 on my machine. When I execute word count mapreduce job, it throws below exception.

`16/09/06 06:55:49 WARN hdfs.DFSClient: Caught exception 
java.lang.InterruptedException
    at java.lang.Object.wait(Native Method)
    at java.lang.Thread.join(Thread.java:1281)
    at java.lang.Thread.join(Thread.java:1355)
    at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:862)
    at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.endBlock(DFSOutputStream.java:600)
    at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:789)
`

But the job completes successfully. Could someone please help me resolve this.

Thanks.

Answer

Paweł Kucharski picture Paweł Kucharski · Oct 7, 2016

You can ignore this warning. It's a bug in Hadoop.

There is an issue for this: https://issues.apache.org/jira/browse/HDFS-10429

Related questions

Usecases for mapred.job.queue.name

What are the real world use cases on using map reduce job queues i.e. the value of mapred.job.queue.name property. I see default being used as the value always.

Read More
Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses-submiting job2remoteClustr

I recently upgraded my cluster from Apache Hadoop1.0 to CDH4.4.0. I have a weblogic server in another machine from where i submit jobs to this remote cluster via mapreduce client. I still want to use MR1 and not Yarn. I …

Read More
Where are the hadoop-examples* and hadoop-test* jars in Cloudera CDH?

I am looking for the jar files to be able to run the hadoop jobs associated with the examples and test jars. In the past they were under /usr/lib/hadoop, but apparently no longer. Pointers appreciated. Note: this question …

Read More