hadoop.mapred vs hadoop.mapreduce?

apache hadoop mapreduce
bartonm picture bartonm · Apr 29, 2013 · Viewed 17.9k times · Source

Why are there two separate packages map-reduce package in Apache's hadoop package tree:

org.apache.hadoop.mapred

http://javasourcecode.org/html/open-source/hadoop/hadoop-1.0.3/org/apache/hadoop/mapred/

org.apache.hadoop.mapreduce

http://javasourcecode.org/html/open-source/hadoop/hadoop-1.0.3/org/apache/hadoop/mapreduce/

Why are they separated out? Is there documentation that clarifies this?

Answer

Tariq picture Tariq · Apr 29, 2013

They are separated out because both of these packages represent 2 different APIs. org.apache.hadoop.mapred is the older API and org.apache.hadoop.mapreduce is the new one. And it was done to allow programmers write MapReduce jobs in a more convenient, easier and sophisticated fashion. You might find this presentation useful, which talks about the differences in detail.

Hope this answers your question.

Related questions

Checksum Exception when reading from or copying to hdfs in apache hadoop

I am trying to implement a parallelized algorithm using Apache hadoop, however I am facing some issues when trying to transfer a file from the local file system to hdfs. A checksum exception is being thrown when trying to read …

Read More
What is the maximum container(s) in a single-node cluster (hadoop)?

I am new in hadoop and i am not yet familiar to its configuration. I just want to ask the maximum container per node. I am using a single node cluster (6GB ram laptop) and below is my mapred and …

Read More
MapReduce Output ArrayWritable

I'm trying to get an output from an ArrayWritable in a simple MapReduce-Task. I found a few questions with a similar problem, but I can't solve the problem in my own code. So I'm looking forward to your help. Thanks :)! …

Read More