how to include external jar file using PIG

hadoop apache-pig
root1982 picture root1982 · May 3, 2012 · Viewed 16.6k times · Source

When I run a mapreduce job using hadoop command, I use -libjars to setup my jar to the cache and the classpath. How to do something like this in PIG?

Answer

zsxwing picture zsxwing · Apr 23, 2013

There are two ways to add external jars to Pig environment.

  1. Use "-Dpig.additional.jars" to start Pig

    pig -Dpig.additional.jars=/local/path/to/your.jar

  2. Use "register" command in Pig scripts or grunt

    register /local/path/to/your.jar;

You can use any one according to your requirement.

Related questions

Difference between Pig and Hive? Why have both?

My background - 4 weeks old in the Hadoop world. Dabbled a bit in Hive, Pig and Hadoop using Cloudera's Hadoop VM. Have read Google's paper on Map-Reduce and GFS (PDF link). I understand that- Pig's language Pig Latin is a …

Read More
When to use Hadoop, HBase, Hive and Pig?

What are the benefits of using either Hadoop or HBase or Hive ? From my understanding, HBase avoids using map-reduce and has a column oriented storage on top of HDFS. Hive is a sql-like interface for Hadoop and HBase. I would …

Read More
PIG how to count a number of rows in alias

I did something like this to count the number of rows in an alias in PIG: logs = LOAD 'log' logs_w_one = foreach logs generate 1 as one; logs_group = group logs_w_one all; logs_count = foreach logs_group generate …

Read More