Running shell script from oozie through Hue

bash hadoop oozie hue
Sourabh Potnis picture Sourabh Potnis · May 13, 2014 · Viewed 8.1k times · Source

I am invoking a bash shell script using oozie editor in Hue.

I used the shell action in the workflow and tried below different options in shell command:

  1. Uploaded the shell script using 'choose a file'
  2. Gave local directory path where shell script is present
  3. Gave HDFS path where shell script is present

But all these options gave following error:

Cannot run program "sec_test_oozie.sh" (in directory "/data/hadoop/yarn/local/usercache/user/appcache/application_1399542362142_0086/container_1399542362142_0086_01_000002"): java.io.IOException: error=2, No such file or directory

How should I give the shell script execution command? Where the shell script file should be residing?

Answer

SergioRG picture SergioRG · Jun 12, 2014

You need add file "sec_test_oozie.sh" in oozie shell step. In add files

Related questions

Oozie shell script action

I am exploring the capabilities of Oozie for managing Hadoop workflows. I am trying to set up a shell action which invokes some hive commands. My shell script hive.sh looks like: #!/bin/bash hive -f hivescript Where the hive …

Read More
Working With Hadoop: localhost: Error: JAVA_HOME is not set

I'm working with Ubuntu 12.04 LTS. I'm going through the hadoop quickstart manual to make a pseudo-distributed operation. It seems simple and straightforward (easy!). However, when I try to run start-all.sh I get: localhost: Error: JAVA_HOME is not set. …

Read More
Batch rename in hadoop

How can I rename all files in a hdfs directory to have a .lzo extension? .lzo.index files should not be renamed. For example, this directory listing: file0.lzo file0.lzo.index file0.lzo_copy_1 could be renamed to: file0.…

Read More