How to change queue of currently running hadoop job?

hadoop resources share jobs
Gon picture Gon · Apr 2, 2017 · Viewed 12.6k times · Source

My hadoop job was running over 10 hours but since I put it in wrong queue, the containers are kept getting killed by the scheduler.

How do I change the queue of currently running hadoop job without restarting it?

Thank you

Answer

Phan Chuong picture Phan Chuong · Apr 4, 2017

if running Yarn you can change the current job's queue by

yarn application -movetoqueue <app_id> -queue <queue_name>

Related questions

Free Large datasets to experiment with Hadoop

Do you know any large dataset to experiment with Hadoop which is free/low cost? Any pointers/links related are appreciated. Preference: At least one GB of data. Production log data of webserver. Few of them which I found so …

Read More
Hadoop "Unable to load native-hadoop library for your platform" warning

I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable I'm running …

Read More
Spark - load CSV file as DataFrame?

I would like to read a CSV in spark and convert it as DataFrame and store it in HDFS with df.registerTempTable("table_name") I have tried: scala> val df = sqlContext.load("hdfs:///csv/file/dir/file.csv") Error …

Read More