How to delete a gcloud Dataflow job?

google-cloud-dataflow
Vijin Paulraj picture Vijin Paulraj · Sep 4, 2017 · Viewed 10.4k times · Source

The Dataflow jobs are cluttered all over my dashboard, and I'd like to delete the failed jobs from my project. But in the dashboard, I don't see any option to delete the Dataflow job. I'm looking for something like below at least,

$ gcloud beta dataflow jobs delete JOB_ID

To delete all jobs,

$ gcloud beta dataflow jobs delete

Can someone please help me with this?

Answer

Graham Polley picture Graham Polley · Sep 5, 2017

Unfortunately, this is not currently possible. You cannot delete a Dataflow job. This is something that you could request via the public issue tracker (I've wanted it in the past too).

gcloud dataflow jobs --help

COMMANDS

COMMAND is one of the following:

 cancel
    Cancels all jobs that match the command line arguments.

 describe
    Outputs the Job object resulting from the Get API.

 drain
    Drains all jobs that match the command line arguments.

 list
    Lists all jobs in a particular project.

 run
    Runs a job from the specified path.

 show
    Shows a short description of the given job.

Related questions

What is the difference between Google Cloud Dataflow and Google Cloud Dataproc?

I am using Google Data Flow to implement an ETL data ware house solution. Looking into google cloud offering, it seems DataProc can also do the same thing. It also seems DataProc is little bit cheaper than DataFlow. Does anybody …

Read More
FTP to Google Storage

Some files get uploaded on a daily basis to an FTP server and I need those files under Google Cloud Storage. I don't want to bug the users that upload the files to install any additional software and just let …

Read More
Google Dataflow vs Apache Spark

I am surveying Google Dataflow and Apache Spark to decide which one is more suitable solution for our bigdata analysis business needs. I found there are Spark SQL and MLlib in the spark platform to do structured data query and …

Read More