how to schedule the shell script using Google Cloud Shell?

shell cron google-cloud-platform google-bigquery google-cloud-shell
samit picture samit · Oct 31, 2017 · Viewed 9.9k times · Source

I have a .sh file that is stored in GCS. I am trying to schedule the .sh file through google cloud shell.

I can run the same file using gsutil cat gs://miptestauto/baby.sh | sh command but not able to schedule it.

Following is my code for scheduling the file:

16 17 * * * gsutil cat gs://miptestauto/baby.sh | sh

It displays the message as "auto saving..done" but the scheduled job is not get displayed when I use crontab -l

# contents of .sh file 
bin/bash
bq load --source_format=CSV babynames.baby_destination13 gs://testauto/yob2010.txt name:string,gender:string,count:integer

Please can anyone tell me how schedule it using google cloud shell. I am not using compute engine/app engine. Just wanted to schedule it using the cloud shell.

thank you in advance :)

Answer

JMD picture JMD · Oct 31, 2017

As per the documentation, Cloud Shell is intended for interactive use only. The Cloud Shell instances are provisioned on a per-user, per-session basis and sessions are terminated after an hour of inactivity.

In order to schedule a daily cron job, the instance needs to be up and running all time but this doesn’t happen with Cloud Shell and I believe your jobs are not running because of this.

When you start Cloud Shell, it provisions a f1-micro instance which is the same machine type you can get for free if you are eligible for “Always Free”. Therefore you can create a f1-micro instance, configure the cron job on it and leave it running so it can execute the daily job.

You can check free usage limits at https://cloud.google.com/compute/pricing#freeusage

Related questions

How to create a cron job using Bash automatically without the interactive editor?

Does crontab have an argument for creating cron jobs without using the editor (crontab -e). If so, What would be the code create a cronjob from a Bash script?

Read More
find -mtime files older than 1 hour

I have this command that I run every 24 hours currently. find /var/www/html/audio -daystart -maxdepth 1 -mtime +1 -type f -name "*.mp3" -exec rm -f {} \; I would like to run it every 1 hour and delete files that are older than 1 …

Read More
How do I create a crontab through a script

I need to add a cron job thru a script I run to set up a server. I am currently using Ubuntu. I can use crontab -e but that will open an editor to edit the current crontab. I want …

Read More