Top "Spark-submit" questions

spark-submit is a script that is able to run apache-spark code written in e.g. java, scala or python

spark-submit config through file

I am trying to deploy spark job by using spark-submit which has bunch of parameters like spark-submit --class Eventhub --master …

Read More
apache-spark spark-submit
Set hadoop configuration values on spark-submit command line

We want to set the aws parameters that from code would be done via the SparkContext: sc.hadoopConfiguration.set("fs.…

Read More
apache-spark spark-submit
Pass system property to spark-submit and read file from classpath or custom path

I have recently found a way to use logback instead of log4j in Apache Spark (both for local use …

Read More
java scala apache-spark apache-spark-2.0 spark-submit
How to set Spark application exit status?

I'm writing a spark application and run it using spark-submit shell script (using yarn-cluster/yarn-client) As I see now, exit …

Read More
apache-spark yarn exit-code spark-submit