Use for questions specific to Apache Spark 1.4. For general questions related to Apache Spark use the tag [apache-spark].
I am trying to effectively join two DataFrames, one of which is large and the second is a bit smaller. …
apache-spark dataframe apache-spark-sql apache-spark-1.4I am running a Spark streaming application with 2 workers. Application has a join and an union operations. All the batches …
apache-spark spark-streaming apache-spark-1.4I am a beginner in Spark and trying to follow instructions from here on how to initialize Spark shell from …
pyspark apache-spark-1.4I am using Spark 1.4.1. I can use spark-submit without problem. But when I ran ~/spark/bin/spark-shell I got the …
apache-spark apache-spark-1.4