Popular "apache-spark-sql" questions | Page 3

I have constructed two dataframes. How can we join multiple Spark dataframes ? For Example : PersonDf, ProfileDf with a common column …

scala apache-spark dataframe apache-spark-sql

Is there a way to apply an aggregate function to all (or a list of) columns of a dataframe, when …

apache-spark dataframe apache-spark-sql aggregate-functions

I want to create on DataFrame with a specified schema in Scala. I have tried to use JSON read (I …

scala apache-spark dataframe apache-spark-sql

What's the difference between selecting with a where clause and filtering in Spark? Are there any use cases in which …

apache-spark apache-spark-sql

E.g sqlContext = SQLContext(sc) sample=sqlContext.sql("select Name ,age ,city from user") sample.show() The above statement print …

apache-spark dataframe for-loop pyspark apache-spark-sql

This command works with HiveQL: insert overwrite directory '/data/home.csv' select * from testtable; But with Spark SQL I'm …

hadoop apache-spark export-to-csv hiveql apache-spark-sql

I am working with Spark and PySpark. I am trying to achieve the result equivalent to the following pseudocode: df = …

apache-spark hive pyspark apache-spark-sql hiveql

So as I know in Spark Dataframe, that for multiple columns can have the same name as shown in below …

python apache-spark dataframe pyspark apache-spark-sql

I want to filter dataframe according to the following conditions firstly (d<5) and secondly (value of col2 not equal …

sql filter pyspark apache-spark-sql pyspark-sql

I have a text file on HDFS and I want to convert it to a Data Frame in Spark. I …

scala apache-spark dataframe apache-spark-sql rdd

Top "Apache-spark-sql" questions