Top "Spark-csv" questions

Decimal data type not storing the values correctly in both spark and Hive

I am having a problem storing with the decimal data type and not sure if it is a bug or …

apache-spark hive apache-spark-sql spark-csv

Add UUID to spark dataset

I am trying to add a UUID column to my dataset. getDataset(Transaction.class)).withColumn("uniqueId", functions.lit(UUID.randomUUID().…

apache-spark apache-spark-dataset spark-csv

Can I read a CSV represented as a string into Apache Spark using spark-csv

I know how to read a csv file into spark using spark-csv (https://github.com/databricks/spark-csv), but I already …

apache-spark apache-spark-sql spark-csv

How to save CSV with all fields quoted?

The below code does not add the double quotes which is the default. I also tried adding # and single quote …

scala apache-spark spark-csv

Programmatically generate the schema AND the data for a dataframe in Apache Spark

I would like to dynamically generate a dataframe containing a header record for a report, so creating a dataframe from …

apache-spark dataframe spark-dataframe rdd spark-csv