Error: Could not find or load main class org.test.spark.streamExample

spark-streaming scala-ide
kumar picture kumar · Dec 22, 2015 · Viewed 24.9k times · Source

I was trying to execute sample basic sparkstreaming example in Scala IDE, but I am getting below error:

Error: Could not find or load main class org.test.spark.streamExample.

Could anyone help me to sort out this please.

Answer

sudhir picture sudhir · Dec 28, 2015

RightClick on your project and go to properties where you will find Scala Compiler, change target to jvm 1.7 based on your installation and also change Scala Installation dropdown based on version you have installed

Related questions

Drop spark dataframe from cache

I am using Spark 1.3.0 with python api. While transforming huge dataframes, I cache many DFs for faster execution; df1.cache() df2.cache() Once use of certain dataframe is over and is no longer needed how can I drop DF from …

Read More
The value of "spark.yarn.executor.memoryOverhead" setting?

The value of spark.yarn.executor.memoryOverhead in a Spark job with YARN should be allocated to App or just the max value?

Read More
How to write spark streaming DF to Kafka topic

I am using Spark Streaming to process data between two Kafka queues but I can not seem to find a good way to write on Kafka from Spark. I have tried this: input.foreachRDD(rdd => rdd.foreachPartition(partition => …

Read More