Spark Streaming is an extension of the core Apache Spark API that enables high-throughput, fault-tolerant stream processing of live data streams.
I am using Spark 1.3.0 with python api. While transforming huge dataframes, I cache many DFs for faster execution; df1.cache() …
apache-spark apache-spark-sql spark-streamingThe value of spark.yarn.executor.memoryOverhead in a Spark job with YARN should be allocated to App or just …
apache-spark apache-spark-sql spark-streaming apache-spark-mllibI am using Spark Streaming to process data between two Kafka queues but I can not seem to find a …
scala apache-spark apache-kafka spark-streaming spark-streaming-kafkaHello I am trying to download spark-core, spark-streaming, twitter4j, and spark-streaming-twitter in the build.sbt file below: name := "hello" …
scala apache-spark sbt spark-streamingI've just created python list of range(1,100000). Using SparkContext done the following steps: a = sc.parallelize([i for i in …
apache-spark spark-streamingI am designing a new architecture big data where my client has as IBM MQ broker. We use to work …
ibm-mq apache-kafka apache-storm spark-streamingIs there anything in Scala like, condition ? first_expression : second_expression; that I can use within map function in scala? …
scala apache-spark spark-streaming map-functionI am monitoring a spark executor JVM of a OutOfMemoryException. I used Jconsole to connect to executor JVM. Following is …
java apache-spark memory-management jvm spark-streamingI am beginner to Spark and I am running my application to read 14KB data from text filed, do some …
java apache-spark spark-streaming spark-submitI am a beginner in Spark streaming and Scala. For a project requirement I was trying to run TwitterPopularTags example …
scala maven apache-spark noclassdeffounderror spark-streaming