Top "Avro" questions

Apache Avro is a data serialization framework primarily used in Apache Hadoop.

Using apache avro reflect

Avro serialization is popular with Hadoop users but examples are so hard to find. Can anyone help me with this …

java reflection avro
How to mix record with map in Avro?

I'm dealing with server logs which are JSON format, and I want to store my logs on AWS S3 in …

avro
Writing to Avro Data file

The following code simply writes data into avro format and reads and displays the same from the avro file written …

file avro eofexception
What is the advantage of storing schema in avro?

We need to serialize some data for putting into solr as well as hadoop. I am evaluating serialization tools for …

java apache hadoop solr avro
Avro schema definition nesting types

I am fairly new to Avro and going through documentation for nested types. I have the example below working nicely …

avro
How to create an empty dataFrame in Spark

I have a set of Avro based hive tables and I need to read data from them. As Spark-SQL uses …

scala apache-spark apache-spark-sql avro spark-avro
KafkaAvroSerializer for serializing Avro without schema.registry.url

I'm a noob to Kafka and Avro. So i have been trying to get the Producer/Consumer running. So far …

java apache-kafka avro confluent-schema-registry
How can I load Avros in Spark using the schema on-board the Avro file(s)?

I am running CDH 4.4 with Spark 0.9.0 from a Cloudera parcel. I have a bunch of Avro files that were created …

scala hadoop avro apache-spark
Deserialize an Avro file with C#

I can't find a way to deserialize an Apache Avro file with C#. The Avro file is a file generated …

c# azure hadoop avro
How to extract schema from an avro file in Java

How do you extract first the schema and then the data from an avro file in Java? Identical to this …

java avro avro-tools