Top "Avro" questions

Apache Avro is a data serialization framework primarily used in Apache Hadoop.

Avro Java API Timestamp Logical Type?

With the Avro Java API, I can make a simple record schema like: Schema schemaWithTimestamp = SchemaBuilder .record("MyRecord").namespace("org.…

java time avro
Polymorphism and inheritance in Avro schemas

Is it possible to write an Avro schema/IDL that will generate a Java class that either extends a base …

avro
Use schema to convert AVRO messages with Spark to DataFrame

Is there a way to use a schema to convert avro messages from kafka with spark to dataframe? The schema …

scala apache-spark apache-kafka spark-streaming avro
Encode an object with Avro to a byte array in Python

In python 2.7, using Avro, I'd like to encode an object to a byte array. All examples I've found write to …

python-2.7 avro
Nesting Avro schemas

According to this question on nesting Avro schemas, the right way to nest a record schema is as follows: { "name": "…

nested schema record avro
AVRO Validation

Am fairly new to AVRO so please excuse if am missing anything obvious. Is there an AVRO validator/commandline utility …

json encoding validation avro
Performance Metrics for Avro vs Protobuf

We are using kafka for storing messages and pushing an extremely large number of messages(> 30k in a minute). …

performance serialization apache-kafka protocol-buffers avro
avro gradle plugin sample usage

I am trying to use the avro-gradle-plugin on github, but have not gotten any luck getting it to work. Does …

hadoop gradle avro
Spark: Writing to Avro file

I am in Spark, I have an RDD from an Avro file. I now want to do some transformations on …

scala serialization avro apache-spark
Getting Started with Avro

I want to get started with using Avro with Map Reduce. Can Someone suggest a good tutorial / example to get …

mapreduce avro