Top "Avro" questions

Apache Avro is a data serialization framework primarily used in Apache Hadoop.

How to fix Expected start-union. Got VALUE_NUMBER_INT when converting JSON to Avro on the command line?

I'm trying to validate a JSON file using an Avro schema and write the corresponding Avro file. First, I've defined …

json validation avro
How to serialize a Date using AVRO in Java

I'm actually trying to serialize objects containing dates with Avro, and the deserialized date doesn't match the expected value (tested …

java datetime serialization avro
How to read Avro file in PySpark

I am writing a spark job using python. However, I need to read in a whole bunch of avro files. …

python apache-spark avro pyspark
Confluent Maven repository not working?

I need to use the Confluent kafka-avro-serializer Maven artifact. From the official guide I should add this repository to my …

maven apache-kafka avro confluent-platform
Can I split an Apache Avro schema across multiple files?

I can do, { "type": "record", "name": "Foo", "fields": [ {"name": "bar", "type": { "type": "record", "name": "Bar", "fields": [ ] }} ] } and that works fine, …

avro
Thrift, Avro, Protocolbuffers - Are they all dead?

Working on a pet project (cassandra, spark, hadoop, kafka) I need a data serialization framework. Checking out the common three …

hadoop serialization protocol-buffers thrift avro
Generic conversion from POJO to Avro Record

I'm looking for a way to convert a POJO to an avro object in a generic way. The implementation should …

java avro
optional array in avro schema

I'm wondering whether or not it is possible to have an optional array. Let's assume a schema like this: { "type": "…

arrays null optional avro
How to nest records in an Avro schema?

I'm trying to get Python to parse Avro schemas such as the following... from avro import schema mySchema = """ { "name": "person", "…

python avro
How to define avro schema for complex json document?

I have a JSON document that I would like to convert to Avro and need a schema to be specified …

json serialization mapreduce avro