Top "Avro" questions

Where an Avro schema is stored when I create a hive table with 'STORED AS AVRO' clause?

There are at least two different ways of creating a hive table backed with Avro data: 1) Creating a table based …

hive schema avro metastore

Unnesting in SQL (Athena): How to convert array of structs into an array of values plucked from the structs?

I am taking samples from a Bayesian statistical model, serializing them with Avro, uploading them to S3, and querying them …

sql row avro amazon-athena unnest

Kafka Stream with Avro in JAVA , schema.registry.url" which has no default value

I have the following configuration for my Kafka Stream application Properties config = new Properties(); config.put(StreamsConfig.APPLICATION_ID_CONFIG,…

java apache-kafka avro apache-kafka-streams confluent-schema-registry

How to avro binary encode my json string to a byte array?

I have a actual JSON String which I need to avro binary encode to a byte array. After going through …

java json bytearray avro

Impala - convert existing table to parquet format

I have a table that has partitions and I use avro files or text files to create and insert into …

text-files avro parquet impala

Avro multiple record of same type in single schema

I like to use the same record type in an Avro schema multiple times. Consider this schema definition { "type": "record", "…

avro spark-avro

Unknown magic byte with kafka-avro-console-consumer

I have been trying to connect with kafka-avro-console-consumer from Confluent to our legacy Kafka cluster, which was deployed without Confluent …

apache-kafka avro confluent-platform confluent-schema-registry

How to generate schema-less avro files using apache avro?

I am using Apache avro for data serialization. Since, the data has a fixed schema I do not want the …

java apache avro

Kafka Avro Consumer with Decoder issues

When I attempted to run Kafka Consumer with Avro over the data with my respective schema,it returns an error …

java apache-kafka avro kafka-consumer-api apache-nifi

How to serialize java.math.BigDecimal in Avro?

Avro schemas are defined using JSON. Schemas are composed of primitive types (null, boolean, int, long, float, double, bytes, and …

java bigdecimal avro