Cloudera 5.6: Parquet does not support date. See HIVE-6384

hive cloudera parquet
pitchblack408 picture pitchblack408 · May 21, 2016 · Viewed 12.7k times · Source

I am currently using Cloudera 5.6 trying to create a parquet format table in hive table based off another table, but I am running into an error.

create table sfdc_opportunities_sandbox_parquet like 
sfdc_opportunities_sandbox STORED AS PARQUET

Error Message

Parquet does not support date. See HIVE-6384

I read that hive 1.2 has a fix for this issue, but Cloudera 5.6 and 5.7 do not come with hive 1.2. Has anyone found way around this issue?

Answer

U880D picture U880D · Jan 2, 2018

Except from using an other data type like TIMESTAMP or an other storage format like ORC, there might be no way around if there is a dependency to the used Hive version and Parquet file storage format.

According Clouderas CDH 5 Packaging and Tarball Information, the whole branch 5 comes packed with Apache Parquet in v1.5.0 and Apache Hive in v1.1.0.

Date was implemented in ParquetSerde with HIVE-8119 and as of Hive 1.2.

Related questions

Hive External Table Skip First Row

I am using Cloudera's version of Hive and trying to create an external table over a csv file that contains the column names in the first column. Here is the code that I am using to do that. CREATE EXTERNAL …

Read More
beeline not able to connect to hiveserver2

I have a CDH 5.3 instance. I start the hive-server2 by first starting the hive-metastore and then the hive-server from command line. After this I use beeline to connect to my hive-server2 but apparently it is not able to so. Could …

Read More
No partition predicate found for Alias even when the partition predicate in present in the query

I have a table pos.pos_inv in hdfs which is partitioned by yyyymm. Below is the query: select DATE_ADD(to_date(from_unixtime(unix_timestamp(Inv.actvydt, 'MM/dd/yyyy'))),5), to_date(from_unixtime(unix_timestamp(Inv.actvydt, …

Read More