Array intersect Hive

arrays apache hive intersect
Adriano Foschi picture Adriano Foschi · Feb 5, 2014 · Viewed 8.2k times · Source

I have two arrays of string in Hive like

{'value1','value2','value3'}
{'value1', 'value2'}

I want to merge arrays without duplicates, result:

{'value1','value2','value3'}

How I can do it in hive?

Answer

Adriano Foschi picture Adriano Foschi · Feb 5, 2014

A native solution could be that:

SELECT id, collect_set(item)
FROM table
LATERAL VIEW explode(list) lTable AS item
GROUP BY id;

Firstly explode with lateralview, and next group by and remove duplicates with collect_set.

Related questions

Using velocity split() to split a string into an array doesnt seem to work

I HATE velocity and rarely ever use it but sometimes I am called upon at my job to do so. I can never really figure out just how to use it. I have this #foreach( $product in $browseSiteProducts ) alert("$product.…

Read More
How can I remove a specific item from an array?

I have an array of numbers and I'm using the .push() method to add elements to it. Is there a simple way to remove a specific element from an array? I'm looking for the equivalent of something like: array.remove(…

Read More
How do I declare and initialize an array in Java?

How do I declare and initialize an array in Java?

Read More