Sunday, October 13, 2013

Hive development !

Lateral view simplifies the use of UDTF :

SELECT column1, column_udtf1
FROM t_table

LATERAL VIEW explode(array_column) ssreq_lv1 AS column_udtf1 
;

And with Hive 0.11, you now have ORC Files and windowing functions :
  • LEAD / LAG
  • FIRST_VALUE / LAST_VALUE
  • RANK / RANK / ROW_NUMBER / DENSE_RANK
  • CUME_DIST / PERCENT_RANK / NTILE
which is convenient for our BI needs !