Add Username password auth to Hive

In my previous post, we achieved end to end SSL encryption from client to ELB to the EMR master. Our next requirement is to add username password authentication. There are different ways in hive to do this: 1. LDAP, 2. PAM, 3. CUSTOM mode. After some evaluation we finally choosed the  CUSTOM mode way. We…

EMR hive JDBC over SSL with ELB

Recently we need to setup a hive cluster consuming S3 objects so that we could run query from our java server(tomcat) via JDBC. Several challenges: our java server is on prem(will move to aws in 2017) so we have to secure the channel to the ERM cluster in emr. Solution: use SSL cross the board….

Some notes on javascript the core

Some notes on reading an article:  javascript the core Execution context(EC) VO Variable Object (VO): includes variables and function declarations.              function expression will not be included in the VO Activation Object (AO): include VO + function arguments In ES5, the VO and AO is combined into the lexical environments….

Hive query select as alias and format date

select as alias In Hive, in order to use select COL as “Alias” syntax, we cannot use single or double quote. We have to use the special “backtick” symbol -> `.  Example: SELECT user_name AS `system user name`, ….. date format To format date, we need to convert the date to bigint with unix_timestamp function and then…

2015 in review

The stats helper monkeys prepared a 2015 annual report for this blog. Here’s an excerpt: The concert hall at the Sydney Opera House holds 2,700 people. This blog was viewed about 31,000 times in 2015. If it were a concert at Sydney Opera House, it would take about 11 sold-out performances for that many…