Generate Large file via Hive JDBC

Recently in our project, we have a requirement of generating┬ácomparatively large file via Hive JDBC for web app user to download, by large I mean millions of rows. Since our previous use case are all small files containing less than maybe 50000 rows, our approach is grabbing them all into memory and dump into file….