Think learning Java and C++ in school was bad... I was taught COBOL and FORTRAN... on punch cards. Then years later had the ground-breaking opportunity to use IBM's DB/2 database. Revealing my old age here, and my how far we have come.
Very cool to meet someone else here wrangling up some code! And temp files, I do the dele, dele1, dele2, ad infinitum. Then after a year or so delete them all seconds before I realize I needed sample code out of one.
Great read, as I do something very similar. I import to MariaDB (a fork of MySQL) but use Lucee CFML as my language. It runs on the JVM (through Tomcat), but you don't have to write Java. CFML is very fast but Old Skool. Most operations, including importing the last 1,000 records from a HIVE API call takes typically 0.01 seconds to parse and INSERT into MariaDB. I also have a separate panel to query the database. All done as a web app in HTML/CSS and touches of JavaScript for client interface trickery.