Skills
Hadoop Developer/Administrator and Content Editor
I am a Hadoop Developer/Administrator and Content Editor. Developed Oozie workflow to automate the loading of data into HDFS and Pig for data pre-processing. Architected 60-node Hadoop clusters with CDH4.4 on CentOS. Successfully implemented Cloudera on a 30-node cluster. Leveraged Sqoop to import data from RDBMS into HDFS. Developed ETL framework using Python and Hive (including daily runs, error handling, and logging) to glean useful data and improve vendor negotiations. Performed cleaning and filtering on imported data using Hive and MapReduce. Developed and designed a 10-node Hadoop cluster for sample data analysis. Regularly tune performance of Hive and Pig queries to improve data processing and retrieving. Run Hadoop streaming jobs to process terabytes of XML data. Created visualizations and reports for the business intelligence team, using Tableau. Analyzed datasets using Pig, Hive, MapReduce, and Sqoop to recommend business improvements. Setup, installed, and monitored 3-node enterprise Hadoop cluster on Ubuntu Linux. Analyzed and interpreted transaction behaviors and clickstream data with Hadoop and HDP to predict what customers might buy in the future. Setup the ganglia monitoring tool to monitor both hadoop specific metrics and also system metrics. Wrote custom Nagiosscripts to monitor Namenode, data node, secondary name node, job tracker and task trackers daemons and setup alerting system. Experimented to dump the data from MySQL to HDFS using sqoop. As a content editor wrote copy sourced material and developed ideas. Proofed and edited online copy for newspaper website. Ensured all articles and posts followed correct grammar and style guidelines. Tested website usability and appearance for attractiveness and errors. Designed new features for site to increase user engagement. Monitored website communications and escalated problems.
Reviews
Finance Management software
January 6, 2018 - March 30, 2018
Gavin is a pleasure to work with, we can see from our communications and completed works, his a very experienced and professional coder with great analytical skills. He quickly worked his way into completing a complex coding requirement that we needed urgent assistance with, of which Gavin completed earlier than expected. We highly recommend Gavin and are currently planning our next project to work with him over the coming weeks.
Hadoop help
March 28, 2018 - May 22, 2018
Thank you for your excellent and highly professional development service. All tasks have been successfully completed with an exceptional quality in a right time. We had excellent experience with Gavin. Happy to deal with you anytime again for future development services and Highly recommend you as an absolutely high quality software development service.
Test management software
August 8, 2018 - November 25, 2018
Great Developer! excellent communication! he really knows how to improve the original specs and fix issues, a real professional! thank you!
API software creation
October 24, 2018 - December 28, 2018
Everything was just great. Can't say anything negative. Definitely, would recommend Gavin to my colleagues.
Ecommerce web app
March 27, 2019 - May 10, 2019
Gavin delivered great work on my project. He completed his task in very short time and at short notice. I will likely work with him again in the future.
Data mining software
June 7, 2019 - August 24, 2019
Gavin is an excellent communicator and we enjoyed working with him. His questions helped us crystallize the goals of the project. We would be glad to work with him in the future.
Signaturit <=> Zoho
February 8, 2020 - February 8, 2020
He did a good job
