Automating MAPR (Hadoop Cluster) Provisioning for a Global Travel Technology Company
Overview
The Customer was a global travel technology company and was looking for institutionalizing an enterprise innovation framework for Continuous Integration, Continuous Delivery and Continuous Learning.
Download Case Study
Challenges
Difficulty in automating the setup of lambda box
Time consuming process of entire Hadoop cluster set up
Solution
- Automation, Patching and Upgradation of MapR tools using Node Hopper and Python
- Nodes configuration and roles assignment
- Downloaded all the remote libraries for MapR tools like Oozie, Hive, Spark, etc.
- Implemented Puppet architecture throughout the nodes to install all MapR dependencies
Outcomes
- 50% Reduction in Hadoop cluster set-up time
- Single click infra provisioning
- 40% Improvement in productivity
