How PayPal got 300 Nodes up in 14 minutes - Greg Bruno, VP Engineering/Co-Founder @ StackIQ StackiFest - March 24, 2016

1. Greg Bruno
VP of Engineering

2. How PayPal Installs 300 Nodes in 14 Minutes …
In 14 Minutes

3. Stacki Positioning
DevOps / Configuration Tool
DHCP /
DNS / TFTP
NetworkDiskOS
In-house
developed
deployment
tools
- Disk Array Controller Configuration
- Disk Partitioning Configuration

4. Stacki @ PayPal
Ambari HDP
Health Detection
Integration
IPMI/iLOOS Disk Network
DHCP / DNS /
TFTP
Ansible
- Disk Array Controller Configuration
- Disk Partitioning Configuration
“Stacki + Ansible = Happiness. :D” – Stacki mailing list 8/11/15

5. Hadoop @ PayPal
12 x 2TB SATA
data drives
48 nodes
each rack
1GBE-10GBE
NICs
24 x 900GB 6G SAS
10K data drives
24 nodes
each rack
10GBE NIC
8 x 4TB NR-SAS
data drives
10 GBE NIC
Bay Area
Salt Lake City
Las Vegas
DATACENTERS
• 3,000 nodes and growing
• 60+ initial server racks
• Heterogeneous HW
across multiple DCs
Data Science
Infrastructure Footprint
48 nodes
each rack

6. Quick, Early Success
14 Minutes*To Fully Provision 6 Racks of Bare Metal (288 Servers)
Includes wiping all
disks then fully
partitioning & formatting
~3500 drives
And Now…
Upgrades all firmware
automatically
Executes Ansible
scripts on all hosts
Hadoop packages
installed
* Versus hours with other hyperscale management tools, or days to weeks with traditional tools and processes