Розробка інфраструктури в умовах обмежених бюджетів, людських ресурсів та часу.

1. Constraint Driven Infrastructure
Scale and tune to save money
Volodymyr Tsap
Highload FWdays 2017
Volodymyr Tsap
CTO at SHALB
Constraint Driven Infrastructure

2. About Me
15 years supporting Linux for
money
10 years Enterprise Java
Applications and SDK’s
support
8 years as a CTO in own
company

3. Saving on Hardware

4. Starting Startup
Select the Platform

5. Platform Dependent Proc
Extremely low price
OS/Hypervisor lock out
Orchestration freedom
Don’t waste your time on
$ calculations
Dedicated Server PaaS
Flexible PasYG price
Does not require any
system administration
Failover by design
Cloud Provider
Price could be managed
by resource freeing
Unlimited scaling
Rapid env. deployment
using platform tools
Bare Metal

6. Hardware Sample on AWS
Dev:
m4.2xlarge 8vCPU(11863PM) / 32GB / 500 GB Storage
Prod:
m4.xlarge 4vCPU(5931PM**) / 16GB / 100 GB Storage
10 % Change in daily snapshot
2 Elastic IP
1.5 Tb traffic
$648 / Month*
27.4PM/$
* https://calculator.s3.amazonaws.com/index.html
**https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2676+v3+%40+2.40GHz

7. EC2 Spot + RDS on AWS
RDS(save up to 42% by upfront year payment):
db.t2.medium (2СPU(2)4GB) = 48,96 $
db.m4.large (2CPU(6.5) 8GB) = 252$
Spot instances (6 hours):
m4.2xlarge = 187.2
m4.xlarge = 93.6
EBS
$0.10 per 600G = 60$
$514-641 / Month*
34PM/$
* https://calculator.s3.amazonaws.com/index.html
* https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2676+v3+%40+2.40GHz

8. PaaS Heroku Dyno
Performance-l 14GB CPU 46x(PM9073) $500/mo
Or
10x Standard-2x 1GB CPU 2-8X $50/mo
$500 / Month*
18PM/$
0,65xAWS* https://devcenter.heroku.com/articles/dyno-types#available-dyno-types
*https://www.quora.com/How-powerful-is-one-Heroku-dyno-Is-it-roughly-equivalent-to-an-EC2-Sm
all-instance

9. Enterprise Server
Config on OVH.com
Intel 2x Xeon E5-2630v3(PM18649) / 128GB
Hardware Raid 2x2TB + 2x480GB SSD
500 Mbps guaranteed bandwidth
5 TB* Remote Backup storage
VMware ESXi supported
* https://www.ovh.ie/dedicated_servers/enterprise/
$333 / Month*
56PM/$
2xAWS

10. 2 x Soft-Raid Servers
Config for OVH.com
2 servers same hardware:
Intel Xeon E3-1270v6(11324PM) / 64GB
SoftRaid 2x2TB
500 Mbps bandwidth
1 TB* Remote Backup storage
$282 Month
80.3PM/$
3xAWS

11. 2 x Desktop Hardware
Dev and Prod dedicated each:
AX60-SSD
AMD Ryzen 7 1700X (14651PM) / 64 GB
2 x 500 GB SSD
Guaranteed bandwidth 1 Gbit/s-Port
$70 Month
2 TB Backup Storage - $ 12
$152 Month
192.7PM/$
7xAWS

12. Hardware price needs to
be taken into account
DailyDaily

13. Cloud Saving
by Scaling?
Daily

14. Daily load sample for corporate mail system

15. Daily load sample for E-commerce platform

16. Daily load sample for news website

17. Daily load sample for PaaS Provider

18. Scaling can save your
money only if workload
is not planar

19. Saving Money on
Software

20. Operating
system
Points to check
Filesystem - ext4, xfs, noatime
Memory - disable swap/swappiness
Network - tcp r/wmem, buffers
Process - limits, open files
Prepare ready images no
post-installation provisioning
Compile - it could save 10-20%

21. Distro Selection
Lifecycle
RHEL/CentOS - 10 years
Ubuntu LTS - 5 years
Debian ~ 3 years
Gentoo - rolling release
Upgrade
CentOS - pain
Ubuntu/Debian - ok
Gentoo - pain/ok
Packages Available
RHEL/CentOS repo - 6000
Ubuntu Universe - 23,000
Debian - 23,000
Gentoo - 19,692
OpenStack, K8, Swarm:
CentOS/Ubuntu - Good
Debian - Normal
Lyfecycle
Packages AvailableLyfecycle
Upgrade procedure Platform Support

22. Virtualization
Containerization
Points to check
Free and popular: KVM, Xen, Docker,
ESXi*
Live migration support
Hosted OS requirements
For licensed features fill the top of
hardware limits
HCL could be bypassed

23. Orchestration
Points to check
Deployment Simplicity
Manageability
Scalability
Suitable for stateful and stateless
apps
Networking and multi-site support

24. Databases
Points to check
Choose the DB by the planned
workload
Check the CAP Theorem
Fault tolerance and recovery speed
Use profilers and query monitoring
Buffers and pools has significant
impact

25. How much it cost
to support an
infrastructure

26. Price depends on
Number of instance types and roles
Quality of automation
Incident response/resolution time
Number request for env. changes
Mad man coefficient

27. Prod & Dev at same server
$250 / Month

28. 2-3 Servers, Failover, Basic
Roles
$500-800 /
Month

29. Multi DC, IaaC, CI/CD,
Orchestration
$1.2k-3k / Month
K8/OS 3k-4k / Month

30. Geo Distributed Orchestration,
Hybrid Clouds, Dedicated Ops
$4k-6k / Month
+$100 per in. type

31. Saved money spend on people!

32. Thank you!
Volodymyr Tsap
Co-founder/CTO at SHALB.com
Email: voa@shalb.com
Skype: volodymyr.tsap
Linkedin: voatsap
Facebook: volodymyr.tsap