Audience Level All levels Synopsis Our journey towards solving our Application and Infrastructure Problems using Immutability, Codification, Mesos, Docker and Ironic. OpenStack Australia Day Melbourne 2017 https://events.aptira.com/openstack-australia-day-melbourne-2017/

1. Ironically,
Infrastructure
doesn’t matter
Quinton Anderson
Head of Engineering
Analytics and Information
CBA

2. Downstream
systems
• Specialised
management
systems
• Reporting Systems
• Product
management
Channel &
product
systems
Master Data
Management
Hadoop
• Leverage all data & reduce
integration costs
• Comprehensive dataset –
internal & external, realtime &
batch, structured & unstructured
• Advanced analytics / machine
learning
Group Data
Warehouse
• Understand our business
• Accurate, conformed, and
reconciled data
• Access layer to support BI &
reporting
BI/Reporting
• User facing tools
• Regulatory reporting
• Dishoarding
• Self service BI for the
masses
Customer record &
insights
All data
Price,
conversation,
credit dec.
etc.
Financial Data
Subset of
data
User
access
Information for
people
Core Financial
Systems and
functions
• P&L
• Recon
• General Ledger
• Etc…
Closed loop,
automated ‘decisions’
Decisioning
• Personalise/optimise decisions,
maximise customer value
• E.g. price, credit decision, next
conversation, experience
Core information repositories
Analytics applications
Other systems

3. > 6000 Daily Batch Jobs

4. > 6 PB of State and growing

5. Hbase,
Cassandra,
HDFS,
Influx,
Elastic Search,
Kafka,
Etcd,
Zookeeper
OpenStack Swift

6. Teradata,
Oracle,
MySQL,
Postgres

7. Hundreds of services

8. MR1,
MR2,
Spark,
Akka

9. Dev,
Test,
Staging,
Prod 1,
Prod 2,
Etc…

10. 1500 users

11. > 400 Developers

12. Hosted on…

14. Issues

15. - Unit Cost
- Cost of change
- Developer Satisfaction

16. Public Cloud?

17. Physical, not VM

19. Storage

20. Networking

21. Repo(s) CI/CD Apps
Docker Calico
Mesos + Marathon
Yarn
Spark, MR, Impala, etc
CI/CD
CI/CD
Repo(s)
Repo(s)
Open
Stack Nova/Ironic
OS
Firmware + Hardware + Tags
Vault

23. - VRFs with Route Leakage for migration
- Vlan and route separation of IPMI
- Tagged Vlan allows for IPMI
management servers to be logical

24. Workflow

25. - Collaboration
- Track evolution
- Automation friendly
- Reproducibility

26. OS Image
Container X
Environment
CI Artefactory
CI Environment

27. CI
Environment
Branch PR
Merge
Dev
Deploy
Master
Deploy
Test
Change
Plan

31. Application
Infrastructure
Infrastructure