SlideShare a Scribd company logo
1 of 47
"Где деньги, Лебовски?",
или
Почему пора перейти на FinOps
Журов Павел
Токарев Александр
Who we are
Alex Tokarev
Head of RnD Platform V Sberbank – platformv.sber.ru
AWS and GCP expert
The man who cares about money
Pavel Zhurov
Senior Cloud Engineer at VTB
Kubernetes security nerd
For God’s sake, be careful with hostPath in production
2
What not about
• Particular provider optimizations
• In-house money
• Application refactoring approach
But FinOps works there as well
3
What about
• What is FinOps
• What for
• FinOps stakeholders
• Allocation approach
• SDLC demo
• Maturity level
• Q&A
4
What is cloud
• On-demand
• Scalable
• Self-service
5
DevOps
“DevOps” is a movement that advocates:
1. A collaborative working relationship between development and
IT operations
2. Fast flow of planned work
3. High reliability, stability, resilience, and security of the
production environment
6
Cloud pains
• Financial decisions moved out form finance to engineers
• Unexpected bills at the end of month
• Huge files with billing data
• Unclear charges with micro-amounts
• Each provider has vendor-specific vocabulary
• Each provider has unique billing files structure
• IT department requests more and more cloud services
7
Big figures case
1. Company spends $875,387 for cloud each month
2. Proper spending?
3. Is $20,000/month cost optimization big enough?
8
Outliers and big figures hybrid case
• Company spends $874,387 for GCP per month
• A team purchases GPU server, which costs $5,000/month for a
new NN test
• The team forgets to switch it off
• Nobody will notice – 879 387 vs 875 387
9
Fake economy case
• Team A switches off server X each night because they use the
server for real-time tasks during working hours
• Team B switches off server Y each day because they use the
server for batch tasks during non-working hours
• Both think that they make cost-efficient decision
Just buy RI server, share it and get 20% discount!
10
Lost money case
11
Lost money case
12
Lost money case
13
More cloud pains
• No visibility for spends
• Overprovisioning
• No trust in IT department
• Budgeting cycle is complicated
• Financial department has full
control over cloud spends and
should approve each request
• No on-demand infrastructure and
on-demand spend
No enough speed – old approach irrelevant!
14
Decision
1. Operate at near-realtime
2. Eliminate monthly or quarterly spend reviews
3. Encourage finance and IT departments to work in harmony
15
FinOps
Near real time reporting
+
Just-in-time processes
+
IT and finance teams work together
+
Shared cloud dictionary
=
FinOps
+
Trust
=
Balance between speed of changes, availability of services and cloud costs
16
17
FinOps community
18
Why developers don’t like FinOps
• They never thought about money
• Constant pressure to deliver more and more features
• Cloud spends are not features – someone else’s job
• Top management doesn’t articulate cost reduction as goal
• They have never seen a cloud bill
19
Why developers need it
• Clear picture of spends – you can use more managed services
• Proven efficiency – more robust reserved instances could be
purchased
• More robust resources – more features with less efforts
• Money questions will arise at any case so let’s do it in cloud native
fashion
• Cool stuff in CV 
20
How to encourage
• Rightsizing (not cost reduction!) should be a target for every team
• Provide a visibility of each team spends – teams should have an
option for benchmarking
• Just ask to help business
• Explain FinOps not about cutting resources, but accountability
• Always estimate efforts of implementing savings:
3 hours of engineer can save 10000 USD – cool
3 hours of engineer can save 100 USD – bad
It solves big figure issue as well
Soft
skills
21
Why CTO needs it
• Benchmark against industry
• Cloud spend limits could become less strict
• More money saved – more additional headcount or team
salary’s cap
• Proven value of tech and cloud investments
• Establishing completive advantage
• Improved time-to-market
FinOps centralized team should close to CTO!!!
22
Why finance needs it
• More precise spending forecast
• Overspending risks mitigation
• More clear understanding of the overall cloud efficiency
• Actual revenue per spent money
• Figures to negotiate with cloud vendors
• Cap for cloud reservation plans
23
FinOps implementation plan - IT
• Extract consumption data for compute from:
• Billing files
• Cloud API
• Allocate shared resources to teams
• Tagging
• Internal metrics
• Find idle resources
• Introduce Cloud-native FinOps tools
• Implement recommendations system
• Implement API-based decommissioning
• Implement AI-based outliers detection
Initial stage
True real-time
management
management
+
teams
teams
Intra company FinOps
visibility
teams
teams
24
Cloud native FinOps
• New mandatory endpoint -
/consumption
• Money consumption via
Prometheus exposition format
• Budget control – standard cloud
native monitoring tools
• Money-related tests in CI/CD
• Agile-related tags:
tribe/team/product/
• Per-second consumption
calculation
25
OpenSource cloud-native tooling Start from
Task Tool Profit
Storage Prometheus
VictoriaMetrics
Long-term consumption data storage
Real-time compute management Keda
Zalando kube-metrics-adapter
Scale up/scale down
Tagging enforcement Open Policy Agent Resource allocation
Alerting Prometheus Alert Manager Outlier notifications
Reporting and dashboards Grafana Price analytics
Idle identification Goldilocks Orphan compute tasks
Containers analytics Kubecost Shared compute allocation
26
Chargeback policy in CI/CD Argo-rollouts Consumption-based rollbacks
SAAS architecture
27
Cost allocation
• The process of splitting up a cloud bill and associating the costs
to each cost center dimension
• Allocation gaps must be shared between all teams
• Takes into account all cloud services: compute, storage,
network, etc.
• Could be achieved by:
• Internal price metrics - teams calculate dependent services
consumption
• Tagging – FinOps platform calculates metrics
28
Internal metrics
• A dedicated /price or /money or /consumption endpoint
• Timeseries data
• {tenant: <>, price_unit: <>, value: <>}
• Perfect for multi-tenant services
29
Internal metrics issues
• State should be stored somewhere
• Normalization for many replicas services
• Services restart
• Teams are reluctant to care about price metrics
30
Tagging
• Folksonomy
• Set of words to describe a resource
• Self-explaining
• About IT and finance
• Perfect for multi-instance services
31
Tagging issues
• Too verbose
• Typos
• Engineers tags not aligned with business tags
• Not all cloud products have tags
Example: API gateway endpoint, DB in RDS
• No options to use for multi-tenant products
32
Suggested tags
Business department which business unit could be charged
Service which cost center drives spendings
Team how much cost a team efforts in cloud
Name what’s a name of a component
Front/Back what is ratio between back and front
Answered question
Performance metrics for
company:
Team vs Team
Department
vs
Department
Tag
33
Suggested tags
Answered question
Tag
Tags are prohibited - they are for
allocation only – not access
control!
Security-related
Use cloud project/account level!
34
Prod/Test/Dev which costs are nonproduction and safe to turn off?
Tagging
• Not more 6 tags
• Be careful with typos
• Enforce mandatory tagging via automation
• Dedicated tags set for FinOps
35
Recommendation system
• Should be on regular basis by email reports - showback
• Should be on regular basis via ticketing system for developers
• Should be taken in priority for a next sprint
• A way to get rid of engineer offence – it’s not me – it is JIRA
• A source for statistics:
• Recommendation count per release
• How many gave actual money savings
• How many were ignored
• What is average time to be taken in a sprint
• How many teams use recommendations
Recommendation discussion – it is a chance
Soft skill next level 
36
Ticketing recommendations
By tickets to IT about usage reduction by:
- decommission resources
- rightsizing
- more expensive flavors but packed by many extra workloads
- serverless services
By tickets to finance by:
- rate reduction by commercial agreement
- reserved instances
IT is happy – finance will struggle from tickets as well
37
FinOps implementation plan - Management
• Introduce FinOps approach
• Implement FinOps for multi-instance services
• Implement FinOps for multi-tenant services
• Create finance and IT dashboards
• Start teams showback-ing
• Create cost allocation dashboards and cost optimization
learning materials
• Introduce chargeback
• Create top-management dashboards
38
xBack
Showback reports - show teams what they are spending, but
money are allocated internally from a central budget
Chargeback reports - show teams what they are spending and
money are consumed internally from a team budget
39
Where to hire
Nobody knows so
you must foster in
your team!
A person who is happy with cloud but ready for fiscal and business thinking
+
Decent soft skills level
40
FinOps demo architecture
41
FinOps maturity level
Idle/underutilized resources
removal
Quarterly based manual Monthly based manual Daily AI based via API
Automation approach Spreadsheets macros Scripts for notifications API-based cloud automation
Optimization approach No Idle removing
Software refactoring
Reserved instances
Idle removing
Rightsizing
Software refactoring
Notification approach By emails from finance Emails from FinOps team
Price dashboard for an
application
Tickets in tracking system
Price dashboard per service
Allocation awareness No Showback reports Chargeback information
Teams budget No budget Budget in not real money Budget in real money
Allocation approach No allocation Cloud provider accounts Tagging and metrics
Data retention Mailbox lifetime Limited granular data Unlimited full dataset
Cost awareness timing Quarterly Monthly Near-real time
Before FinOps Level 1 Level 2
Cost extraction approach Vendor invoices manual
reconciliation
Automatic vendor invoices
reconciliation
API-based reconciliation
42
What is cloud
• On-demand
• Scalable
• Self-service
• Measurable
43
FinOps
“FinOps” is a movement that advocates:
1. a collaborative working relationship between DevOps and
Finance data-driven management of infrastructure spending
2. Transparency between IT and finance
3. Cost efficiency, profitability and product delivery pace
44
Risks
• Reducing spend at the cost of innovation or at the cost of
impacting an important project
• Recommendations don’t consider spikes in utilization
• Forgetting about disaster recovery overprovisioning
• Failing to rightsize beyond compute – databases, API gateways,
etc.
• Too many reserved instances
• Neglecting very small savings – forgot to multiply by 365
Beware stubborn FinOps!
45
Conclusion
• FinOps is feasible with opensource technologies
• Encourage ownership of each teams to govern cloud usage
• Decentralize reduction of usage to engineers
• Centralizing reduction of spendings to finance
• FinOps is not only software and money – it is about soft skills
• FinOps is not about saving money - FinOps is about making
money
46
Q&A
47
Alexander Tokarev
shtock@mail.ru
@Shtock
Email
Telegram
Github repo
pavelzhurov@gmail.com
@pavelzhurov
Email
Telegram
Pavel Zhurov

More Related Content

What's hot

What's hot (20)

How to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your EnterpriseHow to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your Enterprise
 
Practical FinOps in Practice
Practical FinOps in PracticePractical FinOps in Practice
Practical FinOps in Practice
 
Cloud Cost Optimization Whitepaper
Cloud Cost Optimization WhitepaperCloud Cost Optimization Whitepaper
Cloud Cost Optimization Whitepaper
 
Webinar: Accelerate Your Cloud Business With CloudHealth
Webinar: Accelerate Your Cloud Business With CloudHealthWebinar: Accelerate Your Cloud Business With CloudHealth
Webinar: Accelerate Your Cloud Business With CloudHealth
 
Cloud Migration Workshop
Cloud Migration WorkshopCloud Migration Workshop
Cloud Migration Workshop
 
AWS Financial Governance Practice
AWS Financial Governance Practice AWS Financial Governance Practice
AWS Financial Governance Practice
 
Chicago FinOps Meet-Up - 11.19.2019
Chicago FinOps Meet-Up - 11.19.2019Chicago FinOps Meet-Up - 11.19.2019
Chicago FinOps Meet-Up - 11.19.2019
 
Cost Star Ratings to score team's AWS optimization at Morningstar" - Katelyn ...
Cost Star Ratings to score team's AWS optimization at Morningstar" - Katelyn ...Cost Star Ratings to score team's AWS optimization at Morningstar" - Katelyn ...
Cost Star Ratings to score team's AWS optimization at Morningstar" - Katelyn ...
 
FinOps@SC CH-Meetup.pdf
FinOps@SC CH-Meetup.pdfFinOps@SC CH-Meetup.pdf
FinOps@SC CH-Meetup.pdf
 
Introducing Amazon EKS
Introducing Amazon EKSIntroducing Amazon EKS
Introducing Amazon EKS
 
Big Data Analytics Architectural Patterns and Best Practices (ANT201-R1) - AW...
Big Data Analytics Architectural Patterns and Best Practices (ANT201-R1) - AW...Big Data Analytics Architectural Patterns and Best Practices (ANT201-R1) - AW...
Big Data Analytics Architectural Patterns and Best Practices (ANT201-R1) - AW...
 
Kubernetes on AWS with Amazon EKS - MAD301 - New York AWS Summit
Kubernetes on AWS with Amazon EKS - MAD301 - New York AWS SummitKubernetes on AWS with Amazon EKS - MAD301 - New York AWS Summit
Kubernetes on AWS with Amazon EKS - MAD301 - New York AWS Summit
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
ENT204 The AWS Cloud Value Framework
ENT204 The AWS Cloud Value FrameworkENT204 The AWS Cloud Value Framework
ENT204 The AWS Cloud Value Framework
 
Introduction to AWS Cost Management
Introduction to AWS Cost ManagementIntroduction to AWS Cost Management
Introduction to AWS Cost Management
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
Cloud Migration, Application Modernization and Security for Partners
Cloud Migration, Application Modernization and Security for PartnersCloud Migration, Application Modernization and Security for Partners
Cloud Migration, Application Modernization and Security for Partners
 
12 Ways to Manage Cloud Costs and Optimize Cloud Spend
12 Ways to Manage Cloud Costs and Optimize Cloud Spend12 Ways to Manage Cloud Costs and Optimize Cloud Spend
12 Ways to Manage Cloud Costs and Optimize Cloud Spend
 
Cloud Migration: A How-To Guide
Cloud Migration: A How-To GuideCloud Migration: A How-To Guide
Cloud Migration: A How-To Guide
 
Migrating Databases to the Cloud: Introduction to AWS DMS - SRV215 - Chicago ...
Migrating Databases to the Cloud: Introduction to AWS DMS - SRV215 - Chicago ...Migrating Databases to the Cloud: Introduction to AWS DMS - SRV215 - Chicago ...
Migrating Databases to the Cloud: Introduction to AWS DMS - SRV215 - Chicago ...
 

Similar to FinOps introduction

Hybrid Cloud Integration - Connecting Taleo Enterprise Edition With E-Busines...
Hybrid Cloud Integration - Connecting Taleo Enterprise Edition With E-Busines...Hybrid Cloud Integration - Connecting Taleo Enterprise Edition With E-Busines...
Hybrid Cloud Integration - Connecting Taleo Enterprise Edition With E-Busines...
Kyle Lambert
 
FORCES - EBS Upgrade Compared to SaaS Cloud.pdf
FORCES - EBS Upgrade Compared to SaaS Cloud.pdfFORCES - EBS Upgrade Compared to SaaS Cloud.pdf
FORCES - EBS Upgrade Compared to SaaS Cloud.pdf
JacobYeboa1
 
2014-09-23 Best of Breed Cloud Based Accounting System Seminar
2014-09-23 Best of Breed Cloud Based Accounting System Seminar2014-09-23 Best of Breed Cloud Based Accounting System Seminar
2014-09-23 Best of Breed Cloud Based Accounting System Seminar
Raffa Learning Community
 

Similar to FinOps introduction (20)

Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About NowPrepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
 
Enterprise Cloud Strategy: 7 Areas You Need to Re-Think
Enterprise Cloud Strategy: 7 Areas You Need to Re-ThinkEnterprise Cloud Strategy: 7 Areas You Need to Re-Think
Enterprise Cloud Strategy: 7 Areas You Need to Re-Think
 
Why Business is Better in the Cloud
Why Business is Better in the CloudWhy Business is Better in the Cloud
Why Business is Better in the Cloud
 
Agile DevOps Transformation Strategy
Agile DevOps Transformation StrategyAgile DevOps Transformation Strategy
Agile DevOps Transformation Strategy
 
The Changing Role of IT: From Service Managers to Advisors
The Changing Role of IT:From Service Managers to AdvisorsThe Changing Role of IT:From Service Managers to Advisors
The Changing Role of IT: From Service Managers to Advisors
 
Bring Down Costs by Controlling Cloud Capacity
Bring Down Costs by Controlling Cloud Capacity Bring Down Costs by Controlling Cloud Capacity
Bring Down Costs by Controlling Cloud Capacity
 
ROI and Economic Value of Data Virtualization
ROI and Economic Value of Data VirtualizationROI and Economic Value of Data Virtualization
ROI and Economic Value of Data Virtualization
 
Softchoice Discovery Series: Cloud Cost Governance
Softchoice Discovery Series: Cloud Cost GovernanceSoftchoice Discovery Series: Cloud Cost Governance
Softchoice Discovery Series: Cloud Cost Governance
 
How To Position Cloud
How To Position CloudHow To Position Cloud
How To Position Cloud
 
A Framework to Measure and Maximize Cloud ROI
A Framework to Measure and Maximize Cloud ROIA Framework to Measure and Maximize Cloud ROI
A Framework to Measure and Maximize Cloud ROI
 
Quick App Flow
Quick App FlowQuick App Flow
Quick App Flow
 
Hybrid Cloud Integration - Connecting Taleo Enterprise Edition With E-Busines...
Hybrid Cloud Integration - Connecting Taleo Enterprise Edition With E-Busines...Hybrid Cloud Integration - Connecting Taleo Enterprise Edition With E-Busines...
Hybrid Cloud Integration - Connecting Taleo Enterprise Edition With E-Busines...
 
Pivoting to Cloud: How an MSP Brokers Cloud Services
Pivoting to Cloud: How an MSP Brokers Cloud Services Pivoting to Cloud: How an MSP Brokers Cloud Services
Pivoting to Cloud: How an MSP Brokers Cloud Services
 
Great Lakes Oracle Conference (GLOC) Benefits of migrating to the Cloud- Me...
Great Lakes Oracle Conference (GLOC)  Benefits of migrating to the Cloud-  Me...Great Lakes Oracle Conference (GLOC)  Benefits of migrating to the Cloud-  Me...
Great Lakes Oracle Conference (GLOC) Benefits of migrating to the Cloud- Me...
 
FORCES - EBS Upgrade Compared to SaaS Cloud.pdf
FORCES - EBS Upgrade Compared to SaaS Cloud.pdfFORCES - EBS Upgrade Compared to SaaS Cloud.pdf
FORCES - EBS Upgrade Compared to SaaS Cloud.pdf
 
Configuration Management is Old and Boring
Configuration Management is Old and BoringConfiguration Management is Old and Boring
Configuration Management is Old and Boring
 
Patching is Your Friend in the New World Order of EPM and ERP Cloud
Patching is Your Friend in the New World Order of EPM and ERP CloudPatching is Your Friend in the New World Order of EPM and ERP Cloud
Patching is Your Friend in the New World Order of EPM and ERP Cloud
 
2014-09-23 Best of Breed Cloud Based Accounting System Seminar
2014-09-23 Best of Breed Cloud Based Accounting System Seminar2014-09-23 Best of Breed Cloud Based Accounting System Seminar
2014-09-23 Best of Breed Cloud Based Accounting System Seminar
 
Optimizing your cloud
Optimizing your cloudOptimizing your cloud
Optimizing your cloud
 
Evaluating the Cloud
Evaluating the CloudEvaluating the Cloud
Evaluating the Cloud
 

More from Alexander Tokarev

More from Alexander Tokarev (20)

Rate limits and all about
Rate limits and all aboutRate limits and all about
Rate limits and all about
 
rnd teams.pptx
rnd teams.pptxrnd teams.pptx
rnd teams.pptx
 
FinOps for private cloud
FinOps for private cloudFinOps for private cloud
FinOps for private cloud
 
Graph ql and enterprise
Graph ql and enterpriseGraph ql and enterprise
Graph ql and enterprise
 
Open Policy Agent for governance as a code
Open Policy Agent for governance as a code Open Policy Agent for governance as a code
Open Policy Agent for governance as a code
 
Relational databases for BigData
Relational databases for BigDataRelational databases for BigData
Relational databases for BigData
 
Cloud DWH deep dive
Cloud DWH deep diveCloud DWH deep dive
Cloud DWH deep dive
 
Cloud dwh
Cloud dwhCloud dwh
Cloud dwh
 
P9 speed of-light faceted search via oracle in-memory option by alexander tok...
P9 speed of-light faceted search via oracle in-memory option by alexander tok...P9 speed of-light faceted search via oracle in-memory option by alexander tok...
P9 speed of-light faceted search via oracle in-memory option by alexander tok...
 
Row Level Security in databases advanced edition
Row Level Security in databases advanced editionRow Level Security in databases advanced edition
Row Level Security in databases advanced edition
 
Row level security in enterprise applications
Row level security in enterprise applicationsRow level security in enterprise applications
Row level security in enterprise applications
 
Inmemory BI based on opensource stack
Inmemory BI based on opensource stackInmemory BI based on opensource stack
Inmemory BI based on opensource stack
 
Oracle InMemory hardcore edition
Oracle InMemory hardcore editionOracle InMemory hardcore edition
Oracle InMemory hardcore edition
 
Tagging search solution design Advanced edition
Tagging search solution design Advanced editionTagging search solution design Advanced edition
Tagging search solution design Advanced edition
 
Faceted search with Oracle InMemory option
Faceted search with Oracle InMemory optionFaceted search with Oracle InMemory option
Faceted search with Oracle InMemory option
 
Oracle JSON treatment evolution - from 12.1 to 18 AOUG-2018
Oracle JSON treatment evolution - from 12.1 to 18 AOUG-2018Oracle JSON treatment evolution - from 12.1 to 18 AOUG-2018
Oracle JSON treatment evolution - from 12.1 to 18 AOUG-2018
 
Tagging search solution design
Tagging search solution designTagging search solution design
Tagging search solution design
 
Oracle JSON internals advanced edition
Oracle JSON internals advanced editionOracle JSON internals advanced edition
Oracle JSON internals advanced edition
 
Oracle Result Cache deep dive
Oracle Result Cache deep diveOracle Result Cache deep dive
Oracle Result Cache deep dive
 
Oracle result cache highload 2017
Oracle result cache highload 2017Oracle result cache highload 2017
Oracle result cache highload 2017
 

Recently uploaded

TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
mohitmore19
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
VishalKumarJha10
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 

Recently uploaded (20)

Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students
 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with Precision
 
VTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnVTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learn
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
 
How to Choose the Right Laravel Development Partner in New York City_compress...
How to Choose the Right Laravel Development Partner in New York City_compress...How to Choose the Right Laravel Development Partner in New York City_compress...
How to Choose the Right Laravel Development Partner in New York City_compress...
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 

FinOps introduction

  • 1. "Где деньги, Лебовски?", или Почему пора перейти на FinOps Журов Павел Токарев Александр
  • 2. Who we are Alex Tokarev Head of RnD Platform V Sberbank – platformv.sber.ru AWS and GCP expert The man who cares about money Pavel Zhurov Senior Cloud Engineer at VTB Kubernetes security nerd For God’s sake, be careful with hostPath in production 2
  • 3. What not about • Particular provider optimizations • In-house money • Application refactoring approach But FinOps works there as well 3
  • 4. What about • What is FinOps • What for • FinOps stakeholders • Allocation approach • SDLC demo • Maturity level • Q&A 4
  • 5. What is cloud • On-demand • Scalable • Self-service 5
  • 6. DevOps “DevOps” is a movement that advocates: 1. A collaborative working relationship between development and IT operations 2. Fast flow of planned work 3. High reliability, stability, resilience, and security of the production environment 6
  • 7. Cloud pains • Financial decisions moved out form finance to engineers • Unexpected bills at the end of month • Huge files with billing data • Unclear charges with micro-amounts • Each provider has vendor-specific vocabulary • Each provider has unique billing files structure • IT department requests more and more cloud services 7
  • 8. Big figures case 1. Company spends $875,387 for cloud each month 2. Proper spending? 3. Is $20,000/month cost optimization big enough? 8
  • 9. Outliers and big figures hybrid case • Company spends $874,387 for GCP per month • A team purchases GPU server, which costs $5,000/month for a new NN test • The team forgets to switch it off • Nobody will notice – 879 387 vs 875 387 9
  • 10. Fake economy case • Team A switches off server X each night because they use the server for real-time tasks during working hours • Team B switches off server Y each day because they use the server for batch tasks during non-working hours • Both think that they make cost-efficient decision Just buy RI server, share it and get 20% discount! 10
  • 14. More cloud pains • No visibility for spends • Overprovisioning • No trust in IT department • Budgeting cycle is complicated • Financial department has full control over cloud spends and should approve each request • No on-demand infrastructure and on-demand spend No enough speed – old approach irrelevant! 14
  • 15. Decision 1. Operate at near-realtime 2. Eliminate monthly or quarterly spend reviews 3. Encourage finance and IT departments to work in harmony 15
  • 16. FinOps Near real time reporting + Just-in-time processes + IT and finance teams work together + Shared cloud dictionary = FinOps + Trust = Balance between speed of changes, availability of services and cloud costs 16
  • 17. 17
  • 19. Why developers don’t like FinOps • They never thought about money • Constant pressure to deliver more and more features • Cloud spends are not features – someone else’s job • Top management doesn’t articulate cost reduction as goal • They have never seen a cloud bill 19
  • 20. Why developers need it • Clear picture of spends – you can use more managed services • Proven efficiency – more robust reserved instances could be purchased • More robust resources – more features with less efforts • Money questions will arise at any case so let’s do it in cloud native fashion • Cool stuff in CV  20
  • 21. How to encourage • Rightsizing (not cost reduction!) should be a target for every team • Provide a visibility of each team spends – teams should have an option for benchmarking • Just ask to help business • Explain FinOps not about cutting resources, but accountability • Always estimate efforts of implementing savings: 3 hours of engineer can save 10000 USD – cool 3 hours of engineer can save 100 USD – bad It solves big figure issue as well Soft skills 21
  • 22. Why CTO needs it • Benchmark against industry • Cloud spend limits could become less strict • More money saved – more additional headcount or team salary’s cap • Proven value of tech and cloud investments • Establishing completive advantage • Improved time-to-market FinOps centralized team should close to CTO!!! 22
  • 23. Why finance needs it • More precise spending forecast • Overspending risks mitigation • More clear understanding of the overall cloud efficiency • Actual revenue per spent money • Figures to negotiate with cloud vendors • Cap for cloud reservation plans 23
  • 24. FinOps implementation plan - IT • Extract consumption data for compute from: • Billing files • Cloud API • Allocate shared resources to teams • Tagging • Internal metrics • Find idle resources • Introduce Cloud-native FinOps tools • Implement recommendations system • Implement API-based decommissioning • Implement AI-based outliers detection Initial stage True real-time management management + teams teams Intra company FinOps visibility teams teams 24
  • 25. Cloud native FinOps • New mandatory endpoint - /consumption • Money consumption via Prometheus exposition format • Budget control – standard cloud native monitoring tools • Money-related tests in CI/CD • Agile-related tags: tribe/team/product/ • Per-second consumption calculation 25
  • 26. OpenSource cloud-native tooling Start from Task Tool Profit Storage Prometheus VictoriaMetrics Long-term consumption data storage Real-time compute management Keda Zalando kube-metrics-adapter Scale up/scale down Tagging enforcement Open Policy Agent Resource allocation Alerting Prometheus Alert Manager Outlier notifications Reporting and dashboards Grafana Price analytics Idle identification Goldilocks Orphan compute tasks Containers analytics Kubecost Shared compute allocation 26 Chargeback policy in CI/CD Argo-rollouts Consumption-based rollbacks
  • 28. Cost allocation • The process of splitting up a cloud bill and associating the costs to each cost center dimension • Allocation gaps must be shared between all teams • Takes into account all cloud services: compute, storage, network, etc. • Could be achieved by: • Internal price metrics - teams calculate dependent services consumption • Tagging – FinOps platform calculates metrics 28
  • 29. Internal metrics • A dedicated /price or /money or /consumption endpoint • Timeseries data • {tenant: <>, price_unit: <>, value: <>} • Perfect for multi-tenant services 29
  • 30. Internal metrics issues • State should be stored somewhere • Normalization for many replicas services • Services restart • Teams are reluctant to care about price metrics 30
  • 31. Tagging • Folksonomy • Set of words to describe a resource • Self-explaining • About IT and finance • Perfect for multi-instance services 31
  • 32. Tagging issues • Too verbose • Typos • Engineers tags not aligned with business tags • Not all cloud products have tags Example: API gateway endpoint, DB in RDS • No options to use for multi-tenant products 32
  • 33. Suggested tags Business department which business unit could be charged Service which cost center drives spendings Team how much cost a team efforts in cloud Name what’s a name of a component Front/Back what is ratio between back and front Answered question Performance metrics for company: Team vs Team Department vs Department Tag 33
  • 34. Suggested tags Answered question Tag Tags are prohibited - they are for allocation only – not access control! Security-related Use cloud project/account level! 34 Prod/Test/Dev which costs are nonproduction and safe to turn off?
  • 35. Tagging • Not more 6 tags • Be careful with typos • Enforce mandatory tagging via automation • Dedicated tags set for FinOps 35
  • 36. Recommendation system • Should be on regular basis by email reports - showback • Should be on regular basis via ticketing system for developers • Should be taken in priority for a next sprint • A way to get rid of engineer offence – it’s not me – it is JIRA • A source for statistics: • Recommendation count per release • How many gave actual money savings • How many were ignored • What is average time to be taken in a sprint • How many teams use recommendations Recommendation discussion – it is a chance Soft skill next level  36
  • 37. Ticketing recommendations By tickets to IT about usage reduction by: - decommission resources - rightsizing - more expensive flavors but packed by many extra workloads - serverless services By tickets to finance by: - rate reduction by commercial agreement - reserved instances IT is happy – finance will struggle from tickets as well 37
  • 38. FinOps implementation plan - Management • Introduce FinOps approach • Implement FinOps for multi-instance services • Implement FinOps for multi-tenant services • Create finance and IT dashboards • Start teams showback-ing • Create cost allocation dashboards and cost optimization learning materials • Introduce chargeback • Create top-management dashboards 38
  • 39. xBack Showback reports - show teams what they are spending, but money are allocated internally from a central budget Chargeback reports - show teams what they are spending and money are consumed internally from a team budget 39
  • 40. Where to hire Nobody knows so you must foster in your team! A person who is happy with cloud but ready for fiscal and business thinking + Decent soft skills level 40
  • 42. FinOps maturity level Idle/underutilized resources removal Quarterly based manual Monthly based manual Daily AI based via API Automation approach Spreadsheets macros Scripts for notifications API-based cloud automation Optimization approach No Idle removing Software refactoring Reserved instances Idle removing Rightsizing Software refactoring Notification approach By emails from finance Emails from FinOps team Price dashboard for an application Tickets in tracking system Price dashboard per service Allocation awareness No Showback reports Chargeback information Teams budget No budget Budget in not real money Budget in real money Allocation approach No allocation Cloud provider accounts Tagging and metrics Data retention Mailbox lifetime Limited granular data Unlimited full dataset Cost awareness timing Quarterly Monthly Near-real time Before FinOps Level 1 Level 2 Cost extraction approach Vendor invoices manual reconciliation Automatic vendor invoices reconciliation API-based reconciliation 42
  • 43. What is cloud • On-demand • Scalable • Self-service • Measurable 43
  • 44. FinOps “FinOps” is a movement that advocates: 1. a collaborative working relationship between DevOps and Finance data-driven management of infrastructure spending 2. Transparency between IT and finance 3. Cost efficiency, profitability and product delivery pace 44
  • 45. Risks • Reducing spend at the cost of innovation or at the cost of impacting an important project • Recommendations don’t consider spikes in utilization • Forgetting about disaster recovery overprovisioning • Failing to rightsize beyond compute – databases, API gateways, etc. • Too many reserved instances • Neglecting very small savings – forgot to multiply by 365 Beware stubborn FinOps! 45
  • 46. Conclusion • FinOps is feasible with opensource technologies • Encourage ownership of each teams to govern cloud usage • Decentralize reduction of usage to engineers • Centralizing reduction of spendings to finance • FinOps is not only software and money – it is about soft skills • FinOps is not about saving money - FinOps is about making money 46

Editor's Notes

  1. Сюда бы фоточку адского файла с биллингом амазона
  2. Пример где много ресурсов и одна команда заказывает сервер на 5000 usd
  3. For instance, one team may have high resource usage during the day while another has high resource usage during the night. Based on their usage, it probably doesn’t make sense for either team to commit to RIs individually. But overall, there’s a consistent base of resources running across the 24-hour period. The central team identifies the opportunity to commit to a reservation and save both teams on the rate they pay for resources.
  4. Зачем кому нужен финопс
  5. Зачем кому нужен финопс
  6. Зачем кому нужен финопс
  7. Зачем кому нужен финопс
  8. Зачем кому нужен финопс
  9. Акцентировать, что рекомендации очень дают визибилити
  10. Сказать зачем price unit – для сложных продуктов, где цена за несколько а-ля s3
  11. Тут картиночку с инстаграмма
  12. Тут принтскрин с hh.ru
  13. 103