SlideShare uma empresa Scribd logo
1 de 21
Setting up an Optimisation Function
Aliur Rahman
Head of Digital Optimisation & Personalisation
Digital Analytics
Digital Optimisation
Personalisation
Experian UK PLC
• Free Score (CreditMatcher)
• CreditExpert
• Comparison
Digital transformation
• From Technology to Customer Services, from Product to Marketing
The brief
• Set up an Optimisation function in London
• Create a culture of test and learn (fail fast, learn quick)
• Bridge relationship between Marketing and Technology
TECHNOLOGY PROCESSES PEOPLE
• Process was substandard
• No real governance in place
• Silo optimisation roadmap
• No frameworks or centralisation
• Decent Optimisation tool
• No building out of capability
• Old version being used
• No integration
• Silo Optimisation teams
• No technical people in London
• Skillset gap in Optimisation
OPERATIONAL
• Pushing 2-3 tests a month
• No delivery management
• No Targeting/personalisation
Optimisation before
Senior
Leadership
Team Buy-In
7 step process to setting up an Optimisation function
1. DEVELOP OPTIMISATION STRATEGY
• Plan for next 12 months
• Technology
• Process & Governance
• People & Operating Model
• Culture
• Personalisation
7 step process to setting up an Optimisation function
1. DEVELOP OPTIMISATION STRATEGY
2. BUILD OPTIMISATION TEAM
• Identify roles and skill set required
• Hire people in London (Contractors)
• Train and Equip
7 step process to setting up an Optimisation function
1. DEVELOP OPTIMISATION STRATEGY
2. BUILD OPTIMISATION TEAM
3. PUT IN PLACE PROCESS
• Agree and establish process
• Establish agile delivery method (KANBAN)
• Centralise assets and communication
• Put in place Steerco and governance
Business Kanban Board
Technical Kanban Board
JIRA Kanban boards for Optimisation delivery
Centrally hosted assets for Optimisation efficiency
Centralised briefing process in Confluence
Agreed and established process in Blueworks
7 step process to setting up an Optimisation function
1. DEVELOP OPTIMISATION STRATEGY
2. BUILD OPTIMISATION TEAM
3. PUT IN PLACE PROCESS
4. EXECUTE
• Run team using daily stand ups
• Work closely with business owners
• Build, configure and push test live
• Communicate to SLT
7 step process to setting up an Optimisation function
1. DEVELOP OPTIMISATION STRATEGY
2. BUILD OPTIMISATION TEAM
3. PUT IN PLACE PROCESS
4. EXECUTE
5. MEASURE, REPORT & VALIDATE
• Track velocity
• Track and report number of tests completed
• Prove that the Optimisation team was
successful
7 step process to setting up an Optimisation function
1. DEVELOP OPTIMISATION STRATEGY
2. BUILD OPTIMISATION TEAM
3. PUT IN PLACE PROCESS
4. EXECUTE
5. MEASURE, REPORT & VALIDATE
6. TRANSITION
• Replace contractors with permanent team
• Widen scope of digital development
• Build close relationship between
Marketing and Technology
7 step process to setting up an Optimisation function
1. DEVELOP OPTIMISATION STRATEGY
2. BUILD OPTIMISATION TEAM
3. PUT IN PLACE PROCESS
4. EXECUTE
5. MEASURE, REPORT & VALIDATE
6. TRANSITION
7. BAU
• Continue to produce tests
• Align with technology team for wider work
• Put in amends to processes
TECHNOLOGY PROCESSES PEOPLE
• Process established and aligned
• Governance & steerco in place
• Centralisation of assets
• KANBAN delivery method
• Technical support from
Vendor
• Building out of capability to
include Personalisation
• Set up three new functions
• Well organised team in London
• Relevant technical skillset
• One team under the same place
OPERATIONAL
• Pushing 15-20 tests a month
• Contributed to increasing
overall site conversion by
80%
Optimisation after
Small and nimble operation in a
large and complex environment
Establishing a digital first culture
Transition and
embed team Personalisation
Mobile App
Optimisation
Establish a
Testing Culture
Thank you for listening
Questions?

Mais conteúdo relacionado

Mais procurados

Top 5 Tips to Increase Field Service Technician Utilization
Top 5 Tips to Increase Field Service Technician UtilizationTop 5 Tips to Increase Field Service Technician Utilization
Top 5 Tips to Increase Field Service Technician UtilizationServiceMax
 
Portals for Field Serivce: Your Secret to Success With Partners and Customers
Portals for Field Serivce: Your Secret to Success With Partners and CustomersPortals for Field Serivce: Your Secret to Success With Partners and Customers
Portals for Field Serivce: Your Secret to Success With Partners and CustomersServiceMax
 
Aen010 Stroka 091907
Aen010 Stroka 091907Aen010 Stroka 091907
Aen010 Stroka 091907Dreamforce07
 
Web analytics process
Web analytics processWeb analytics process
Web analytics processbduverneuil
 
Gartner Digital Marketing Conference 2016: Theater Session (C. Slovak)
Gartner Digital Marketing Conference 2016: Theater Session (C. Slovak) Gartner Digital Marketing Conference 2016: Theater Session (C. Slovak)
Gartner Digital Marketing Conference 2016: Theater Session (C. Slovak) Tealium
 
Breaking down data the value of data (agency perspective) - presented by An...
Breaking down data   the value of data (agency perspective) - presented by An...Breaking down data   the value of data (agency perspective) - presented by An...
Breaking down data the value of data (agency perspective) - presented by An...Angelina Eng
 
Jamie Brighton - Personalization Spectrum
Jamie Brighton - Personalization SpectrumJamie Brighton - Personalization Spectrum
Jamie Brighton - Personalization SpectrumMezzo Labs
 
Scout Marketing One Pager
Scout Marketing One PagerScout Marketing One Pager
Scout Marketing One PagerSean Reed
 
7 Ways to Amp Up Your Service Culture and Drive Revenue
7 Ways to Amp Up Your Service Culture and Drive Revenue7 Ways to Amp Up Your Service Culture and Drive Revenue
7 Ways to Amp Up Your Service Culture and Drive RevenueServiceMax
 
How to Take Control of your Employee 360 Process
How to Take Control of your Employee 360 ProcessHow to Take Control of your Employee 360 Process
How to Take Control of your Employee 360 ProcessQualtrics
 
Digital Transformation Journey
Digital Transformation JourneyDigital Transformation Journey
Digital Transformation Journeykannancr
 
Empired Convergence 2017 - Keeping Pace, Staying Safe in the Digital World
Empired Convergence 2017 - Keeping Pace, Staying Safe in the Digital WorldEmpired Convergence 2017 - Keeping Pace, Staying Safe in the Digital World
Empired Convergence 2017 - Keeping Pace, Staying Safe in the Digital WorldEmpired
 
Oracle eloqua ad focus overview
Oracle eloqua ad focus overviewOracle eloqua ad focus overview
Oracle eloqua ad focus overviewAdCMO
 
Convergytics - Data Management, Reporting & Visualization Capabilities
Convergytics - Data Management, Reporting & Visualization CapabilitiesConvergytics - Data Management, Reporting & Visualization Capabilities
Convergytics - Data Management, Reporting & Visualization CapabilitiesRandhir Hebbar
 
Day In the Life of a Field Service Manager: Dashboards Are My Co-Pilot
Day In the Life of a Field Service Manager: Dashboards Are My Co-PilotDay In the Life of a Field Service Manager: Dashboards Are My Co-Pilot
Day In the Life of a Field Service Manager: Dashboards Are My Co-PilotServiceMax
 
Gray Matrix Solutions Pvt. Ltd
Gray Matrix Solutions Pvt. LtdGray Matrix Solutions Pvt. Ltd
Gray Matrix Solutions Pvt. LtdBhavika Patel
 
Omc value proposition
Omc value propositionOmc value proposition
Omc value propositionEloquademo
 
Qualtrics - Salesforce Integration for SFDC MVPs
Qualtrics - Salesforce Integration for SFDC MVPsQualtrics - Salesforce Integration for SFDC MVPs
Qualtrics - Salesforce Integration for SFDC MVPsQualtrics
 
Data & Analytics: The Competitive Edge for Small and Midsize Businesses
Data & Analytics: The Competitive Edge for Small and Midsize BusinessesData & Analytics: The Competitive Edge for Small and Midsize Businesses
Data & Analytics: The Competitive Edge for Small and Midsize BusinessesSAP Analytics
 
Convergytics capabilites and profile
Convergytics capabilites and profileConvergytics capabilites and profile
Convergytics capabilites and profileSantosh Atre
 

Mais procurados (20)

Top 5 Tips to Increase Field Service Technician Utilization
Top 5 Tips to Increase Field Service Technician UtilizationTop 5 Tips to Increase Field Service Technician Utilization
Top 5 Tips to Increase Field Service Technician Utilization
 
Portals for Field Serivce: Your Secret to Success With Partners and Customers
Portals for Field Serivce: Your Secret to Success With Partners and CustomersPortals for Field Serivce: Your Secret to Success With Partners and Customers
Portals for Field Serivce: Your Secret to Success With Partners and Customers
 
Aen010 Stroka 091907
Aen010 Stroka 091907Aen010 Stroka 091907
Aen010 Stroka 091907
 
Web analytics process
Web analytics processWeb analytics process
Web analytics process
 
Gartner Digital Marketing Conference 2016: Theater Session (C. Slovak)
Gartner Digital Marketing Conference 2016: Theater Session (C. Slovak) Gartner Digital Marketing Conference 2016: Theater Session (C. Slovak)
Gartner Digital Marketing Conference 2016: Theater Session (C. Slovak)
 
Breaking down data the value of data (agency perspective) - presented by An...
Breaking down data   the value of data (agency perspective) - presented by An...Breaking down data   the value of data (agency perspective) - presented by An...
Breaking down data the value of data (agency perspective) - presented by An...
 
Jamie Brighton - Personalization Spectrum
Jamie Brighton - Personalization SpectrumJamie Brighton - Personalization Spectrum
Jamie Brighton - Personalization Spectrum
 
Scout Marketing One Pager
Scout Marketing One PagerScout Marketing One Pager
Scout Marketing One Pager
 
7 Ways to Amp Up Your Service Culture and Drive Revenue
7 Ways to Amp Up Your Service Culture and Drive Revenue7 Ways to Amp Up Your Service Culture and Drive Revenue
7 Ways to Amp Up Your Service Culture and Drive Revenue
 
How to Take Control of your Employee 360 Process
How to Take Control of your Employee 360 ProcessHow to Take Control of your Employee 360 Process
How to Take Control of your Employee 360 Process
 
Digital Transformation Journey
Digital Transformation JourneyDigital Transformation Journey
Digital Transformation Journey
 
Empired Convergence 2017 - Keeping Pace, Staying Safe in the Digital World
Empired Convergence 2017 - Keeping Pace, Staying Safe in the Digital WorldEmpired Convergence 2017 - Keeping Pace, Staying Safe in the Digital World
Empired Convergence 2017 - Keeping Pace, Staying Safe in the Digital World
 
Oracle eloqua ad focus overview
Oracle eloqua ad focus overviewOracle eloqua ad focus overview
Oracle eloqua ad focus overview
 
Convergytics - Data Management, Reporting & Visualization Capabilities
Convergytics - Data Management, Reporting & Visualization CapabilitiesConvergytics - Data Management, Reporting & Visualization Capabilities
Convergytics - Data Management, Reporting & Visualization Capabilities
 
Day In the Life of a Field Service Manager: Dashboards Are My Co-Pilot
Day In the Life of a Field Service Manager: Dashboards Are My Co-PilotDay In the Life of a Field Service Manager: Dashboards Are My Co-Pilot
Day In the Life of a Field Service Manager: Dashboards Are My Co-Pilot
 
Gray Matrix Solutions Pvt. Ltd
Gray Matrix Solutions Pvt. LtdGray Matrix Solutions Pvt. Ltd
Gray Matrix Solutions Pvt. Ltd
 
Omc value proposition
Omc value propositionOmc value proposition
Omc value proposition
 
Qualtrics - Salesforce Integration for SFDC MVPs
Qualtrics - Salesforce Integration for SFDC MVPsQualtrics - Salesforce Integration for SFDC MVPs
Qualtrics - Salesforce Integration for SFDC MVPs
 
Data & Analytics: The Competitive Edge for Small and Midsize Businesses
Data & Analytics: The Competitive Edge for Small and Midsize BusinessesData & Analytics: The Competitive Edge for Small and Midsize Businesses
Data & Analytics: The Competitive Edge for Small and Midsize Businesses
 
Convergytics capabilites and profile
Convergytics capabilites and profileConvergytics capabilites and profile
Convergytics capabilites and profile
 

Destaque

Steve Keightley, Head of Optimisation, Mezzo Labs - Data-Driven Optimisation
Steve Keightley, Head of Optimisation, Mezzo Labs - Data-Driven OptimisationSteve Keightley, Head of Optimisation, Mezzo Labs - Data-Driven Optimisation
Steve Keightley, Head of Optimisation, Mezzo Labs - Data-Driven OptimisationMezzo Labs
 
Alex Gallagher, Future Finance - Targeting Audiences Wherever They Are
Alex Gallagher, Future Finance - Targeting Audiences Wherever They AreAlex Gallagher, Future Finance - Targeting Audiences Wherever They Are
Alex Gallagher, Future Finance - Targeting Audiences Wherever They AreMezzo Labs
 
Adrian Kingwell, Mezzo Labs - App Analytics
Adrian Kingwell, Mezzo Labs - App AnalyticsAdrian Kingwell, Mezzo Labs - App Analytics
Adrian Kingwell, Mezzo Labs - App AnalyticsMezzo Labs
 
Andy Walker - Creating Order from Chaos - Integrating Online with Offline (In...
Andy Walker - Creating Order from Chaos - Integrating Online with Offline (In...Andy Walker - Creating Order from Chaos - Integrating Online with Offline (In...
Andy Walker - Creating Order from Chaos - Integrating Online with Offline (In...Mezzo Labs
 
Adrian kingwell, Mezzo Labs - Making Data Personal
Adrian kingwell, Mezzo Labs - Making Data PersonalAdrian kingwell, Mezzo Labs - Making Data Personal
Adrian kingwell, Mezzo Labs - Making Data PersonalMezzo Labs
 
Analytics Horror Stories - BrightonSEO 2016
Analytics Horror Stories - BrightonSEO 2016Analytics Horror Stories - BrightonSEO 2016
Analytics Horror Stories - BrightonSEO 2016Anna Lewis
 

Destaque (6)

Steve Keightley, Head of Optimisation, Mezzo Labs - Data-Driven Optimisation
Steve Keightley, Head of Optimisation, Mezzo Labs - Data-Driven OptimisationSteve Keightley, Head of Optimisation, Mezzo Labs - Data-Driven Optimisation
Steve Keightley, Head of Optimisation, Mezzo Labs - Data-Driven Optimisation
 
Alex Gallagher, Future Finance - Targeting Audiences Wherever They Are
Alex Gallagher, Future Finance - Targeting Audiences Wherever They AreAlex Gallagher, Future Finance - Targeting Audiences Wherever They Are
Alex Gallagher, Future Finance - Targeting Audiences Wherever They Are
 
Adrian Kingwell, Mezzo Labs - App Analytics
Adrian Kingwell, Mezzo Labs - App AnalyticsAdrian Kingwell, Mezzo Labs - App Analytics
Adrian Kingwell, Mezzo Labs - App Analytics
 
Andy Walker - Creating Order from Chaos - Integrating Online with Offline (In...
Andy Walker - Creating Order from Chaos - Integrating Online with Offline (In...Andy Walker - Creating Order from Chaos - Integrating Online with Offline (In...
Andy Walker - Creating Order from Chaos - Integrating Online with Offline (In...
 
Adrian kingwell, Mezzo Labs - Making Data Personal
Adrian kingwell, Mezzo Labs - Making Data PersonalAdrian kingwell, Mezzo Labs - Making Data Personal
Adrian kingwell, Mezzo Labs - Making Data Personal
 
Analytics Horror Stories - BrightonSEO 2016
Analytics Horror Stories - BrightonSEO 2016Analytics Horror Stories - BrightonSEO 2016
Analytics Horror Stories - BrightonSEO 2016
 

Semelhante a Aliur Rahman, Experian, - Setting up an Optimisation Function

Having a PMO with agile flavor
Having a PMO with agile flavorHaving a PMO with agile flavor
Having a PMO with agile flavorImad Alsadeq
 
Operational Excellence.pptx
Operational Excellence.pptxOperational Excellence.pptx
Operational Excellence.pptxArvindGarg40
 
Simplify Salesforce Testing with AI-Driven Codeless Tools
Simplify Salesforce Testing with AI-Driven Codeless ToolsSimplify Salesforce Testing with AI-Driven Codeless Tools
Simplify Salesforce Testing with AI-Driven Codeless ToolsSauce Labs
 
How to implement operational excellence in organizations
How to implement operational excellence in organizationsHow to implement operational excellence in organizations
How to implement operational excellence in organizationsglobalsevensteps
 
Agile software development that delivers tangible results with Wemanity
Agile software development that delivers tangible results with WemanityAgile software development that delivers tangible results with Wemanity
Agile software development that delivers tangible results with WemanityWemanityUK
 
A New Model for Building Business Process Quality
A New Model for Building Business Process QualityA New Model for Building Business Process Quality
A New Model for Building Business Process QualityWorksoft
 
OpenSymmetry Corporate Presentation
OpenSymmetry Corporate PresentationOpenSymmetry Corporate Presentation
OpenSymmetry Corporate PresentationOpenSymmetry
 
Lean Solutions – Agile Transformation at the United States Postal Service
Lean Solutions  – Agile Transformation at the United States Postal ServiceLean Solutions  – Agile Transformation at the United States Postal Service
Lean Solutions – Agile Transformation at the United States Postal ServiceITSM Academy, Inc.
 
ERPredefined Corporate Profile
ERPredefined Corporate ProfileERPredefined Corporate Profile
ERPredefined Corporate ProfileERPredefined
 
Process innovation & value chain
Process innovation & value chainProcess innovation & value chain
Process innovation & value chaincc85
 
Six sigma control in total quality management copy
Six sigma control in total quality management   copySix sigma control in total quality management   copy
Six sigma control in total quality management copyVijay Vuriti
 
CenturyLink's Game-Changing Strategies for Increasing Project Quality
CenturyLink's Game-Changing Strategies for Increasing Project QualityCenturyLink's Game-Changing Strategies for Increasing Project Quality
CenturyLink's Game-Changing Strategies for Increasing Project QualityWorksoft
 
Implementing Customer Transformation - Melbourne
Implementing Customer Transformation - MelbourneImplementing Customer Transformation - Melbourne
Implementing Customer Transformation - MelbourneMarty Nicholas
 
Align Associate - Analytics Powered Transformation
Align Associate - Analytics Powered TransformationAlign Associate - Analytics Powered Transformation
Align Associate - Analytics Powered TransformationAlign Associate
 
Analytics Powered Transformation - Food & Beverages Sector
Analytics Powered Transformation - Food & Beverages SectorAnalytics Powered Transformation - Food & Beverages Sector
Analytics Powered Transformation - Food & Beverages SectorAlign Associate
 
How to sell Lean & Six sigma, a quick tour guide
How to sell Lean & Six sigma, a quick tour guideHow to sell Lean & Six sigma, a quick tour guide
How to sell Lean & Six sigma, a quick tour guideMichael R. Büchler
 
Sabrion_Consulting_Overview CPG Retail Apparel.pdf
Sabrion_Consulting_Overview CPG Retail Apparel.pdfSabrion_Consulting_Overview CPG Retail Apparel.pdf
Sabrion_Consulting_Overview CPG Retail Apparel.pdfBrion Carroll (II)
 
anuragsaxena_Profile
anuragsaxena_Profileanuragsaxena_Profile
anuragsaxena_ProfileAnurag Saxena
 
Business Process Layout
Business Process LayoutBusiness Process Layout
Business Process LayoutYogesh Satpute
 

Semelhante a Aliur Rahman, Experian, - Setting up an Optimisation Function (20)

Having a PMO with agile flavor
Having a PMO with agile flavorHaving a PMO with agile flavor
Having a PMO with agile flavor
 
Operational Excellence.pptx
Operational Excellence.pptxOperational Excellence.pptx
Operational Excellence.pptx
 
Simplify Salesforce Testing with AI-Driven Codeless Tools
Simplify Salesforce Testing with AI-Driven Codeless ToolsSimplify Salesforce Testing with AI-Driven Codeless Tools
Simplify Salesforce Testing with AI-Driven Codeless Tools
 
How to implement operational excellence in organizations
How to implement operational excellence in organizationsHow to implement operational excellence in organizations
How to implement operational excellence in organizations
 
Agile software development that delivers tangible results with Wemanity
Agile software development that delivers tangible results with WemanityAgile software development that delivers tangible results with Wemanity
Agile software development that delivers tangible results with Wemanity
 
A New Model for Building Business Process Quality
A New Model for Building Business Process QualityA New Model for Building Business Process Quality
A New Model for Building Business Process Quality
 
OpenSymmetry Corporate Presentation
OpenSymmetry Corporate PresentationOpenSymmetry Corporate Presentation
OpenSymmetry Corporate Presentation
 
Lean Solutions – Agile Transformation at the United States Postal Service
Lean Solutions  – Agile Transformation at the United States Postal ServiceLean Solutions  – Agile Transformation at the United States Postal Service
Lean Solutions – Agile Transformation at the United States Postal Service
 
ERPredefined Corporate Profile
ERPredefined Corporate ProfileERPredefined Corporate Profile
ERPredefined Corporate Profile
 
Process innovation & value chain
Process innovation & value chainProcess innovation & value chain
Process innovation & value chain
 
Six sigma control in total quality management copy
Six sigma control in total quality management   copySix sigma control in total quality management   copy
Six sigma control in total quality management copy
 
CenturyLink's Game-Changing Strategies for Increasing Project Quality
CenturyLink's Game-Changing Strategies for Increasing Project QualityCenturyLink's Game-Changing Strategies for Increasing Project Quality
CenturyLink's Game-Changing Strategies for Increasing Project Quality
 
Implementing Customer Transformation - Melbourne
Implementing Customer Transformation - MelbourneImplementing Customer Transformation - Melbourne
Implementing Customer Transformation - Melbourne
 
Align Associate - Analytics Powered Transformation
Align Associate - Analytics Powered TransformationAlign Associate - Analytics Powered Transformation
Align Associate - Analytics Powered Transformation
 
Analytics Powered Transformation - Food & Beverages Sector
Analytics Powered Transformation - Food & Beverages SectorAnalytics Powered Transformation - Food & Beverages Sector
Analytics Powered Transformation - Food & Beverages Sector
 
How to sell Lean & Six sigma, a quick tour guide
How to sell Lean & Six sigma, a quick tour guideHow to sell Lean & Six sigma, a quick tour guide
How to sell Lean & Six sigma, a quick tour guide
 
Sabrion_Consulting_Overview CPG Retail Apparel.pdf
Sabrion_Consulting_Overview CPG Retail Apparel.pdfSabrion_Consulting_Overview CPG Retail Apparel.pdf
Sabrion_Consulting_Overview CPG Retail Apparel.pdf
 
CV_N Srividya_300kb
CV_N Srividya_300kbCV_N Srividya_300kb
CV_N Srividya_300kb
 
anuragsaxena_Profile
anuragsaxena_Profileanuragsaxena_Profile
anuragsaxena_Profile
 
Business Process Layout
Business Process LayoutBusiness Process Layout
Business Process Layout
 

Mais de Mezzo Labs

Consumer not Customer, Value not Revenue, Actions not Numbers - Russell McAthy
Consumer not Customer, Value not Revenue, Actions not Numbers - Russell McAthyConsumer not Customer, Value not Revenue, Actions not Numbers - Russell McAthy
Consumer not Customer, Value not Revenue, Actions not Numbers - Russell McAthyMezzo Labs
 
Attribution Modelling and Blockchain - Peter Prince
Attribution Modelling and Blockchain - Peter PrinceAttribution Modelling and Blockchain - Peter Prince
Attribution Modelling and Blockchain - Peter PrinceMezzo Labs
 
Attribution or Misattribution? How to make digital measurement less awful - N...
Attribution or Misattribution? How to make digital measurement less awful - N...Attribution or Misattribution? How to make digital measurement less awful - N...
Attribution or Misattribution? How to make digital measurement less awful - N...Mezzo Labs
 
What can Artificial Intelligence (AI) offer to Attribution Modelling? - Dimit...
What can Artificial Intelligence (AI) offer to Attribution Modelling? - Dimit...What can Artificial Intelligence (AI) offer to Attribution Modelling? - Dimit...
What can Artificial Intelligence (AI) offer to Attribution Modelling? - Dimit...Mezzo Labs
 
Raoul Lumb, Data Protection Lawyer, Simons Muirhead & Burton - The Letter of Law
Raoul Lumb, Data Protection Lawyer, Simons Muirhead & Burton - The Letter of LawRaoul Lumb, Data Protection Lawyer, Simons Muirhead & Burton - The Letter of Law
Raoul Lumb, Data Protection Lawyer, Simons Muirhead & Burton - The Letter of LawMezzo Labs
 
Lindsay McEwan, VP & MD EMEA, Tealium - The Martech Industry and Your Data - ...
Lindsay McEwan, VP & MD EMEA, Tealium - The Martech Industry and Your Data - ...Lindsay McEwan, VP & MD EMEA, Tealium - The Martech Industry and Your Data - ...
Lindsay McEwan, VP & MD EMEA, Tealium - The Martech Industry and Your Data - ...Mezzo Labs
 
Adrian Kingwell, Managing Director, Mezzo Labs - 350 days to Armageddon
Adrian Kingwell, Managing Director, Mezzo Labs - 350 days to ArmageddonAdrian Kingwell, Managing Director, Mezzo Labs - 350 days to Armageddon
Adrian Kingwell, Managing Director, Mezzo Labs - 350 days to ArmageddonMezzo Labs
 
Lee Suker - What is a DMP
Lee Suker - What is a DMPLee Suker - What is a DMP
Lee Suker - What is a DMPMezzo Labs
 
Increasing Audience Engagement - Chris Moss
Increasing Audience Engagement - Chris MossIncreasing Audience Engagement - Chris Moss
Increasing Audience Engagement - Chris MossMezzo Labs
 
Is personal shopping personal enough yet? - Simon Bloom
Is personal shopping personal enough yet? - Simon BloomIs personal shopping personal enough yet? - Simon Bloom
Is personal shopping personal enough yet? - Simon BloomMezzo Labs
 
Insurance, Customers and Data - Alan Sanderson
Insurance, Customers and Data� - Alan SandersonInsurance, Customers and Data� - Alan Sanderson
Insurance, Customers and Data - Alan SandersonMezzo Labs
 
Richard Ayers - Future of Web Analytics
Richard Ayers - Future of Web AnalyticsRichard Ayers - Future of Web Analytics
Richard Ayers - Future of Web AnalyticsMezzo Labs
 
Measuring websites - Romain Ammar
Measuring websites - Romain AmmarMeasuring websites - Romain Ammar
Measuring websites - Romain AmmarMezzo Labs
 
Measuring off-site traffic - Adrian Kingwell
Measuring off-site traffic - Adrian KingwellMeasuring off-site traffic - Adrian Kingwell
Measuring off-site traffic - Adrian KingwellMezzo Labs
 
Data mining and data visualisation - Lance Nelson
Data mining and data visualisation - Lance NelsonData mining and data visualisation - Lance Nelson
Data mining and data visualisation - Lance NelsonMezzo Labs
 
Analytics. It's not about the numbers - Andrew Scott
Analytics. It's not about the numbers - Andrew ScottAnalytics. It's not about the numbers - Andrew Scott
Analytics. It's not about the numbers - Andrew ScottMezzo Labs
 
A flying lesson, or why it's important to connect KPIs to clear objectives - ...
A flying lesson, or why it's important to connect KPIs to clear objectives - ...A flying lesson, or why it's important to connect KPIs to clear objectives - ...
A flying lesson, or why it's important to connect KPIs to clear objectives - ...Mezzo Labs
 
Analysing Analytics: Exposing the gap in the web analytics labour market - Ad...
Analysing Analytics: Exposing the gap in the web analytics labour market - Ad...Analysing Analytics: Exposing the gap in the web analytics labour market - Ad...
Analysing Analytics: Exposing the gap in the web analytics labour market - Ad...Mezzo Labs
 
A view of the Next Wave of Web Insight - Julian Brewer
A view of the Next Wave of Web Insight -  Julian BrewerA view of the Next Wave of Web Insight -  Julian Brewer
A view of the Next Wave of Web Insight - Julian BrewerMezzo Labs
 
Google Analytics - Threat or Opportunity? Peter O'Neill
Google Analytics - Threat or Opportunity? Peter O'NeillGoogle Analytics - Threat or Opportunity? Peter O'Neill
Google Analytics - Threat or Opportunity? Peter O'NeillMezzo Labs
 

Mais de Mezzo Labs (20)

Consumer not Customer, Value not Revenue, Actions not Numbers - Russell McAthy
Consumer not Customer, Value not Revenue, Actions not Numbers - Russell McAthyConsumer not Customer, Value not Revenue, Actions not Numbers - Russell McAthy
Consumer not Customer, Value not Revenue, Actions not Numbers - Russell McAthy
 
Attribution Modelling and Blockchain - Peter Prince
Attribution Modelling and Blockchain - Peter PrinceAttribution Modelling and Blockchain - Peter Prince
Attribution Modelling and Blockchain - Peter Prince
 
Attribution or Misattribution? How to make digital measurement less awful - N...
Attribution or Misattribution? How to make digital measurement less awful - N...Attribution or Misattribution? How to make digital measurement less awful - N...
Attribution or Misattribution? How to make digital measurement less awful - N...
 
What can Artificial Intelligence (AI) offer to Attribution Modelling? - Dimit...
What can Artificial Intelligence (AI) offer to Attribution Modelling? - Dimit...What can Artificial Intelligence (AI) offer to Attribution Modelling? - Dimit...
What can Artificial Intelligence (AI) offer to Attribution Modelling? - Dimit...
 
Raoul Lumb, Data Protection Lawyer, Simons Muirhead & Burton - The Letter of Law
Raoul Lumb, Data Protection Lawyer, Simons Muirhead & Burton - The Letter of LawRaoul Lumb, Data Protection Lawyer, Simons Muirhead & Burton - The Letter of Law
Raoul Lumb, Data Protection Lawyer, Simons Muirhead & Burton - The Letter of Law
 
Lindsay McEwan, VP & MD EMEA, Tealium - The Martech Industry and Your Data - ...
Lindsay McEwan, VP & MD EMEA, Tealium - The Martech Industry and Your Data - ...Lindsay McEwan, VP & MD EMEA, Tealium - The Martech Industry and Your Data - ...
Lindsay McEwan, VP & MD EMEA, Tealium - The Martech Industry and Your Data - ...
 
Adrian Kingwell, Managing Director, Mezzo Labs - 350 days to Armageddon
Adrian Kingwell, Managing Director, Mezzo Labs - 350 days to ArmageddonAdrian Kingwell, Managing Director, Mezzo Labs - 350 days to Armageddon
Adrian Kingwell, Managing Director, Mezzo Labs - 350 days to Armageddon
 
Lee Suker - What is a DMP
Lee Suker - What is a DMPLee Suker - What is a DMP
Lee Suker - What is a DMP
 
Increasing Audience Engagement - Chris Moss
Increasing Audience Engagement - Chris MossIncreasing Audience Engagement - Chris Moss
Increasing Audience Engagement - Chris Moss
 
Is personal shopping personal enough yet? - Simon Bloom
Is personal shopping personal enough yet? - Simon BloomIs personal shopping personal enough yet? - Simon Bloom
Is personal shopping personal enough yet? - Simon Bloom
 
Insurance, Customers and Data - Alan Sanderson
Insurance, Customers and Data� - Alan SandersonInsurance, Customers and Data� - Alan Sanderson
Insurance, Customers and Data - Alan Sanderson
 
Richard Ayers - Future of Web Analytics
Richard Ayers - Future of Web AnalyticsRichard Ayers - Future of Web Analytics
Richard Ayers - Future of Web Analytics
 
Measuring websites - Romain Ammar
Measuring websites - Romain AmmarMeasuring websites - Romain Ammar
Measuring websites - Romain Ammar
 
Measuring off-site traffic - Adrian Kingwell
Measuring off-site traffic - Adrian KingwellMeasuring off-site traffic - Adrian Kingwell
Measuring off-site traffic - Adrian Kingwell
 
Data mining and data visualisation - Lance Nelson
Data mining and data visualisation - Lance NelsonData mining and data visualisation - Lance Nelson
Data mining and data visualisation - Lance Nelson
 
Analytics. It's not about the numbers - Andrew Scott
Analytics. It's not about the numbers - Andrew ScottAnalytics. It's not about the numbers - Andrew Scott
Analytics. It's not about the numbers - Andrew Scott
 
A flying lesson, or why it's important to connect KPIs to clear objectives - ...
A flying lesson, or why it's important to connect KPIs to clear objectives - ...A flying lesson, or why it's important to connect KPIs to clear objectives - ...
A flying lesson, or why it's important to connect KPIs to clear objectives - ...
 
Analysing Analytics: Exposing the gap in the web analytics labour market - Ad...
Analysing Analytics: Exposing the gap in the web analytics labour market - Ad...Analysing Analytics: Exposing the gap in the web analytics labour market - Ad...
Analysing Analytics: Exposing the gap in the web analytics labour market - Ad...
 
A view of the Next Wave of Web Insight - Julian Brewer
A view of the Next Wave of Web Insight -  Julian BrewerA view of the Next Wave of Web Insight -  Julian Brewer
A view of the Next Wave of Web Insight - Julian Brewer
 
Google Analytics - Threat or Opportunity? Peter O'Neill
Google Analytics - Threat or Opportunity? Peter O'NeillGoogle Analytics - Threat or Opportunity? Peter O'Neill
Google Analytics - Threat or Opportunity? Peter O'Neill
 

Último

Semantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxSemantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxMike Bennett
 
SMOTE and K-Fold Cross Validation-Presentation.pptx
SMOTE and K-Fold Cross Validation-Presentation.pptxSMOTE and K-Fold Cross Validation-Presentation.pptx
SMOTE and K-Fold Cross Validation-Presentation.pptxHaritikaChhatwal1
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBoston Institute of Analytics
 
Conf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
Conf42-LLM_Adding Generative AI to Real-Time Streaming PipelinesConf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
Conf42-LLM_Adding Generative AI to Real-Time Streaming PipelinesTimothy Spann
 
Unveiling the Role of Social Media Suspect Investigators in Preventing Online...
Unveiling the Role of Social Media Suspect Investigators in Preventing Online...Unveiling the Role of Social Media Suspect Investigators in Preventing Online...
Unveiling the Role of Social Media Suspect Investigators in Preventing Online...Milind Agarwal
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryJeremy Anderson
 
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...Boston Institute of Analytics
 
modul pembelajaran robotic Workshop _ by Slidesgo.pptx
modul pembelajaran robotic Workshop _ by Slidesgo.pptxmodul pembelajaran robotic Workshop _ by Slidesgo.pptx
modul pembelajaran robotic Workshop _ by Slidesgo.pptxaleedritatuxx
 
Networking Case Study prepared by teacher.pptx
Networking Case Study prepared by teacher.pptxNetworking Case Study prepared by teacher.pptx
Networking Case Study prepared by teacher.pptxHimangsuNath
 
Decoding Patterns: Customer Churn Prediction Data Analysis Project
Decoding Patterns: Customer Churn Prediction Data Analysis ProjectDecoding Patterns: Customer Churn Prediction Data Analysis Project
Decoding Patterns: Customer Churn Prediction Data Analysis ProjectBoston Institute of Analytics
 
Cyber awareness ppt on the recorded data
Cyber awareness ppt on the recorded dataCyber awareness ppt on the recorded data
Cyber awareness ppt on the recorded dataTecnoIncentive
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsVICTOR MAESTRE RAMIREZ
 
What To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxWhat To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxSimranPal17
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics
 
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Thomas Poetter
 
INTRODUCTION TO Natural language processing
INTRODUCTION TO Natural language processingINTRODUCTION TO Natural language processing
INTRODUCTION TO Natural language processingsocarem879
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksdeepakthakur548787
 
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024Susanna-Assunta Sansone
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfblazblazml
 
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...Amil Baba Dawood bangali
 

Último (20)

Semantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptxSemantic Shed - Squashing and Squeezing.pptx
Semantic Shed - Squashing and Squeezing.pptx
 
SMOTE and K-Fold Cross Validation-Presentation.pptx
SMOTE and K-Fold Cross Validation-Presentation.pptxSMOTE and K-Fold Cross Validation-Presentation.pptx
SMOTE and K-Fold Cross Validation-Presentation.pptx
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
 
Conf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
Conf42-LLM_Adding Generative AI to Real-Time Streaming PipelinesConf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
Conf42-LLM_Adding Generative AI to Real-Time Streaming Pipelines
 
Unveiling the Role of Social Media Suspect Investigators in Preventing Online...
Unveiling the Role of Social Media Suspect Investigators in Preventing Online...Unveiling the Role of Social Media Suspect Investigators in Preventing Online...
Unveiling the Role of Social Media Suspect Investigators in Preventing Online...
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data Story
 
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
Decoding the Heart: Student Presentation on Heart Attack Prediction with Data...
 
modul pembelajaran robotic Workshop _ by Slidesgo.pptx
modul pembelajaran robotic Workshop _ by Slidesgo.pptxmodul pembelajaran robotic Workshop _ by Slidesgo.pptx
modul pembelajaran robotic Workshop _ by Slidesgo.pptx
 
Networking Case Study prepared by teacher.pptx
Networking Case Study prepared by teacher.pptxNetworking Case Study prepared by teacher.pptx
Networking Case Study prepared by teacher.pptx
 
Decoding Patterns: Customer Churn Prediction Data Analysis Project
Decoding Patterns: Customer Churn Prediction Data Analysis ProjectDecoding Patterns: Customer Churn Prediction Data Analysis Project
Decoding Patterns: Customer Churn Prediction Data Analysis Project
 
Cyber awareness ppt on the recorded data
Cyber awareness ppt on the recorded dataCyber awareness ppt on the recorded data
Cyber awareness ppt on the recorded data
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business Professionals
 
What To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxWhat To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptx
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
 
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
Minimizing AI Hallucinations/Confabulations and the Path towards AGI with Exa...
 
INTRODUCTION TO Natural language processing
INTRODUCTION TO Natural language processingINTRODUCTION TO Natural language processing
INTRODUCTION TO Natural language processing
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing works
 
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
FAIR, FAIRsharing, FAIR Cookbook and ELIXIR - Sansone SA - Boston 2024
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
 
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
NO1 Certified Black Magic Specialist Expert Amil baba in Lahore Islamabad Raw...
 

Aliur Rahman, Experian, - Setting up an Optimisation Function

  • 1. Setting up an Optimisation Function Aliur Rahman Head of Digital Optimisation & Personalisation
  • 3. Experian UK PLC • Free Score (CreditMatcher) • CreditExpert • Comparison
  • 4. Digital transformation • From Technology to Customer Services, from Product to Marketing
  • 5. The brief • Set up an Optimisation function in London • Create a culture of test and learn (fail fast, learn quick) • Bridge relationship between Marketing and Technology
  • 6. TECHNOLOGY PROCESSES PEOPLE • Process was substandard • No real governance in place • Silo optimisation roadmap • No frameworks or centralisation • Decent Optimisation tool • No building out of capability • Old version being used • No integration • Silo Optimisation teams • No technical people in London • Skillset gap in Optimisation OPERATIONAL • Pushing 2-3 tests a month • No delivery management • No Targeting/personalisation Optimisation before
  • 8. 7 step process to setting up an Optimisation function 1. DEVELOP OPTIMISATION STRATEGY • Plan for next 12 months • Technology • Process & Governance • People & Operating Model • Culture • Personalisation
  • 9. 7 step process to setting up an Optimisation function 1. DEVELOP OPTIMISATION STRATEGY 2. BUILD OPTIMISATION TEAM • Identify roles and skill set required • Hire people in London (Contractors) • Train and Equip
  • 10. 7 step process to setting up an Optimisation function 1. DEVELOP OPTIMISATION STRATEGY 2. BUILD OPTIMISATION TEAM 3. PUT IN PLACE PROCESS • Agree and establish process • Establish agile delivery method (KANBAN) • Centralise assets and communication • Put in place Steerco and governance
  • 11. Business Kanban Board Technical Kanban Board JIRA Kanban boards for Optimisation delivery
  • 12. Centrally hosted assets for Optimisation efficiency Centralised briefing process in Confluence Agreed and established process in Blueworks
  • 13. 7 step process to setting up an Optimisation function 1. DEVELOP OPTIMISATION STRATEGY 2. BUILD OPTIMISATION TEAM 3. PUT IN PLACE PROCESS 4. EXECUTE • Run team using daily stand ups • Work closely with business owners • Build, configure and push test live • Communicate to SLT
  • 14. 7 step process to setting up an Optimisation function 1. DEVELOP OPTIMISATION STRATEGY 2. BUILD OPTIMISATION TEAM 3. PUT IN PLACE PROCESS 4. EXECUTE 5. MEASURE, REPORT & VALIDATE • Track velocity • Track and report number of tests completed • Prove that the Optimisation team was successful
  • 15. 7 step process to setting up an Optimisation function 1. DEVELOP OPTIMISATION STRATEGY 2. BUILD OPTIMISATION TEAM 3. PUT IN PLACE PROCESS 4. EXECUTE 5. MEASURE, REPORT & VALIDATE 6. TRANSITION • Replace contractors with permanent team • Widen scope of digital development • Build close relationship between Marketing and Technology
  • 16. 7 step process to setting up an Optimisation function 1. DEVELOP OPTIMISATION STRATEGY 2. BUILD OPTIMISATION TEAM 3. PUT IN PLACE PROCESS 4. EXECUTE 5. MEASURE, REPORT & VALIDATE 6. TRANSITION 7. BAU • Continue to produce tests • Align with technology team for wider work • Put in amends to processes
  • 17. TECHNOLOGY PROCESSES PEOPLE • Process established and aligned • Governance & steerco in place • Centralisation of assets • KANBAN delivery method • Technical support from Vendor • Building out of capability to include Personalisation • Set up three new functions • Well organised team in London • Relevant technical skillset • One team under the same place OPERATIONAL • Pushing 15-20 tests a month • Contributed to increasing overall site conversion by 80% Optimisation after
  • 18. Small and nimble operation in a large and complex environment
  • 19. Establishing a digital first culture
  • 20. Transition and embed team Personalisation Mobile App Optimisation Establish a Testing Culture
  • 21. Thank you for listening Questions?

Notas do Editor

  1. So what did we do – we created a small and nimble operation in a large and at times complex environment
  2. 1.
  3. 1.
  4. 1.