SlideShare uma empresa Scribd logo
1 de 44
Baixar para ler offline
BIMODAL IT AND THE JOURNEY TO
DATA WAREHOUSE MODERNIZATION
BY
ROB GLEAVE
VP ARCHITECTURE AND STRATEGY
SPORTS AUTHORITY
THE SHIFTING LANDSCAPE OF
BUSINESS ANALYTICS
We are all facing this….
THE SHIFTING LANDSCAPE OF
BUSINESS ANALYTICS
Challenges on all fronts…
•  "Traditional" IT-centric business intelligence strategies are no longer
sufficient to drive the use of analytics within an organization.
•  IT teams are struggling to cope with higher volume and diversity of
demand.
•  Business is increasingly taking over control, ownership and
responsibility for analytics — often underestimating the associated
complexity and risks.
•  The almost infinite amount of data available offers great opportunity for
new insights, but also makes it increasingly difficult for organizations to
manage, secure and accurately interpret that data.
THE SHIFTING LANDSCAPE OF
BUSINESS ANALYTICS
Without a roadmap to modernization, you will surely fail to keep
up with the demand for data…
What is your plan?
How do you start?
THE SHIFTING LANDSCAPE OF
BUSINESS ANALYTICS
First and foremost…
Don’t abandon what you have been
doing…
That is NOT necessary.
JUST
ENTER THE BIMODAL HIGHWAY
You can take an alternate route…
BIMODAL IT… WHAT IS IT?
Source: Gartner (April 2015)
!
What is Bimodal IT?
BIMODAL IT… WHAT IS IT?
Mode 1 Mode 2
Reliability, Incremental
Growth
Goal Agility, Innovation
Price for
Performance
Value
Revenue, Brand,
Customer Experience
Waterfall,
High Ceremony
Approach
Agile,
Low Ceremony
Plan Driven,
Approval Based
Governance Empirical, Adaptive
Enterprise Suppliers,
Long-Term Deals
Sourcing
Small, New Vendors,
Short-Term Deals
Good at Conventional
Process, Projects
Talent
Good at New and
Uncertain Projects
Take the Order,
Delight "Customers"
Culture
Innovate With
"Partners"
Long (Months, Years) Cycle Times Short (Days, Weeks)
Think
Ninja
Think
Samurai
Gartner Presentation, Getting Real About Bimodal, Dave Aron, October 2015
Two Different mindsets and approaches… both essential.
BIMODAL IT… WHAT IS IT?
! Source: Gartner (April 2015)
In a perfect world… we want a balanced mix of both capabilities.
BIMODAL IT… THE CHALLENGE
Most organizations are already executing Mode 1 well, delivering:
Reliability
Efficiency
Safety
Accuracy
The challenge is how to build a Mode 2 capability to deliver
SPEED & AGILITY
BIMODAL IT… THE CHALLENGE
Detractors sometimes discount the idea of Bimodal IT, saying…
“Why not just make every element of IT more agile?”
But that is not realistic…
Bimodal is about accepting deliberate trade-offs
ROADMAP TO MODERNIZATION
The road to modernization will be paved by BIMODAL thinkers
You need a viable plan…
Step #1: Embrace Self Service BI
ROADMAP TO MODERNIZATION
“The users have won…”
-  CTO of IBM’s Lean Analytics Division
Inventor of IBM Big Insights
Often, IT will resist self service….. WHY?
•  Business users want it..
•  It is often more agile..
•  The work of BI is distributed across many hands, who are
all expert in the meaning of the data..
•  Self service sandboxes provide real value - they often
become areas of true innovation..
•  It helps the ‘underserved’. Most enterprises cannot fund
enough BI to feed the masses.
ROADMAPROADMAP TO MODERNIZATION
ROADMAP TO MODERNIZATION
Historically with self service, that fear is well founded..
When Sports Authority started the journey to data
warehouse modernization, we had:
•  “Shadow IT” sandboxes everywhere
•  Over 1900 MS Access databases on user desktops –
16,800 mdb files (purpose of most were unknown)
•  One MS Access database supporting 130 users and
containing 50 different tables (many at max size).
•  Most users queried transactional systems directly to
populate their data marts, impacting performance of
those transaction systems dramatically.
ROADMAP TO MODERNIZATION
ROADMAP TO MODERNIZATION
HOST SYSTEM .
Applications
Application
Application
Application
Data Source
Ad-Hoc Report Consumers
Data Sources
Data Source
Application
POS
eCommerce
Enterprise
Data Warehouse
Corporate Report
Consumers
Scales
Transactional
Databases
Scales
A picture of our world….
Change is difficult, however, IT teams must resist the
temptation to “own” everything. The truth is…
•  Overly centralized BI teams can't deliver the domain expertise,
responsiveness and speed most organizations require.
•  While a centralized team does a good job in creating consistency
and governance across certain key subject areas, it creates a
bottleneck, causing most users to wait too long to get their
requirements met.
•  The future of BI and analytics is about enabling both a centralized
BI function as well as the decentralized analysis occurring within the
company.
ROADMAPROADMAP TO MODERNIZATION
It just takes the right technology…
ROADMAP
Plus, we all know that
self-service works…
ROADMAP TO MODERNIZATION
ROADMAP TO MODERNIZATION
Stage 1
What does your technology look like today? Is this your data architecture?
Step #2: Pick your future-state data platform
ROADMAP TO MODERNIZATION
What are kind of environment are we looking for?
•  Secure
•  Universally available
•  Promotes data sharing
•  Scalable
•  Reliable
•  Manageable
•  Easy to use
•  Cost-effective
ROADMAP TO MODERNIZATION
Where can you find such an environment?
Look to a cloud platform, like Google, Microsoft or Amazon…
ROADMAP TO MODERNIZATION
What is BigQuery?
•  A fully managed (Saas) data analytics service
•  ‘Pay for what you use’ model -- very low cost
•  Familiar SQL Interface
•  Super-fast! Query against terabytes of data in seconds
•  Elastic, auto-scaling, up to petabyte-scale databases
•  Truly ‘Big Data’ – comparable to Hadoop/SQL or Spark
•  Programmable - APIs, APIs, APIs….
ROADMAP TO MODERNIZATION
How does BigQuery work?
•  The largest columnar database on earth
•  Optimized for selection, aggregation
•  Provides superior data compression
•  Stores data differently than a traditional RDBMS
ROADMAP TO MODERNIZATION
Step #3: Offer Personal Sandboxes
ROADMAP TO MODERNIZATION
ROADMAP TO MODERNIZATION
Stage 2
Google BigQuery
Google Cloud Storage
Allow users to build personal sandboxes in the cloud environment…
ROADMAP TO MODERNIZATION
Stage 2
At this point, the new sandboxes (Mode 2) sit beside the old EDW (Mode 1)…
Step #4: Experiment with “Citizen” Tools
ROADMAP TO MODERNIZATION
We live in the era of the ‘Citizen’ knowledge worker…
ROADMAP TO MODERNIZATION
Easy-to-use tools are easing business users into functions which
have traditionally been handled by IT
•  Data blending (e.g. Alteryx, )
•  Data quality & MDM (e.g. Alteryx, Reltio, Dell Boomi )
•  Data modeling and virtualization (e.g. Looker, Denodo)
•  Data visualization (e.g. Tableau, Clikview, PowerBI, Microstrategy 10)
•  Lightweight integration and iPaas (e.g. Dell Boomi, Snaplogic)
•  Even…. Data Science! (e.g. R, Python Pandas)
ROADMAP TO MODERNIZATION
Generally, these tools are only appropriate for SMEs or people who are currently
your ‘super users’.
But, they are extremely powerful and give these business data analysts great
freedom to explore, innovate and share valuable data assets.
These tools, extend the reach of IT and actually help eliminate some age-old
problems, for example….
ROADMAP TO MODERNIZATION
ROADMAP TO MODERNIZATION
Stage 3
Where do these tools fit into the new data architecture?
ROADMAP TO MODERNIZATION
Stage 3
Step #5: Build Core Data Sets in the Cloud
ROADMAP TO MODERNIZATION
ROADMAP TO MODERNIZATION
Stage 4
Google BigQuery
Google Cloud Storage
Core Datasets
ROADMAP TO MODERNIZATION
Stage 4
Step #6: Migrate to the Data Warehouse of
the Future
ROADMAP TO MODERNIZATION
ROADMAP TO MODERNIZATION
Stage 5 begins with a full Data Lake, because…
•  The lake supports direct (Mode 2) discovery against new data sets.
•  It provides a platform for Big Data – both structured and unstructured.
•  Its scale-out architecture allows more data to be collected and retained.
•  It can lower upfront costs, by delaying transformation and modeling until
needed.
Caveats: must define platform, security, data management, etc.
ROADMAP TO MODERNIZATION
Notice the full Data Lake and cloud-based Hadoop for Big Data….
Stage 5
Google Cloud Storage
Google BigQuery
Google Cloud DataProc
ROADMAP TO MODERNIZATION
Stage 5
ROADMAP TO MODERNIZATION
Join SQL – over user data
set + core data set
BigQuery Sandbox Project
UserSandbox
UserSandbox
CoreSubjectArea
UserSandbox
UserSandbox
Data set secured to
an individual user
CoreSubjectArea
UserSandbox
UserSandbox
UserSandbox
UserSandbox
CoreSubjectArea
CoreSubjectArea
CoreSubjectArea
Data set secured to
an individual user
Core warehouse
data set – read only
Plain SQL – only against
user sandbox data set
Sports Authority - SA Data Landscape
11/2/2015 Page 1
Users enjoy a powerful data world consisting of personal
sandboxes and core data sets in a new elastic data warehouse.
ROADMAP
In Review, the Steps to Data Warehouse Modernization
1.  Adopt a Mode 2 mindset - with a focus on Self Service.
2.  Pick a new platform for the future-state data world
3.  Offer personal sandboxes for exploration/discovery
4.  Introduce and promote “Citizen” data tools
5.  Build core data sets in the cloud
6.  Migrate completely to the Data Warehouse of the Future
ROADMAP TO MODERNIZATION
QUESTIONS?
Rob Gleave
rgleave@sportsauthority.com
robertjaygleave@gmail.com

Mais conteúdo relacionado

Mais procurados

Verizon: Finance Data Lake implementation as a Self Service Discovery Big Dat...
Verizon: Finance Data Lake implementation as a Self Service Discovery Big Dat...Verizon: Finance Data Lake implementation as a Self Service Discovery Big Dat...
Verizon: Finance Data Lake implementation as a Self Service Discovery Big Dat...DataWorks Summit
 
Data Quality as a prerequisite for you business success: when should I start ...
Data Quality as a prerequisite for you business success: when should I start ...Data Quality as a prerequisite for you business success: when should I start ...
Data Quality as a prerequisite for you business success: when should I start ...Anastasija Nikiforova
 
Modernizing Integration with Data Virtualization
Modernizing Integration with Data VirtualizationModernizing Integration with Data Virtualization
Modernizing Integration with Data VirtualizationDenodo
 
Reference Data Management
Reference Data ManagementReference Data Management
Reference Data ManagementProfinit
 
Continuous Data Ingestion pipeline for the Enterprise
Continuous Data Ingestion pipeline for the EnterpriseContinuous Data Ingestion pipeline for the Enterprise
Continuous Data Ingestion pipeline for the EnterpriseDataWorks Summit
 
Chief Data Officer: DataOps - Transformation of the Business Data Environment
Chief Data Officer: DataOps - Transformation of the Business Data EnvironmentChief Data Officer: DataOps - Transformation of the Business Data Environment
Chief Data Officer: DataOps - Transformation of the Business Data EnvironmentCraig Milroy
 
Understanding Reference Data with Aaron Zornes
Understanding Reference Data with Aaron ZornesUnderstanding Reference Data with Aaron Zornes
Understanding Reference Data with Aaron ZornesOrchestra Networks
 
A Reference Architecture for Digital Health: The Health Catalyst Data Operati...
A Reference Architecture for Digital Health: The Health Catalyst Data Operati...A Reference Architecture for Digital Health: The Health Catalyst Data Operati...
A Reference Architecture for Digital Health: The Health Catalyst Data Operati...Health Catalyst
 
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
(OTW13) Agile Data Warehousing: Introduction to Data Vault ModelingKent Graziano
 
Master Data Management
Master Data ManagementMaster Data Management
Master Data ManagementZahra Mansoori
 
Big Data Fabric Capability Maturity Model
Big Data Fabric Capability Maturity ModelBig Data Fabric Capability Maturity Model
Big Data Fabric Capability Maturity ModelRoss Collins
 
Data Maturity - A Balanced Approach
Data Maturity - A Balanced ApproachData Maturity - A Balanced Approach
Data Maturity - A Balanced ApproachDATAVERSITY
 
3 Keys To Successful Master Data Management - Final Presentation
3 Keys To Successful Master Data Management - Final Presentation3 Keys To Successful Master Data Management - Final Presentation
3 Keys To Successful Master Data Management - Final PresentationJames Chi
 
Cloud Computing - ISO/IEC 17788
Cloud Computing - ISO/IEC 17788Cloud Computing - ISO/IEC 17788
Cloud Computing - ISO/IEC 17788Hamid Reza Qavami
 
Metadata Strategies - Data Squared
Metadata Strategies - Data SquaredMetadata Strategies - Data Squared
Metadata Strategies - Data SquaredDATAVERSITY
 
AI and sustainability
AI and sustainabilityAI and sustainability
AI and sustainabilitySonja Aits
 

Mais procurados (20)

Data Monetization
Data MonetizationData Monetization
Data Monetization
 
Verizon: Finance Data Lake implementation as a Self Service Discovery Big Dat...
Verizon: Finance Data Lake implementation as a Self Service Discovery Big Dat...Verizon: Finance Data Lake implementation as a Self Service Discovery Big Dat...
Verizon: Finance Data Lake implementation as a Self Service Discovery Big Dat...
 
Data Quality as a prerequisite for you business success: when should I start ...
Data Quality as a prerequisite for you business success: when should I start ...Data Quality as a prerequisite for you business success: when should I start ...
Data Quality as a prerequisite for you business success: when should I start ...
 
Building Digital Trust
   Building Digital Trust   Building Digital Trust
Building Digital Trust
 
Modernizing Integration with Data Virtualization
Modernizing Integration with Data VirtualizationModernizing Integration with Data Virtualization
Modernizing Integration with Data Virtualization
 
Reference Data Management
Reference Data ManagementReference Data Management
Reference Data Management
 
Continuous Data Ingestion pipeline for the Enterprise
Continuous Data Ingestion pipeline for the EnterpriseContinuous Data Ingestion pipeline for the Enterprise
Continuous Data Ingestion pipeline for the Enterprise
 
Data Vault and DW2.0
Data Vault and DW2.0Data Vault and DW2.0
Data Vault and DW2.0
 
Dremio introduction
Dremio introductionDremio introduction
Dremio introduction
 
Chief Data Officer: DataOps - Transformation of the Business Data Environment
Chief Data Officer: DataOps - Transformation of the Business Data EnvironmentChief Data Officer: DataOps - Transformation of the Business Data Environment
Chief Data Officer: DataOps - Transformation of the Business Data Environment
 
Understanding Reference Data with Aaron Zornes
Understanding Reference Data with Aaron ZornesUnderstanding Reference Data with Aaron Zornes
Understanding Reference Data with Aaron Zornes
 
A Reference Architecture for Digital Health: The Health Catalyst Data Operati...
A Reference Architecture for Digital Health: The Health Catalyst Data Operati...A Reference Architecture for Digital Health: The Health Catalyst Data Operati...
A Reference Architecture for Digital Health: The Health Catalyst Data Operati...
 
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
 
Master Data Management
Master Data ManagementMaster Data Management
Master Data Management
 
Big Data Fabric Capability Maturity Model
Big Data Fabric Capability Maturity ModelBig Data Fabric Capability Maturity Model
Big Data Fabric Capability Maturity Model
 
Data Maturity - A Balanced Approach
Data Maturity - A Balanced ApproachData Maturity - A Balanced Approach
Data Maturity - A Balanced Approach
 
3 Keys To Successful Master Data Management - Final Presentation
3 Keys To Successful Master Data Management - Final Presentation3 Keys To Successful Master Data Management - Final Presentation
3 Keys To Successful Master Data Management - Final Presentation
 
Cloud Computing - ISO/IEC 17788
Cloud Computing - ISO/IEC 17788Cloud Computing - ISO/IEC 17788
Cloud Computing - ISO/IEC 17788
 
Metadata Strategies - Data Squared
Metadata Strategies - Data SquaredMetadata Strategies - Data Squared
Metadata Strategies - Data Squared
 
AI and sustainability
AI and sustainabilityAI and sustainability
AI and sustainability
 

Destaque

Project management Framework
Project management FrameworkProject management Framework
Project management Frameworknewbie2009
 
Hybrid Development Webinar - English
Hybrid Development Webinar - EnglishHybrid Development Webinar - English
Hybrid Development Webinar - EnglishCollabNet
 
Eliminate HR Paperwork & Manual Processes
Eliminate HR Paperwork & Manual ProcessesEliminate HR Paperwork & Manual Processes
Eliminate HR Paperwork & Manual ProcessesJazz
 
Closing The Gap Between Recruiting and HR Through Better Onboarding
Closing The Gap Between Recruiting and HR Through Better OnboardingClosing The Gap Between Recruiting and HR Through Better Onboarding
Closing The Gap Between Recruiting and HR Through Better OnboardingBambooHR
 
IOUG93 - Technical Architecture for the Data Warehouse - Presentation
IOUG93 - Technical Architecture for the Data Warehouse - PresentationIOUG93 - Technical Architecture for the Data Warehouse - Presentation
IOUG93 - Technical Architecture for the Data Warehouse - PresentationDavid Walker
 
Benefits of a data warehouse presentation by Being topper
Benefits of a data warehouse presentation by Being topperBenefits of a data warehouse presentation by Being topper
Benefits of a data warehouse presentation by Being topperBeing Topper
 
How PACE Layering bridges the GAP From Systems of Record to Systems of Engage...
How PACE Layering bridges the GAP From Systems of Record to Systems of Engage...How PACE Layering bridges the GAP From Systems of Record to Systems of Engage...
How PACE Layering bridges the GAP From Systems of Record to Systems of Engage...Jeff Shuey
 
Data as Seductive Material, Spring Summit, Umeå March09
Data as Seductive Material, Spring Summit, Umeå March09Data as Seductive Material, Spring Summit, Umeå March09
Data as Seductive Material, Spring Summit, Umeå March09Matt Jones
 
Everything Has Changed Except Us: Modernizing the Data Warehouse
Everything Has Changed Except Us: Modernizing the Data WarehouseEverything Has Changed Except Us: Modernizing the Data Warehouse
Everything Has Changed Except Us: Modernizing the Data Warehousemark madsen
 
Data Warehouse Concepts and Architecture
Data Warehouse Concepts and ArchitectureData Warehouse Concepts and Architecture
Data Warehouse Concepts and ArchitectureMohd Tousif
 
Data warehouse architecture
Data warehouse architectureData warehouse architecture
Data warehouse architectureuncleRhyme
 
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...Denodo
 
Data warehouse inmon versus kimball 2
Data warehouse inmon versus kimball 2Data warehouse inmon versus kimball 2
Data warehouse inmon versus kimball 2Mike Frampton
 
Martin Börjesson - Hvad er Bimodal IT?
Martin Börjesson - Hvad er Bimodal IT?Martin Börjesson - Hvad er Bimodal IT?
Martin Börjesson - Hvad er Bimodal IT?Aarhus BSS
 
Bimodal IT: Shortcut to Innovation or Path to Dysfunction?
Bimodal IT: Shortcut to Innovation or Path to Dysfunction?Bimodal IT: Shortcut to Innovation or Path to Dysfunction?
Bimodal IT: Shortcut to Innovation or Path to Dysfunction?dev2ops
 
INNOVATION BLUEPRINTS FOR BIMODAL IT
INNOVATION BLUEPRINTS FOR BIMODAL ITINNOVATION BLUEPRINTS FOR BIMODAL IT
INNOVATION BLUEPRINTS FOR BIMODAL ITNVISIA
 
10 benefits to thinking inside Box
10 benefits to thinking inside Box10 benefits to thinking inside Box
10 benefits to thinking inside BoxIBM Analytics
 

Destaque (20)

Project management Framework
Project management FrameworkProject management Framework
Project management Framework
 
Hybrid Development Webinar - English
Hybrid Development Webinar - EnglishHybrid Development Webinar - English
Hybrid Development Webinar - English
 
Eliminate HR Paperwork & Manual Processes
Eliminate HR Paperwork & Manual ProcessesEliminate HR Paperwork & Manual Processes
Eliminate HR Paperwork & Manual Processes
 
Closing The Gap Between Recruiting and HR Through Better Onboarding
Closing The Gap Between Recruiting and HR Through Better OnboardingClosing The Gap Between Recruiting and HR Through Better Onboarding
Closing The Gap Between Recruiting and HR Through Better Onboarding
 
IOUG93 - Technical Architecture for the Data Warehouse - Presentation
IOUG93 - Technical Architecture for the Data Warehouse - PresentationIOUG93 - Technical Architecture for the Data Warehouse - Presentation
IOUG93 - Technical Architecture for the Data Warehouse - Presentation
 
Benefits of a data warehouse presentation by Being topper
Benefits of a data warehouse presentation by Being topperBenefits of a data warehouse presentation by Being topper
Benefits of a data warehouse presentation by Being topper
 
How PACE Layering bridges the GAP From Systems of Record to Systems of Engage...
How PACE Layering bridges the GAP From Systems of Record to Systems of Engage...How PACE Layering bridges the GAP From Systems of Record to Systems of Engage...
How PACE Layering bridges the GAP From Systems of Record to Systems of Engage...
 
Data as Seductive Material, Spring Summit, Umeå March09
Data as Seductive Material, Spring Summit, Umeå March09Data as Seductive Material, Spring Summit, Umeå March09
Data as Seductive Material, Spring Summit, Umeå March09
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Everything Has Changed Except Us: Modernizing the Data Warehouse
Everything Has Changed Except Us: Modernizing the Data WarehouseEverything Has Changed Except Us: Modernizing the Data Warehouse
Everything Has Changed Except Us: Modernizing the Data Warehouse
 
Data Warehouse Concepts and Architecture
Data Warehouse Concepts and ArchitectureData Warehouse Concepts and Architecture
Data Warehouse Concepts and Architecture
 
Data warehouse architecture
Data warehouse architectureData warehouse architecture
Data warehouse architecture
 
Inmon & kimball method
Inmon & kimball methodInmon & kimball method
Inmon & kimball method
 
Accelerating Data Warehouse Modernization
Accelerating Data Warehouse ModernizationAccelerating Data Warehouse Modernization
Accelerating Data Warehouse Modernization
 
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
Extended Data Warehouse - A New Data Architecture for Modern BI with Claudia ...
 
Data warehouse inmon versus kimball 2
Data warehouse inmon versus kimball 2Data warehouse inmon versus kimball 2
Data warehouse inmon versus kimball 2
 
Martin Börjesson - Hvad er Bimodal IT?
Martin Börjesson - Hvad er Bimodal IT?Martin Börjesson - Hvad er Bimodal IT?
Martin Börjesson - Hvad er Bimodal IT?
 
Bimodal IT: Shortcut to Innovation or Path to Dysfunction?
Bimodal IT: Shortcut to Innovation or Path to Dysfunction?Bimodal IT: Shortcut to Innovation or Path to Dysfunction?
Bimodal IT: Shortcut to Innovation or Path to Dysfunction?
 
INNOVATION BLUEPRINTS FOR BIMODAL IT
INNOVATION BLUEPRINTS FOR BIMODAL ITINNOVATION BLUEPRINTS FOR BIMODAL IT
INNOVATION BLUEPRINTS FOR BIMODAL IT
 
10 benefits to thinking inside Box
10 benefits to thinking inside Box10 benefits to thinking inside Box
10 benefits to thinking inside Box
 

Semelhante a Bimodal IT and EDW Modernization

A Modern Data Architecture for Risk Management... For Financial Services
A Modern Data Architecture for Risk Management... For Financial ServicesA Modern Data Architecture for Risk Management... For Financial Services
A Modern Data Architecture for Risk Management... For Financial ServicesMammoth Data
 
Modern data integration expert sessions
Modern data integration expert sessionsModern data integration expert sessions
Modern data integration expert sessionsJessicaMurrell3
 
Modern Data Integration Expert Session Webinar
Modern Data Integration Expert Session Webinar Modern Data Integration Expert Session Webinar
Modern Data Integration Expert Session Webinar ibi
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Denodo
 
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...How a Time Series Database Contributes to a Decentralized Cloud Object Storag...
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...InfluxData
 
A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)Denodo
 
Power to the People: A Stack to Empower Every User to Make Data-Driven Decisions
Power to the People: A Stack to Empower Every User to Make Data-Driven DecisionsPower to the People: A Stack to Empower Every User to Make Data-Driven Decisions
Power to the People: A Stack to Empower Every User to Make Data-Driven DecisionsLooker
 
Why Data Virtualization? An Introduction
Why Data Virtualization? An IntroductionWhy Data Virtualization? An Introduction
Why Data Virtualization? An IntroductionDenodo
 
Accelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationAccelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationDenodo
 
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)Denodo
 
Seeing Redshift: How Amazon Changed Data Warehousing Forever
Seeing Redshift: How Amazon Changed Data Warehousing ForeverSeeing Redshift: How Amazon Changed Data Warehousing Forever
Seeing Redshift: How Amazon Changed Data Warehousing ForeverInside Analysis
 
Top Business Intelligence Trends for 2016 by Panorama Software
Top Business Intelligence Trends for 2016 by Panorama SoftwareTop Business Intelligence Trends for 2016 by Panorama Software
Top Business Intelligence Trends for 2016 by Panorama SoftwarePanorama Software
 
apidays LIVE LONDON - Old meets New - Managing transactions on the edge of th...
apidays LIVE LONDON - Old meets New - Managing transactions on the edge of th...apidays LIVE LONDON - Old meets New - Managing transactions on the edge of th...
apidays LIVE LONDON - Old meets New - Managing transactions on the edge of th...apidays
 
Bridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItBridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItDenodo
 
What is the future of data strategy?
What is the future of data strategy?What is the future of data strategy?
What is the future of data strategy?Denodo
 
The Growth Of Data Centers
The Growth Of Data CentersThe Growth Of Data Centers
The Growth Of Data CentersGina Buck
 
Di in the age of digital disruptions v1.0
Di in the age of digital disruptions v1.0Di in the age of digital disruptions v1.0
Di in the age of digital disruptions v1.0Amar Roy
 
When and How Data Lakes Fit into a Modern Data Architecture
When and How Data Lakes Fit into a Modern Data ArchitectureWhen and How Data Lakes Fit into a Modern Data Architecture
When and How Data Lakes Fit into a Modern Data ArchitectureDATAVERSITY
 
Rethinking Data Availability and Governance in a Mobile World
Rethinking Data Availability and Governance in a Mobile WorldRethinking Data Availability and Governance in a Mobile World
Rethinking Data Availability and Governance in a Mobile WorldHao Tran
 
Rethinking Data Availability and Governance in a Mobile World
Rethinking Data Availability and Governance in a Mobile WorldRethinking Data Availability and Governance in a Mobile World
Rethinking Data Availability and Governance in a Mobile WorldInside Analysis
 

Semelhante a Bimodal IT and EDW Modernization (20)

A Modern Data Architecture for Risk Management... For Financial Services
A Modern Data Architecture for Risk Management... For Financial ServicesA Modern Data Architecture for Risk Management... For Financial Services
A Modern Data Architecture for Risk Management... For Financial Services
 
Modern data integration expert sessions
Modern data integration expert sessionsModern data integration expert sessions
Modern data integration expert sessions
 
Modern Data Integration Expert Session Webinar
Modern Data Integration Expert Session Webinar Modern Data Integration Expert Session Webinar
Modern Data Integration Expert Session Webinar
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
 
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...How a Time Series Database Contributes to a Decentralized Cloud Object Storag...
How a Time Series Database Contributes to a Decentralized Cloud Object Storag...
 
A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)
 
Power to the People: A Stack to Empower Every User to Make Data-Driven Decisions
Power to the People: A Stack to Empower Every User to Make Data-Driven DecisionsPower to the People: A Stack to Empower Every User to Make Data-Driven Decisions
Power to the People: A Stack to Empower Every User to Make Data-Driven Decisions
 
Why Data Virtualization? An Introduction
Why Data Virtualization? An IntroductionWhy Data Virtualization? An Introduction
Why Data Virtualization? An Introduction
 
Accelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationAccelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and Visualization
 
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
Logical Data Warehouse: The Foundation of Modern Data and Analytics (APAC)
 
Seeing Redshift: How Amazon Changed Data Warehousing Forever
Seeing Redshift: How Amazon Changed Data Warehousing ForeverSeeing Redshift: How Amazon Changed Data Warehousing Forever
Seeing Redshift: How Amazon Changed Data Warehousing Forever
 
Top Business Intelligence Trends for 2016 by Panorama Software
Top Business Intelligence Trends for 2016 by Panorama SoftwareTop Business Intelligence Trends for 2016 by Panorama Software
Top Business Intelligence Trends for 2016 by Panorama Software
 
apidays LIVE LONDON - Old meets New - Managing transactions on the edge of th...
apidays LIVE LONDON - Old meets New - Managing transactions on the edge of th...apidays LIVE LONDON - Old meets New - Managing transactions on the edge of th...
apidays LIVE LONDON - Old meets New - Managing transactions on the edge of th...
 
Bridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItBridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need It
 
What is the future of data strategy?
What is the future of data strategy?What is the future of data strategy?
What is the future of data strategy?
 
The Growth Of Data Centers
The Growth Of Data CentersThe Growth Of Data Centers
The Growth Of Data Centers
 
Di in the age of digital disruptions v1.0
Di in the age of digital disruptions v1.0Di in the age of digital disruptions v1.0
Di in the age of digital disruptions v1.0
 
When and How Data Lakes Fit into a Modern Data Architecture
When and How Data Lakes Fit into a Modern Data ArchitectureWhen and How Data Lakes Fit into a Modern Data Architecture
When and How Data Lakes Fit into a Modern Data Architecture
 
Rethinking Data Availability and Governance in a Mobile World
Rethinking Data Availability and Governance in a Mobile WorldRethinking Data Availability and Governance in a Mobile World
Rethinking Data Availability and Governance in a Mobile World
 
Rethinking Data Availability and Governance in a Mobile World
Rethinking Data Availability and Governance in a Mobile WorldRethinking Data Availability and Governance in a Mobile World
Rethinking Data Availability and Governance in a Mobile World
 

Bimodal IT and EDW Modernization

  • 1. BIMODAL IT AND THE JOURNEY TO DATA WAREHOUSE MODERNIZATION BY ROB GLEAVE VP ARCHITECTURE AND STRATEGY SPORTS AUTHORITY
  • 2. THE SHIFTING LANDSCAPE OF BUSINESS ANALYTICS We are all facing this….
  • 3. THE SHIFTING LANDSCAPE OF BUSINESS ANALYTICS Challenges on all fronts… •  "Traditional" IT-centric business intelligence strategies are no longer sufficient to drive the use of analytics within an organization. •  IT teams are struggling to cope with higher volume and diversity of demand. •  Business is increasingly taking over control, ownership and responsibility for analytics — often underestimating the associated complexity and risks. •  The almost infinite amount of data available offers great opportunity for new insights, but also makes it increasingly difficult for organizations to manage, secure and accurately interpret that data.
  • 4. THE SHIFTING LANDSCAPE OF BUSINESS ANALYTICS Without a roadmap to modernization, you will surely fail to keep up with the demand for data… What is your plan? How do you start?
  • 5. THE SHIFTING LANDSCAPE OF BUSINESS ANALYTICS First and foremost… Don’t abandon what you have been doing… That is NOT necessary. JUST
  • 6. ENTER THE BIMODAL HIGHWAY You can take an alternate route…
  • 7. BIMODAL IT… WHAT IS IT? Source: Gartner (April 2015) ! What is Bimodal IT?
  • 8. BIMODAL IT… WHAT IS IT? Mode 1 Mode 2 Reliability, Incremental Growth Goal Agility, Innovation Price for Performance Value Revenue, Brand, Customer Experience Waterfall, High Ceremony Approach Agile, Low Ceremony Plan Driven, Approval Based Governance Empirical, Adaptive Enterprise Suppliers, Long-Term Deals Sourcing Small, New Vendors, Short-Term Deals Good at Conventional Process, Projects Talent Good at New and Uncertain Projects Take the Order, Delight "Customers" Culture Innovate With "Partners" Long (Months, Years) Cycle Times Short (Days, Weeks) Think Ninja Think Samurai Gartner Presentation, Getting Real About Bimodal, Dave Aron, October 2015 Two Different mindsets and approaches… both essential.
  • 9. BIMODAL IT… WHAT IS IT? ! Source: Gartner (April 2015) In a perfect world… we want a balanced mix of both capabilities.
  • 10. BIMODAL IT… THE CHALLENGE Most organizations are already executing Mode 1 well, delivering: Reliability Efficiency Safety Accuracy The challenge is how to build a Mode 2 capability to deliver SPEED & AGILITY
  • 11. BIMODAL IT… THE CHALLENGE Detractors sometimes discount the idea of Bimodal IT, saying… “Why not just make every element of IT more agile?” But that is not realistic… Bimodal is about accepting deliberate trade-offs
  • 12. ROADMAP TO MODERNIZATION The road to modernization will be paved by BIMODAL thinkers You need a viable plan…
  • 13. Step #1: Embrace Self Service BI ROADMAP TO MODERNIZATION “The users have won…” -  CTO of IBM’s Lean Analytics Division Inventor of IBM Big Insights
  • 14. Often, IT will resist self service….. WHY? •  Business users want it.. •  It is often more agile.. •  The work of BI is distributed across many hands, who are all expert in the meaning of the data.. •  Self service sandboxes provide real value - they often become areas of true innovation.. •  It helps the ‘underserved’. Most enterprises cannot fund enough BI to feed the masses. ROADMAPROADMAP TO MODERNIZATION
  • 16. Historically with self service, that fear is well founded.. When Sports Authority started the journey to data warehouse modernization, we had: •  “Shadow IT” sandboxes everywhere •  Over 1900 MS Access databases on user desktops – 16,800 mdb files (purpose of most were unknown) •  One MS Access database supporting 130 users and containing 50 different tables (many at max size). •  Most users queried transactional systems directly to populate their data marts, impacting performance of those transaction systems dramatically. ROADMAP TO MODERNIZATION
  • 17. ROADMAP TO MODERNIZATION HOST SYSTEM . Applications Application Application Application Data Source Ad-Hoc Report Consumers Data Sources Data Source Application POS eCommerce Enterprise Data Warehouse Corporate Report Consumers Scales Transactional Databases Scales A picture of our world….
  • 18. Change is difficult, however, IT teams must resist the temptation to “own” everything. The truth is… •  Overly centralized BI teams can't deliver the domain expertise, responsiveness and speed most organizations require. •  While a centralized team does a good job in creating consistency and governance across certain key subject areas, it creates a bottleneck, causing most users to wait too long to get their requirements met. •  The future of BI and analytics is about enabling both a centralized BI function as well as the decentralized analysis occurring within the company. ROADMAPROADMAP TO MODERNIZATION
  • 19. It just takes the right technology… ROADMAP Plus, we all know that self-service works… ROADMAP TO MODERNIZATION
  • 20. ROADMAP TO MODERNIZATION Stage 1 What does your technology look like today? Is this your data architecture?
  • 21. Step #2: Pick your future-state data platform ROADMAP TO MODERNIZATION
  • 22. What are kind of environment are we looking for? •  Secure •  Universally available •  Promotes data sharing •  Scalable •  Reliable •  Manageable •  Easy to use •  Cost-effective ROADMAP TO MODERNIZATION Where can you find such an environment? Look to a cloud platform, like Google, Microsoft or Amazon…
  • 24. What is BigQuery? •  A fully managed (Saas) data analytics service •  ‘Pay for what you use’ model -- very low cost •  Familiar SQL Interface •  Super-fast! Query against terabytes of data in seconds •  Elastic, auto-scaling, up to petabyte-scale databases •  Truly ‘Big Data’ – comparable to Hadoop/SQL or Spark •  Programmable - APIs, APIs, APIs…. ROADMAP TO MODERNIZATION
  • 25. How does BigQuery work? •  The largest columnar database on earth •  Optimized for selection, aggregation •  Provides superior data compression •  Stores data differently than a traditional RDBMS ROADMAP TO MODERNIZATION
  • 26. Step #3: Offer Personal Sandboxes ROADMAP TO MODERNIZATION
  • 27. ROADMAP TO MODERNIZATION Stage 2 Google BigQuery Google Cloud Storage Allow users to build personal sandboxes in the cloud environment…
  • 28. ROADMAP TO MODERNIZATION Stage 2 At this point, the new sandboxes (Mode 2) sit beside the old EDW (Mode 1)…
  • 29. Step #4: Experiment with “Citizen” Tools ROADMAP TO MODERNIZATION
  • 30. We live in the era of the ‘Citizen’ knowledge worker… ROADMAP TO MODERNIZATION
  • 31. Easy-to-use tools are easing business users into functions which have traditionally been handled by IT •  Data blending (e.g. Alteryx, ) •  Data quality & MDM (e.g. Alteryx, Reltio, Dell Boomi ) •  Data modeling and virtualization (e.g. Looker, Denodo) •  Data visualization (e.g. Tableau, Clikview, PowerBI, Microstrategy 10) •  Lightweight integration and iPaas (e.g. Dell Boomi, Snaplogic) •  Even…. Data Science! (e.g. R, Python Pandas) ROADMAP TO MODERNIZATION
  • 32. Generally, these tools are only appropriate for SMEs or people who are currently your ‘super users’. But, they are extremely powerful and give these business data analysts great freedom to explore, innovate and share valuable data assets. These tools, extend the reach of IT and actually help eliminate some age-old problems, for example…. ROADMAP TO MODERNIZATION
  • 33. ROADMAP TO MODERNIZATION Stage 3 Where do these tools fit into the new data architecture?
  • 35. Step #5: Build Core Data Sets in the Cloud ROADMAP TO MODERNIZATION
  • 36. ROADMAP TO MODERNIZATION Stage 4 Google BigQuery Google Cloud Storage Core Datasets
  • 38. Step #6: Migrate to the Data Warehouse of the Future ROADMAP TO MODERNIZATION
  • 39. ROADMAP TO MODERNIZATION Stage 5 begins with a full Data Lake, because… •  The lake supports direct (Mode 2) discovery against new data sets. •  It provides a platform for Big Data – both structured and unstructured. •  Its scale-out architecture allows more data to be collected and retained. •  It can lower upfront costs, by delaying transformation and modeling until needed. Caveats: must define platform, security, data management, etc.
  • 40. ROADMAP TO MODERNIZATION Notice the full Data Lake and cloud-based Hadoop for Big Data…. Stage 5 Google Cloud Storage Google BigQuery Google Cloud DataProc
  • 42. ROADMAP TO MODERNIZATION Join SQL – over user data set + core data set BigQuery Sandbox Project UserSandbox UserSandbox CoreSubjectArea UserSandbox UserSandbox Data set secured to an individual user CoreSubjectArea UserSandbox UserSandbox UserSandbox UserSandbox CoreSubjectArea CoreSubjectArea CoreSubjectArea Data set secured to an individual user Core warehouse data set – read only Plain SQL – only against user sandbox data set Sports Authority - SA Data Landscape 11/2/2015 Page 1 Users enjoy a powerful data world consisting of personal sandboxes and core data sets in a new elastic data warehouse.
  • 43. ROADMAP In Review, the Steps to Data Warehouse Modernization 1.  Adopt a Mode 2 mindset - with a focus on Self Service. 2.  Pick a new platform for the future-state data world 3.  Offer personal sandboxes for exploration/discovery 4.  Introduce and promote “Citizen” data tools 5.  Build core data sets in the cloud 6.  Migrate completely to the Data Warehouse of the Future ROADMAP TO MODERNIZATION