The document summarizes Erik van der Hoeven's journey transforming customer data into wisdom through various data warehouse projects using DataVault 2.0 and automation with WhereScape. It outlines a future state architecture piloted with WhereScape, including the first implementations of a DataVault 2.0 data model and enterprise data model. It concludes that WhereScape helps provide a predictable, mature BI delivery process and framework for tool integration, while recommendations include creating a vision, using an architecture, building team skills, and automating with WhereScape.

1. Physical &Virtual DataVault 2.0 Automation
Erik van der Hoeven
17 October 2019
with

2. Agenda
• My journey
• Customer journey
• Future State Architecture
• WhereScape pilot
• First DV 2.0 implementation
• First EDM implementation
• Conclusion
• Recommendations

3. My journey of: Transforming your data into Wisdom!
2008 -2012
4 Kim
ball projects
Autom
ated pattern loading
2
DataVault 1.0 projects
DataVault 2.0Certificate
First DataVault 2.0 project
2013 2014 -2017 2018 2019 - present2018
First Big Data Project
Non Lean and mature process Lean and mature process
Erik van der Hoeven

4. Customer journey
What made this journey special
• Historization with DataVault 2.0
• Automation with WhereScape
• Tool integration
• Contract first
First EDM
im
plem
entation
04-2019
FutureStateArchitecture
Pilot
First DV
2.0 im
plem
entation
08-2019 - 09-201905-2019 10-2019

5. Future State Architecture
Source
Historised
Persistent Store
(RawVault)
Consumption
Data Delivery
Layer
Delivery
Transform
ations
Semantic Layer
Business
Transform
ations
Functional Tooling Database

6. PilotWhereScape
Define Test Score Launch
Architect Programmanager
Fin. Director
BI Team BI Team
Architect Programmanager
Fin. Director
Real value
Trust in the supplier
Trust in the BITeam
Loyalty from the BITeam +
Mature(2) dev team
Common understanding
Trust in the FSA
Foundation for future dev.

7. First DV 2.0 implementation
Solution Architecture
Savings
Mortgages
BizTalk Server
Azure
Integration
Services
PORTAL
Logging
Virtual
MDS
On Premise Cloud
Search
Customers
Persistent
RawVault
DataDelivery

8. First LDM implementation
Raw Vault: Data Vault Model
ODS Savings
Business Vault: EDM Based Data Model
ACBS MDS …
Data
Delivery
Layer
stg_SRC_SourceTable
Entity_S Entiy_L_EntityEntity_H
dv_CONS_Dimension
CONS_Dimension
dv_CONS_Fact
CONS_Fact
stg_SRC2_SourceTable
Virtual Staging
Staging
Raw Vault: Staging
Virtual Transformations + Business Rule Versioning
Persistent
Cached
Virtual
CACHED
Virtual
VirtualData Delivery: Consumer based model
Deployment Development
VirtualRawVault Base Views
Compress Timelines
Fix functional Timeline, Datatype Conversion, Attribute Naming
Determine Business Keys, Create SID
Lookup Reference Data, Split table, Calculate new Change Hash(es)
Union sources
dbo.SRC_SourceTable_H dbo.SRC_SourceTable_S dbo.SRC_SourceTable_L
bv_SRC_SourceTable_H bv_SRC_SourceTable_S bv_SRC_SourceTable_L
SQL Table Denodo Base View Denodo Interface View Denodo View

9. ConclusionWhereScape
• WhereScape helps us to have a predictable mature BI
Delivery Process
• It offers us an open framework where it helps us to
integrate with different tools
• It ensures that our Data Warehouse is fully auditable
and reliable (BCBS 239)
Pro
Con
• Integrating WhereScape with Denodo is not out of the
box.
• Open platform requires you to make choices
• Data & Model Driven

10. Recommendation
1. Create aVision for BI
2. Use an architecture to create a path
3. Build a loyal and skilful BITeam
4. UseWhereScape to automate your DataWarehouse
5. Aim high
6. Start now