SlideShare uma empresa Scribd logo
1 de 19
Baixar para ler offline
1
Selecting Right Data Modeling Strategy
by Vinay Patange
3
Introduction
3
Who We Are: Facts and Figures
 About 150 years old with Market Cap of USD$50 bn
 1700 branches, 5600 ATMs in more than 70 countries.
 Presence predominantly in Emerging Markets
 About 75,000 worldwide staff
 Technology Development in Singapore, Malaysia, U.K. and India
 Singapore has about 6000 staff
 Leaders in Foreign Exchange Currencies (FX) in Emerging Market
Consumer Banking Wholesale Banking
Financial Markets
Corporate Banking
 Business Decision Making
 Timely Information (Operational Decisions, running daily business)
 Ad-Hoc Analysis (Explorative, what went well and what did not go well)
 Predictive Analytic Tools (What if scenarios)
 Interactive Visualization (Trends and Patterns)
 Areas of Information and Intelligence
 Online Transaction Systems
 Data Warehouse
 Data Marts
 Operational Data Stores
 End User Computing
4
What lies beneath the Business Analytics?
Data is the Company’s most valuable asset and keeping it in right data structure is
equally important to derive the information and intelligence.
 Data Structures/Models influence
 Business Rules Implementation (Cardinality, Optionality and Business Representation)
 Information Retrieved and Interpreted (Metadata, Hierarchies and Metrics)
 Data Integrity and Quality
 Data Stewardship & Governance
 Operational Efficiencies in Data Management
5
Why Data Modeling is Important ?
Data Models explain the Business Rules and Selecting Right Data Modeling
Strategy is key to the success of Data Management
 Multiple persistent data layers create data obsolescence with silos and redundant processes.
 There are approximately three times more offline systems than on-line systems
6
Challenges in Information Management Landscape
Account
(Africa)
Local Reg
Reporting
Cost Reporting
MS Access
MM APPLE
SQL Svr
Trades
Mango
SQL Svr
Capital
AP
eProc
T&E
AM
GL
RMI
PMI
ECMI
BS MI
Risk Frontier
Accounting & Costs
TP Systems
Core and Loan TP
Systems
SIP
Commodities
FX DB
MS Access
DPLSales
BIReportingLayer(XLCube)
Sales & Marketing
Product Control
Sales Cube
Country Finance
Money Market Derivatives
Exotics
Equities
Equity Derivatives
Cash
Fixed Income
Bond Trades
Repos
Bonds
Bloomberg
PnL
IREC
Party Static
DPL Cube
Traders P&L
ODS
Balance
Sheet
Liquidity
Fund
Pricing
Gabriel
(FSA)
FSA
RRT
Tool
Calculation Engine
Performance
Reports
Liquidity MI
Risk Mgt
Reports
EBBS
Core BankingCorp Loans
RDS
DIH
RLS
CENTRY
Auto Loans
Collateral
Auto Loans
Credit Cards
Netting
Cash & Pooling
Collateral
AR/Billing
Pipeline
Collection
System
InterComp
Server
DMS
Hyperion
(Management)
Pipeline
Management
Reporting
Financial
Reporting
WB Cube
CB Cube
Magic Packs
Insight Packs
NF KPI Non Financials
PDW
People
Wise
HR BFS
(Access)
Static
Non PSGL entities
Management Allocations
Country Finance
Country Finance
IDS
Local Reg
Hyperion
(Statutory)
Centrally
managed BU’s
T1-T4
Journals
IFRS Cube
Reg, Tax,
WB, Others
Segmental
Cube
CMM Data
Collection
Templates
DCS
Budgets and
Forecast
GBS Cube
(Budgetting)
Financial Markets
Countries not in CDW
1
2
3
4
5
6
7
8
10
1111
1212
9
1313 1414
1515
1516
Manual Journal
Entries by
Country Finance
Group Finance
(Adjustments)
ALM
PSGL Cube
PAS 2
Management
Adjustments
Payroll
Non PSGL Info
PAS
UK MI
RFRAME
(UK)
MFU
MFU & Mapping
Tables
Mapping Tables
Templates
Adjustments
Downgrade
Provisions
Cheques
Private Banking
Collateral
CollateralAggregator
Local Reg
Reporting
CRM
Sales Pipeline
FDW
FDW
FDW
RSA
RSA
RSA
Other Other Other
CP
Spring
watch
ALM
ALM Reports
RSA
FDW
PAS
No prescriptive data modeling strategies available in OLAP environment
7
Approach to Modeling Strategy Selection
 Types of Persistent Layers & Model
Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration - Business
Area Specific v/s Enterprise Model
 Vendor Models v/s In-house Models
 Selection of Hierarchical Structures
 Technology Considerations
 Business Coverage
 Business Entities
 Operational V/s Analytics
 Consumption Type (Raw,
Standardised, Derived)
 Metadata Requirements
 Timeliness
 History
Business Requirement Modeling Aspect
Selection of Right Modeling Strategy Depends on Business Drivers and Other Aspects
Hybrid
(3+2NF)
ROLAP/
MOLAP
Modeling Strategy
Star
8
Modeling Levels – Top Down Approach
Conceptual
Model
TreasuryRisk Finance
Customer Product Employee Geography
Organization
Transactions
Channels
Subject
Area Model
Logical Model
Physical Model
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
What are the Applicable Modeling Levels?
Subject Area
Level
Conceptual
Logical
Physical
SemanticODS Core DWStagingOLTP
Certain Persistent Layers do not require all levels of modeling.
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
What Normalization Techniques are appropriate?
Subject Area
Level
Conceptual
Logical
Physical
SemanticODS Core DWStagingOLTP
3NF/2NF
(Hybrid)
Schema Type
Normalisation Type depends on the selected persistent layer
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
ROLAP/
MOLAP
Flat3NF
3NF/2NF
(Hybrid)
Most Disputed Modeling
Strategies
11
What Level of Abstraction is appropriate?
Business
Area Specific
Highly
Abstracted
 Readily Usable with Business Specific Attribute
 Easy to understand
 Quick to develop and easy to manage
 Not suitable for Enterprise Data Level Integration
 Higher Abstraction accommodates more types
 General Practice is to use Vendor supplied models
 Most Industry Specific Models come with 2000+ entities and 10,000+
Attributes. Highly Flexible
 Suitable for Enterprise Level Data Warehouse.
 Harder to comprehend for business
 Requires extensive modeling effort
 Longer and Expensive to implement and affects Time to Market.
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
12
Example of Highly Abstract Models
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
Choose carefully whether abstracted models is the right choice to solve your analytic problem
Require several joins to
explain highly abstracted
concepts such as Locator
Example of Attributes in Enterprise Data Model
 Customer Domicile Country Code
 Incorporation Country Code
13
Example of Business Area Specific Model
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
In 80% Cases, analytic needs require Business Area Specific problems to be solved
Example of Fixed Income Derivative Model
Abstraction Level is at Product Family/Asset Class
Extensions
anchor on main
entity
Financial Markets
14
Levels of Integration Requirements
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
Fixed Income
Flow Products Exotics
Bonds Money Market
Equities
Retail Banking
Commodities
Currencies
Corporate
Banking
Compliance
Department Level
Integration
Division Level
Integration
Determine the right level of data integration to get the right level of abstraction
Enterprise Level
Integration
FinanceRiskHR
15
Vendor Models v/s In-house
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
- Use vendor models as reference and carve out applicable entities and customize it
- Consider usage of frameworks
In-House
 A good starting reference point
 Requires In-depth understanding
of definitions of generic concepts
 Discipline in customizing models
 Ambiguity in data mapping to
several thousand entities and
attributes
Vendor Models
 Requires high degree of
modeling skills .
 Solves business specific or
division level problems
 Can be customized to be flexible
enough for that level
 Easier to create business
specific model views.
16
Hierarchical Structures
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
Recursive relationships do not work all the time. Consider using flattened hierarchy.
17
Technology Considerations
 Types of Persistent Layers &
Model Levels
 Levels of Normalisation
 Levels of Abstraction
 Levels of Integration -
Business Area Models v/s
Enterprise Model
 Vendor Models v/s In-house
Models
 Selection of Hierarchical
Structures
 Technology Considerations
Appliance vendors emerging strong in OLAP environment and many banks investing in
building enterprise level warehouse
 Certain Database Appliances designed to work well with
abstracted models but can be expensive
 Highly normalized physical models difficult to implement. Most
turn into hybrid of 3NF and 2NF
 Constraints can be on number of joins and length of composite
surrogate keys in dimensional models
 BI tool adaptability to consumption layer
 Efficient Information Delivery Model
 Consistent data model views along the food chain
 Reduction in development costs
 Qualitative Data (usefulness of data)
 Reduction of redundancies in data processing
 Speed to market
 Elimination of manual processes
18
Value Proposition in Selecting Right Data Modeling Strategy
19
References
 IBM Corporation
 Teradata Corporation
 Kimball University – Dr. Ralph Kimball
 Information Management Magazine – September 2002

Mais conteúdo relacionado

Mais procurados

2468 process innovation & enterprise architecture -(foundation for operation...
2468  process innovation & enterprise architecture -(foundation for operation...2468  process innovation & enterprise architecture -(foundation for operation...
2468 process innovation & enterprise architecture -(foundation for operation...Ravi Sarkar
 
Ifw framework for banking industry presentation
Ifw framework for banking industry presentationIfw framework for banking industry presentation
Ifw framework for banking industry presentationRavi Sarkar
 
Career Options And Preparation For I Te S Jobs
Career Options And Preparation For I Te S JobsCareer Options And Preparation For I Te S Jobs
Career Options And Preparation For I Te S JobsHyderabad Chapter of ICWAI
 
Sungard Global trading Presentation
Sungard Global trading PresentationSungard Global trading Presentation
Sungard Global trading Presentationahemeury
 
Spend Analysis - Process, Methodology
Spend Analysis - Process, MethodologySpend Analysis - Process, Methodology
Spend Analysis - Process, MethodologyRam Raghuraman
 
Spend Analysis: It’s What You Do With it That Matters
Spend Analysis: It’s What You Do With it That MattersSpend Analysis: It’s What You Do With it That Matters
Spend Analysis: It’s What You Do With it That MattersSAP Ariba
 
Market Abuse Detection
Market Abuse DetectionMarket Abuse Detection
Market Abuse DetectionRaja Das
 
FESA Financial & Professional Accounting
FESA Financial & Professional AccountingFESA Financial & Professional Accounting
FESA Financial & Professional AccountingFlexSystem fesa-s.com
 
Source-to-Contract (S2C) Outsourcing – Significant Value Potential but Challe...
Source-to-Contract (S2C) Outsourcing – Significant Value Potential but Challe...Source-to-Contract (S2C) Outsourcing – Significant Value Potential but Challe...
Source-to-Contract (S2C) Outsourcing – Significant Value Potential but Challe...Everest Group
 

Mais procurados (9)

2468 process innovation & enterprise architecture -(foundation for operation...
2468  process innovation & enterprise architecture -(foundation for operation...2468  process innovation & enterprise architecture -(foundation for operation...
2468 process innovation & enterprise architecture -(foundation for operation...
 
Ifw framework for banking industry presentation
Ifw framework for banking industry presentationIfw framework for banking industry presentation
Ifw framework for banking industry presentation
 
Career Options And Preparation For I Te S Jobs
Career Options And Preparation For I Te S JobsCareer Options And Preparation For I Te S Jobs
Career Options And Preparation For I Te S Jobs
 
Sungard Global trading Presentation
Sungard Global trading PresentationSungard Global trading Presentation
Sungard Global trading Presentation
 
Spend Analysis - Process, Methodology
Spend Analysis - Process, MethodologySpend Analysis - Process, Methodology
Spend Analysis - Process, Methodology
 
Spend Analysis: It’s What You Do With it That Matters
Spend Analysis: It’s What You Do With it That MattersSpend Analysis: It’s What You Do With it That Matters
Spend Analysis: It’s What You Do With it That Matters
 
Market Abuse Detection
Market Abuse DetectionMarket Abuse Detection
Market Abuse Detection
 
FESA Financial & Professional Accounting
FESA Financial & Professional AccountingFESA Financial & Professional Accounting
FESA Financial & Professional Accounting
 
Source-to-Contract (S2C) Outsourcing – Significant Value Potential but Challe...
Source-to-Contract (S2C) Outsourcing – Significant Value Potential but Challe...Source-to-Contract (S2C) Outsourcing – Significant Value Potential but Challe...
Source-to-Contract (S2C) Outsourcing – Significant Value Potential but Challe...
 

Destaque

UALR School of Masscomm Broadcast Journalism
UALR School of Masscomm Broadcast JournalismUALR School of Masscomm Broadcast Journalism
UALR School of Masscomm Broadcast JournalismUALR School of Masscomm
 
Portaria n 376 mct cidades digitais
Portaria n 376 mct cidades digitaisPortaria n 376 mct cidades digitais
Portaria n 376 mct cidades digitaisCarlos França
 
Buscaminas final Pachi Asier
Buscaminas final Pachi  AsierBuscaminas final Pachi  Asier
Buscaminas final Pachi AsierPachi Martínez
 
Casos de exito easyonpad
Casos de exito easyonpadCasos de exito easyonpad
Casos de exito easyonpadJavier Gonzalez
 
Falcon Football '09
Falcon Football '09Falcon Football '09
Falcon Football '09Nicimolina
 
Ballona Wetlands: Its Diverse Historical Development
Ballona Wetlands: Its Diverse Historical DevelopmentBallona Wetlands: Its Diverse Historical Development
Ballona Wetlands: Its Diverse Historical Developmentjoncreigsakamoto
 
Guia4 Muestra
Guia4 MuestraGuia4 Muestra
Guia4 Muestraiejcg
 
Μεταβίβαση Δικαιωμάτων 2016|Κατηγορίες Μεταβίβασης
Μεταβίβαση Δικαιωμάτων 2016|Κατηγορίες ΜεταβίβασηςΜεταβίβαση Δικαιωμάτων 2016|Κατηγορίες Μεταβίβασης
Μεταβίβαση Δικαιωμάτων 2016|Κατηγορίες ΜεταβίβασηςAgrosimvoulos
 
Tecnologias Digitais para a Sala de Aula
Tecnologias Digitais para a Sala de AulaTecnologias Digitais para a Sala de Aula
Tecnologias Digitais para a Sala de Aularosemaralopes
 
Welcome to Drupalcamp Estonia 2012
Welcome to Drupalcamp Estonia 2012Welcome to Drupalcamp Estonia 2012
Welcome to Drupalcamp Estonia 2012drupalcampest
 
Designing Drupalcamp sites
Designing Drupalcamp sitesDesigning Drupalcamp sites
Designing Drupalcamp sitesdrupalcampest
 
Προγράμματα ΕΣΠΑ 2015
Προγράμματα ΕΣΠΑ 2015Προγράμματα ΕΣΠΑ 2015
Προγράμματα ΕΣΠΑ 2015Agrosimvoulos
 
160727 parousiasi nees_proskliseis_espa
160727 parousiasi nees_proskliseis_espa160727 parousiasi nees_proskliseis_espa
160727 parousiasi nees_proskliseis_espaAgrosimvoulos
 
Basics of videography
Basics of videographyBasics of videography
Basics of videographysrinsha k
 
Eje eléctrico del complejo QRS.
Eje eléctrico del complejo QRS.Eje eléctrico del complejo QRS.
Eje eléctrico del complejo QRS.Gustavo Moreno
 

Destaque (20)

UALR School of Masscomm Broadcast Journalism
UALR School of Masscomm Broadcast JournalismUALR School of Masscomm Broadcast Journalism
UALR School of Masscomm Broadcast Journalism
 
Portaria n 376 mct cidades digitais
Portaria n 376 mct cidades digitaisPortaria n 376 mct cidades digitais
Portaria n 376 mct cidades digitais
 
Evidencia061
Evidencia061Evidencia061
Evidencia061
 
Scan0322 000
Scan0322 000Scan0322 000
Scan0322 000
 
Buscaminas final Pachi Asier
Buscaminas final Pachi  AsierBuscaminas final Pachi  Asier
Buscaminas final Pachi Asier
 
Casos de exito easyonpad
Casos de exito easyonpadCasos de exito easyonpad
Casos de exito easyonpad
 
Falcon Football '09
Falcon Football '09Falcon Football '09
Falcon Football '09
 
Jeannie
JeannieJeannie
Jeannie
 
Ballona Wetlands: Its Diverse Historical Development
Ballona Wetlands: Its Diverse Historical DevelopmentBallona Wetlands: Its Diverse Historical Development
Ballona Wetlands: Its Diverse Historical Development
 
diabetes
diabetesdiabetes
diabetes
 
Loli obradoiro
Loli obradoiroLoli obradoiro
Loli obradoiro
 
Guia4 Muestra
Guia4 MuestraGuia4 Muestra
Guia4 Muestra
 
Μεταβίβαση Δικαιωμάτων 2016|Κατηγορίες Μεταβίβασης
Μεταβίβαση Δικαιωμάτων 2016|Κατηγορίες ΜεταβίβασηςΜεταβίβαση Δικαιωμάτων 2016|Κατηγορίες Μεταβίβασης
Μεταβίβαση Δικαιωμάτων 2016|Κατηγορίες Μεταβίβασης
 
Tecnologias Digitais para a Sala de Aula
Tecnologias Digitais para a Sala de AulaTecnologias Digitais para a Sala de Aula
Tecnologias Digitais para a Sala de Aula
 
Welcome to Drupalcamp Estonia 2012
Welcome to Drupalcamp Estonia 2012Welcome to Drupalcamp Estonia 2012
Welcome to Drupalcamp Estonia 2012
 
Designing Drupalcamp sites
Designing Drupalcamp sitesDesigning Drupalcamp sites
Designing Drupalcamp sites
 
Προγράμματα ΕΣΠΑ 2015
Προγράμματα ΕΣΠΑ 2015Προγράμματα ΕΣΠΑ 2015
Προγράμματα ΕΣΠΑ 2015
 
160727 parousiasi nees_proskliseis_espa
160727 parousiasi nees_proskliseis_espa160727 parousiasi nees_proskliseis_espa
160727 parousiasi nees_proskliseis_espa
 
Basics of videography
Basics of videographyBasics of videography
Basics of videography
 
Eje eléctrico del complejo QRS.
Eje eléctrico del complejo QRS.Eje eléctrico del complejo QRS.
Eje eléctrico del complejo QRS.
 

Semelhante a Selecting_the_Right_Data_Modelling_Stragegy_in_IM_Patange-2012

BI A Practical Perspective - By Team Computers
BI A Practical Perspective - By Team ComputersBI A Practical Perspective - By Team Computers
BI A Practical Perspective - By Team ComputersDhiren Gala
 
BI - A Practical Perspective -TBSL
BI - A Practical Perspective -TBSLBI - A Practical Perspective -TBSL
BI - A Practical Perspective -TBSLTBSL
 
Business Intelligence Challenges 2009
Business Intelligence Challenges 2009Business Intelligence Challenges 2009
Business Intelligence Challenges 2009Lonnell Branch
 
Presentation to HWVP
Presentation to HWVPPresentation to HWVP
Presentation to HWVPpricew
 
Aen010 Stroka 091907
Aen010 Stroka 091907Aen010 Stroka 091907
Aen010 Stroka 091907Dreamforce07
 
Overview of business intelligence
Overview of business intelligenceOverview of business intelligence
Overview of business intelligenceAhsan Kabir
 
Zanibal Financial Services Solutions
Zanibal Financial Services SolutionsZanibal Financial Services Solutions
Zanibal Financial Services SolutionsZanibal LLC
 
Achieving Sales Performance Optimization Through Automated Incentive Compensa...
Achieving Sales Performance Optimization Through Automated Incentive Compensa...Achieving Sales Performance Optimization Through Automated Incentive Compensa...
Achieving Sales Performance Optimization Through Automated Incentive Compensa...Callidus Software
 
A Student Introduction to ERP
A Student Introduction to ERPA Student Introduction to ERP
A Student Introduction to ERPTom Matys
 
Business Intelligence Industry Perspective Session I
Business Intelligence   Industry Perspective Session IBusiness Intelligence   Industry Perspective Session I
Business Intelligence Industry Perspective Session IPrithwis Mukerjee
 
Target operating model definition
Target operating model definitionTarget operating model definition
Target operating model definitionStuart Robb
 
Become BI Architect with 1KEY Agile BI Suite - OLAP
Become BI Architect with 1KEY Agile BI Suite - OLAPBecome BI Architect with 1KEY Agile BI Suite - OLAP
Become BI Architect with 1KEY Agile BI Suite - OLAPDhiren Gala
 
CRM@Oracle: CRM Analytics
CRM@Oracle: CRM AnalyticsCRM@Oracle: CRM Analytics
CRM@Oracle: CRM AnalyticstbOracleCRM
 
Esouag r12 presentation
Esouag r12 presentationEsouag r12 presentation
Esouag r12 presentationBerry Clemens
 
Dealer management system on sap cloud platform
Dealer management system on sap cloud platformDealer management system on sap cloud platform
Dealer management system on sap cloud platformVirendra Rai, PMP
 
Fei It Alignement With With Business V2
Fei It Alignement With With Business V2Fei It Alignement With With Business V2
Fei It Alignement With With Business V2Dr.Adel Ghannam
 

Semelhante a Selecting_the_Right_Data_Modelling_Stragegy_in_IM_Patange-2012 (20)

bi
bibi
bi
 
BI A Practical Perspective - By Team Computers
BI A Practical Perspective - By Team ComputersBI A Practical Perspective - By Team Computers
BI A Practical Perspective - By Team Computers
 
BI - A Practical Perspective -TBSL
BI - A Practical Perspective -TBSLBI - A Practical Perspective -TBSL
BI - A Practical Perspective -TBSL
 
Business Intelligence Challenges 2009
Business Intelligence Challenges 2009Business Intelligence Challenges 2009
Business Intelligence Challenges 2009
 
Presentation to HWVP
Presentation to HWVPPresentation to HWVP
Presentation to HWVP
 
Aen010 Stroka 091907
Aen010 Stroka 091907Aen010 Stroka 091907
Aen010 Stroka 091907
 
Overview of business intelligence
Overview of business intelligenceOverview of business intelligence
Overview of business intelligence
 
Zanibal Financial Services Solutions
Zanibal Financial Services SolutionsZanibal Financial Services Solutions
Zanibal Financial Services Solutions
 
Achieving Sales Performance Optimization Through Automated Incentive Compensa...
Achieving Sales Performance Optimization Through Automated Incentive Compensa...Achieving Sales Performance Optimization Through Automated Incentive Compensa...
Achieving Sales Performance Optimization Through Automated Incentive Compensa...
 
Streebo Corporate Profile - GS
Streebo Corporate Profile - GSStreebo Corporate Profile - GS
Streebo Corporate Profile - GS
 
A Student Introduction to ERP
A Student Introduction to ERPA Student Introduction to ERP
A Student Introduction to ERP
 
Business Intelligence Industry Perspective Session I
Business Intelligence   Industry Perspective Session IBusiness Intelligence   Industry Perspective Session I
Business Intelligence Industry Perspective Session I
 
Target operating model definition
Target operating model definitionTarget operating model definition
Target operating model definition
 
Become BI Architect with 1KEY Agile BI Suite - OLAP
Become BI Architect with 1KEY Agile BI Suite - OLAPBecome BI Architect with 1KEY Agile BI Suite - OLAP
Become BI Architect with 1KEY Agile BI Suite - OLAP
 
CRM@Oracle: CRM Analytics
CRM@Oracle: CRM AnalyticsCRM@Oracle: CRM Analytics
CRM@Oracle: CRM Analytics
 
Esouag r12 presentation
Esouag r12 presentationEsouag r12 presentation
Esouag r12 presentation
 
Oracle BI apps Online Training
Oracle BI apps Online TrainingOracle BI apps Online Training
Oracle BI apps Online Training
 
Dealer management system on sap cloud platform
Dealer management system on sap cloud platformDealer management system on sap cloud platform
Dealer management system on sap cloud platform
 
SOA and M&A
SOA and M&ASOA and M&A
SOA and M&A
 
Fei It Alignement With With Business V2
Fei It Alignement With With Business V2Fei It Alignement With With Business V2
Fei It Alignement With With Business V2
 

Selecting_the_Right_Data_Modelling_Stragegy_in_IM_Patange-2012

  • 1. 1
  • 2. Selecting Right Data Modeling Strategy by Vinay Patange
  • 3. 3 Introduction 3 Who We Are: Facts and Figures  About 150 years old with Market Cap of USD$50 bn  1700 branches, 5600 ATMs in more than 70 countries.  Presence predominantly in Emerging Markets  About 75,000 worldwide staff  Technology Development in Singapore, Malaysia, U.K. and India  Singapore has about 6000 staff  Leaders in Foreign Exchange Currencies (FX) in Emerging Market Consumer Banking Wholesale Banking Financial Markets Corporate Banking
  • 4.  Business Decision Making  Timely Information (Operational Decisions, running daily business)  Ad-Hoc Analysis (Explorative, what went well and what did not go well)  Predictive Analytic Tools (What if scenarios)  Interactive Visualization (Trends and Patterns)  Areas of Information and Intelligence  Online Transaction Systems  Data Warehouse  Data Marts  Operational Data Stores  End User Computing 4 What lies beneath the Business Analytics? Data is the Company’s most valuable asset and keeping it in right data structure is equally important to derive the information and intelligence.
  • 5.  Data Structures/Models influence  Business Rules Implementation (Cardinality, Optionality and Business Representation)  Information Retrieved and Interpreted (Metadata, Hierarchies and Metrics)  Data Integrity and Quality  Data Stewardship & Governance  Operational Efficiencies in Data Management 5 Why Data Modeling is Important ? Data Models explain the Business Rules and Selecting Right Data Modeling Strategy is key to the success of Data Management
  • 6.  Multiple persistent data layers create data obsolescence with silos and redundant processes.  There are approximately three times more offline systems than on-line systems 6 Challenges in Information Management Landscape Account (Africa) Local Reg Reporting Cost Reporting MS Access MM APPLE SQL Svr Trades Mango SQL Svr Capital AP eProc T&E AM GL RMI PMI ECMI BS MI Risk Frontier Accounting & Costs TP Systems Core and Loan TP Systems SIP Commodities FX DB MS Access DPLSales BIReportingLayer(XLCube) Sales & Marketing Product Control Sales Cube Country Finance Money Market Derivatives Exotics Equities Equity Derivatives Cash Fixed Income Bond Trades Repos Bonds Bloomberg PnL IREC Party Static DPL Cube Traders P&L ODS Balance Sheet Liquidity Fund Pricing Gabriel (FSA) FSA RRT Tool Calculation Engine Performance Reports Liquidity MI Risk Mgt Reports EBBS Core BankingCorp Loans RDS DIH RLS CENTRY Auto Loans Collateral Auto Loans Credit Cards Netting Cash & Pooling Collateral AR/Billing Pipeline Collection System InterComp Server DMS Hyperion (Management) Pipeline Management Reporting Financial Reporting WB Cube CB Cube Magic Packs Insight Packs NF KPI Non Financials PDW People Wise HR BFS (Access) Static Non PSGL entities Management Allocations Country Finance Country Finance IDS Local Reg Hyperion (Statutory) Centrally managed BU’s T1-T4 Journals IFRS Cube Reg, Tax, WB, Others Segmental Cube CMM Data Collection Templates DCS Budgets and Forecast GBS Cube (Budgetting) Financial Markets Countries not in CDW 1 2 3 4 5 6 7 8 10 1111 1212 9 1313 1414 1515 1516 Manual Journal Entries by Country Finance Group Finance (Adjustments) ALM PSGL Cube PAS 2 Management Adjustments Payroll Non PSGL Info PAS UK MI RFRAME (UK) MFU MFU & Mapping Tables Mapping Tables Templates Adjustments Downgrade Provisions Cheques Private Banking Collateral CollateralAggregator Local Reg Reporting CRM Sales Pipeline FDW FDW FDW RSA RSA RSA Other Other Other CP Spring watch ALM ALM Reports RSA FDW PAS No prescriptive data modeling strategies available in OLAP environment
  • 7. 7 Approach to Modeling Strategy Selection  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Specific v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations  Business Coverage  Business Entities  Operational V/s Analytics  Consumption Type (Raw, Standardised, Derived)  Metadata Requirements  Timeliness  History Business Requirement Modeling Aspect Selection of Right Modeling Strategy Depends on Business Drivers and Other Aspects Hybrid (3+2NF) ROLAP/ MOLAP Modeling Strategy Star
  • 8. 8 Modeling Levels – Top Down Approach Conceptual Model TreasuryRisk Finance Customer Product Employee Geography Organization Transactions Channels Subject Area Model Logical Model Physical Model  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations
  • 9. What are the Applicable Modeling Levels? Subject Area Level Conceptual Logical Physical SemanticODS Core DWStagingOLTP Certain Persistent Layers do not require all levels of modeling.  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations
  • 10. What Normalization Techniques are appropriate? Subject Area Level Conceptual Logical Physical SemanticODS Core DWStagingOLTP 3NF/2NF (Hybrid) Schema Type Normalisation Type depends on the selected persistent layer  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations ROLAP/ MOLAP Flat3NF 3NF/2NF (Hybrid) Most Disputed Modeling Strategies
  • 11. 11 What Level of Abstraction is appropriate? Business Area Specific Highly Abstracted  Readily Usable with Business Specific Attribute  Easy to understand  Quick to develop and easy to manage  Not suitable for Enterprise Data Level Integration  Higher Abstraction accommodates more types  General Practice is to use Vendor supplied models  Most Industry Specific Models come with 2000+ entities and 10,000+ Attributes. Highly Flexible  Suitable for Enterprise Level Data Warehouse.  Harder to comprehend for business  Requires extensive modeling effort  Longer and Expensive to implement and affects Time to Market.  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations
  • 12. 12 Example of Highly Abstract Models  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations Choose carefully whether abstracted models is the right choice to solve your analytic problem Require several joins to explain highly abstracted concepts such as Locator Example of Attributes in Enterprise Data Model  Customer Domicile Country Code  Incorporation Country Code
  • 13. 13 Example of Business Area Specific Model  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations In 80% Cases, analytic needs require Business Area Specific problems to be solved Example of Fixed Income Derivative Model Abstraction Level is at Product Family/Asset Class Extensions anchor on main entity
  • 14. Financial Markets 14 Levels of Integration Requirements  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations Fixed Income Flow Products Exotics Bonds Money Market Equities Retail Banking Commodities Currencies Corporate Banking Compliance Department Level Integration Division Level Integration Determine the right level of data integration to get the right level of abstraction Enterprise Level Integration FinanceRiskHR
  • 15. 15 Vendor Models v/s In-house  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations - Use vendor models as reference and carve out applicable entities and customize it - Consider usage of frameworks In-House  A good starting reference point  Requires In-depth understanding of definitions of generic concepts  Discipline in customizing models  Ambiguity in data mapping to several thousand entities and attributes Vendor Models  Requires high degree of modeling skills .  Solves business specific or division level problems  Can be customized to be flexible enough for that level  Easier to create business specific model views.
  • 16. 16 Hierarchical Structures  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations Recursive relationships do not work all the time. Consider using flattened hierarchy.
  • 17. 17 Technology Considerations  Types of Persistent Layers & Model Levels  Levels of Normalisation  Levels of Abstraction  Levels of Integration - Business Area Models v/s Enterprise Model  Vendor Models v/s In-house Models  Selection of Hierarchical Structures  Technology Considerations Appliance vendors emerging strong in OLAP environment and many banks investing in building enterprise level warehouse  Certain Database Appliances designed to work well with abstracted models but can be expensive  Highly normalized physical models difficult to implement. Most turn into hybrid of 3NF and 2NF  Constraints can be on number of joins and length of composite surrogate keys in dimensional models  BI tool adaptability to consumption layer
  • 18.  Efficient Information Delivery Model  Consistent data model views along the food chain  Reduction in development costs  Qualitative Data (usefulness of data)  Reduction of redundancies in data processing  Speed to market  Elimination of manual processes 18 Value Proposition in Selecting Right Data Modeling Strategy
  • 19. 19 References  IBM Corporation  Teradata Corporation  Kimball University – Dr. Ralph Kimball  Information Management Magazine – September 2002