The Codex of Business Writing Software for Real-World Solutions 2.pptx
Using a Data Lake at the core of a Life Assurance business
1. INTERNAL USE ONLY
Using a Data Lake at the core of a Life Assurance business
Hadoop World Summit
April 13th 2016
Rajdeep Mukherjee & Chris Murphy
2. INTERNAL USE ONLY
Zurich is a global insurance company founded in
1872 ,Head Quartered in Zurich Switzerland.
Zurich business is organized into three core business
segments: General Insurance, Global Life and
Farmers.
Zurich’s customers include
– Individuals.
– small businesses.
– mid-sized and large companies, including
multinational corporations.
in more than 170 countries.
Zurich Insurance – Introduction
2
3. INTERNAL USE ONLY
Insurance Industry – Key trends
The key trends impacting the business
– Digital Trends : Consumers are looking for simplicity ,
transparency and speed in their transaction with business .
Relentless march of online and mobile technologies is continuing to
fuel this change . A Digital transformation needs easy and quick
access to data as a foundation.
– Technological : IOT and sensors presenting new opportunities and
challenges at the same time and advent of Big data techs is
allowing companies to process unstructured data to gain insights in
conjunction with the structured data.
– Risks: Emerging risks due to new technology ,human interaction ,
habits needs advanced analytical models to predict losses.
– Regulatory : The effect of global regulations such as SOX , GLB
and solvency II are driving insurers to ramp up Enterprise data
management
3
Insurance
Digital
Trends
Analytics
Emerging
Risks
Regulations
4. INTERNAL USE ONLY
State of Data Management
Fragmented Landscape.
Rigid data design fails to Incorporate local business requirements
Very long Change cycles.
4
O
P
E
R
A
T
I
O
N
S
o
P
E
R
A
T
I
O
N
L
O
B
A
d
h
o
c
C
or
p
or
at
e
CRM Policy
Mgmt
Claim
Mgmt
ERP
ODS LoB Marts Spread sheets EDW
External Data
Business Users
5. INTERNAL USE ONLY
What Capabilities are required to Keep up with the Trends
Capability to store all data(Internal, External , Structured , Unstructured ) at Low cost.
Capability to curate and expose Business Views on Demand.
Data Fabric to support different workloads (Operational and Analytical).
Support Rapid Change cycles.
Enable metadata management and data Lineage.
Govern where required don’t govern everything.
Scaling up should be a low cost effort.
Enable business Friendly tooling
“Make App , Analytics and Data a seamless process “
5
Speed
App
AnalyticsData
6. INTERNAL USE ONLY
Zurich Data Lake – Conceptual Architecture
6
CRM Policy
Mgmt
Claim
Mgmt
ERP
Life GC UK-GI BU
Customer
Policy
Claim
Customer
Policy
Claim
Customer
Policy
Claim
Customer
Policy
Claim
Customer Policy Claim
Raw Store
Everything
with History
Enterprise
Provisioning
Curation
Layer
LoB Views
Curation
Group Level
Views
Consumption Real-time Interactive Batch
Flattening
Labelling
Data Sources
7. INTERNAL USE ONLY
Zurich Data Lake - Technical Architecture
7
Batch
Ingestion
Micro
Batch
Real Time
Ingestion
Frameworks
Adapters
Ingest Persist ,Process, Provision Curate
RAW Layer
Enterprise Provision
layer
LoB
Views
Corporate
Views
Security Mgmt
Metadata Mgmt
Operations Mgmt
Consume
API
Interactive
SQL
Batch SQL
S
O
U
R
C
E
Kerberos
AD
IBM
Ambari
RANGER
Hcatalogue
Completely fragmented Insight
EDW meets corporate goals only doesn’t include all the local details
Spread sheet has fidelity problem
Point to point Interfaces
But the problem with such an is you try to create one schema which we think will fit all but it almost never does
This gives rise to Spread sheets and more Lob Data Marts
This is just with Internal Structured data !