Presentation by Luc Delanglez (DataLumen) at the Data Vault Modelling and Data Governance conference on Oct. 17, 2019: From the Data Governance trenches: A real-life perspective

•

0 gostou•173 visualizações

This document discusses data governance and provides guidance on getting started with a data governance program. It outlines key building blocks like a data catalog, workflows, and business and technical lineage. It also covers challenges like governing a multi-store data environment and ensuring data quality. The document recommends starting with understanding your data and building out foundational elements like a data catalog before operationalizing governance through workflows.

Tecnologia

From the Data Governance trenches
A real-life perspective

2
From the Data Governance trenches
19/10/2019
Find
Understand
Trust
How to better
Your Data

5
Find and
Understand
Relevant
for me
How to
access
the data
For which
purpose
to use
Who can I
share it
with
Who is
the SME
Who has
used it
before
Which
data is
similar
Linked
business
terms
Trust
Certified?
Quality
Reviews
Historical
usage
Is it governed?
Trusted
source?
Cross industry studies show that, on average, less than half of an organization’s structured data is
actively used in making decisions - HBR
Find, Understand and Trust Find Understand Trust

7
Building Blocks
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
DataGovernanceBuildingBlocks

8
Building Blocks - A Glossary Example
DataGovernanceBuildingBlocks

9
Building Blocks - Search
19/10/2019
DataGovernanceBuildingBlocks

10
19/10/2019
Building Blocks - Data Catalog –Search
DataGovernanceBuildingBlocks

11
19/10/2019
Building Blocks - Workflow – Critical to operationalize
DataGovernanceBuildingBlocks

12
Building Blocks - Typical Workflows
19/10/2019
DataGovernanceBuildingBlocks

13
Building Blocks - Business Lineage
19/10/2019
DataGovernanceBuildingBlocks

14
19/10/2019
Building Blocks - Technical Lineage
DataGovernanceBuildingBlocks

15
Building Blocks - End-to-End Lineage – For Compliance
19/10/2019
DataGovernanceBuildingBlocks

16
19/10/2019
Building Blocks –
MDM example - Relation to Business Process and Rules
DataGovernanceBuildingBlocks

18
GDPR Data Register - Connected & Reusable
GDPR
Data Sets
Processes
Data
Elements
Roles
Systems
Terms and
definitions
Projects …
GDPRAsPartOfYourDG

22Data Quality results
Fine grained measured in a DQ tool and uploaded
19/10/2019
BusinessRelevantDataQualityMetrics

23
Data Quality results – Aggregated to a higher level
19/10/2019
BusinessRelevantDataQualityMetrics

24
Example of DQ issue analysis of a report
19/10/2019
BusinessRelevantDataQualityMetrics

25
Data Quality results – Aggregated from column level to report level
19/10/2019
BusinessRelevantDataQualityMetrics

26
Tags, Ratings, Comments...
19/10/2019
BusinessRelevantDataQualityMetrics

28
The Multiple Data Store Reality
19/10/2019
Applications BI and visualisation tools Advanced analytics
Structured Data Semi structured and Unstructured Data
SQL NoSQL Real Time Python R….
GoverningAMulti-StoreReality

29
A Popular Data Integration Pattern
Structured Data
MDM
Party Prod
Loc
EDW
DM
Graph
database
Appliance
Semi structured and Unstructured Data
•
•
•
•
•
•
•
GoverningAMulti-StoreReality

30
Logical Data Lake
19/10/2019
Structured Data
MDM
Party Prod
Loc
Semi structured and Unstructured Data
ODS
DW
DM
Staging
Images
Video Sensor
Published
Archived
In
progress
data
text
Data Virtualization services Data Catalog - Glossary
RawUnstructured
lessgoverned
Trusted-governed
Data Consumers
GoverningAMulti-StoreReality

31
Data Catalog – Fundamental Role
19/10/2019
Raw
Data
Clean and
Integrate
service
Trusted Data
Data Catalog
Re-usable Data
Service
Raw
Data
Producers
Clean and
Integrate
service
Publish
Consume
Trusted Data
Reuse data or service Feedback
Consumers
Validation and Certification
GoverningAMulti-StoreReality

32
Feature Promise < > Governance Nightmare
19/10/2019
•
•
GoverningAMulti-StoreReality

33
How to bring in volatile/variety of sources?
ETL ETL ETL
ETL ETL
DMDWH
Staging
Areas
Source
systems
ETL ETL ETL ETL
GoverningAMulti-StoreReality

34
Logical DWH Architecture
ETL ETL ETL
DMDWH
Staging
Areas
Source
systems
DataVirtualizationServer
AbstractionFederationCaching
GoverningAMulti-StoreReality

37
Getting Started
•
•
•
•
•
•
•
19/10/2019

Q&A
DATALUMEN, VELDKANT 31, 2550 KONTICH, BELGIUM
WWW.DATALUMEN.EU

Mais conteúdo relacionado

Mais procurados

Rick Mutsaers Informatica

BigDataExpo

Why Data Virtualization? By Rick van der Lans

Denodo

Multi Cloud Data Integration- Manufacturing Industry

alanwaler

Big Data Fabric Capability Maturity Model

Ross Collins

Watch full webinar here: https://bit.ly/3cZDAvo As COVID -19 continues to challenge entire healthcare ecosystems and forcing healthcare organizations to pivot without much notice, patient information interoperability and data transparency are increasingly taking center stage among healthcare stakeholders. This year, a new set of federal guidelines giving patients more access to their data goes into effect, improving interoperability. Even without this, most healthcare stakeholders would agree that better, and mobile, access, and interoperability of information could improve care and save time and lives. Watch on-demand this webinar to learn: - How health IT interoperability can help your healthcare organization move forward to better health reporting, patient matching and care coordination in 2021 and beyond. - How to set up your healthcare organization for success through more information transparency, how this can help your healthcare stakeholders. - COVID 19 has given federal agencies a lot of momentum to move even more quickly regarding implementing interoperability rules, what does this mean for your organization?

Discover how Covid-19 is accelerating the need for healthcare interoperabilit...

Denodo

Watch full webinar here: https://bit.ly/3kL160o Presented at Tableau Public Sector Day 2020, Singapore Enterprise organizations are shifting to self-service analytics as business users need real-time access to holistic and consistent views of data regardless of its location, source or type for arriving at critical decisions. Data Virtualization and Data Visualization work together through a universal semantic layer. Learn how they enable self-service data discovery and improve performance of your reports and dashboards. Watch this on-demand session to learn more about: - Combined use of Denodo and Tableau to achieve the best self-service BI experience - How data virtualization enables self-service analytics - Use case and lessons from customer’s success - Features in Denodo Tableau Native Connector

Accelerating Self-Service Analytics with Denodo and Tableau (Singapore)

Denodo

Bde presentation dv

BigDataExpo

Watch full webinar here: https://bit.ly/34gVVzH To capitalize on all their data, insurers need a flexible and easily adaptable data integration technology that allows them to keep up with the ever-changing and growing data environment. Data virtualization is that modern data integration technology. It can support insurers not only on their journey to digitization, but also on their future infrastructure changes and innovations, adding agility, flexibility and efficiency to data architectures. Join this webinar to: - Find out why data virtualization should be a part of your enterprise data strategy - See how this technology can help you capitalize on your data - Hear how many of your peers are already leveraging the Denodo Platform for Data Virtualization and the benefits they’re observing

A Successful Data Strategy for Insurers in Volatile Times (EMEA)

Denodo

Logical Data Fabric: Architectural Components

Denodo

Watch the full session: Denodo DataFest 2016 sessions: https://goo.gl/kPmzWU Gaining an enterprise view of the data across different independent lines of businesses is difficult when the operations, systems, and data are inherently siloed. VSP Global is a conglomerate operating different businesses across eyewear insurance, manufacturing, and retail. They are integrating the silos using a semantic data layer. In this presentation, the Enterprise Data Architect at VSP Global, Tim Fredricks will present: • The challenges associated with data siloed across different LOBs • How to build a semantic data layer using data virtualization • Centralizing business rules in the data virtualization layer This session also includes a panel discussion with: • Tim Fredricks, Enterprise Data Architect at VSP Global • Rick Hart, Director of Global Technology Solutions at BioStorage Technologies • Jeff Veis, VP Big Data Platform Marketing at HPE • Mike Litzkow, Sales Director at Denodo (as moderator) This session is part of the Denodo DataFest 2016 event. You can also watch more Denodo DataFest sessions on demand here: https://goo.gl/VXb6M6 This session is part of the Denodo DataFest 2016 event. You can also watch more Denodo DataFest sessions on demand here: https://goo.gl/VXb6M6

Denodo DataFest 2016: Enterprise View of Data with Semantic Data Layer

Denodo

Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...

Denodo

Date: 14th November 2018 Location: Keynote Theatre Time: 13:50 - 14:20 Speaker: Becky Smith Organisation: Denodo About: How many users inside and outside of your organization access your organization’s data? Dozens? Hundreds is probably more like it, each with their own structure and content requirements as well as different access rights. As a result, many organizations have witnessed the formation of “data delivery mills,” in various shapes and sizes. How does one create order and reliability in this world of chaotic data streams? Quite easily, if it’s done with data virtualization. According to Gartner, "through 2020, 50% of enterprises will implement some form of data virtualization as one enterprise production option for data integration.” Data virtualization enables organizations to gain data insights from multiple, distributed data sources without the time-consuming processes of data extraction and loading. This allows for faster insights and fact-based decisions, which help business realize value sooner. Join us to find out more about: • What data virtualization actually means and how it differs from traditional data integration approaches. • How you can connect and combine all your data in real-time, without compromising on scalability, security or governance. • The benefits of data virtualization and its most important use cases.

Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION

Matt Stubbs

An introduction to Business intelligence

Hadi Fadlallah

Introduction to business intelligence

ThilinaWanshathilaka

From Business Intelligence to Big Data - hack/reduce Dec 2014

Adam Ferrari

Executives are still waiting on our “Big Data Deep Insights”. Many of us are down the path of collecting, extracting, and analyzing our ever-growing data in Hadoop environments. We are building our data science expertise and expanding data governance. Yet still we are not getting what we are waiting for.This talk is about: 1. Getting to the right questions 2. Setting expectations with the executive team 3. The unintentional consequence of suddenly having lots of data 4. Framing the boundaries of our data science 5. Pragmatic data governance 6. Looking outside your data to 3rd party data

Asking the Right Questions of Your Data

DataWorks Summit

What makes it worth becoming a Data Engineer?

Hadi Fadlallah

Introduction to Data Engineering

Hadi Fadlallah

Watch full webinar here: https://bit.ly/3szm3PV In the digital transformation era, banks need a single view of all their data and a way to establish security controls across the entire infrastructure. This can be achieved with Data Virtualization. Banking institutions need to update their legacy systems and implement strategies and services that will transform them into digital financial organizations. They need agile access to information that can be leveraged to make timely business decisions, yet still fulfill the regulatory requirements. In the digital transformation era, banks need a single view of all their data and a way to establish security controls across the entire infrastructure. This webinar presents: - How data virtualization can help update and modernize data architectures, - Success stories of financial companies that already use this technology to differentiate themselves from the competition, optimize processes, and create new business opportunities through more agile data management.

Data Virtualization: Fulfilling The Digital Transformation Requirement In Ban...

Denodo

Mais procurados (19)

Rick Mutsaers Informatica

Why Data Virtualization? By Rick van der Lans

Multi Cloud Data Integration- Manufacturing Industry

Big Data Fabric Capability Maturity Model

Discover how Covid-19 is accelerating the need for healthcare interoperabilit...

Accelerating Self-Service Analytics with Denodo and Tableau (Singapore)

Bde presentation dv

A Successful Data Strategy for Insurers in Volatile Times (EMEA)

Logical Data Fabric: Architectural Components

Denodo DataFest 2016: Enterprise View of Data with Semantic Data Layer

Analyst Keynote: Forrester: Data Fabric Strategy is Vital for Business Innova...

Big Data LDN 2018: CONNECTING SILOS IN REAL-TIME WITH DATA VIRTUALIZATION

An introduction to Business intelligence

Introduction to business intelligence

From Business Intelligence to Big Data - hack/reduce Dec 2014

Asking the Right Questions of Your Data

What makes it worth becoming a Data Engineer?

Introduction to Data Engineering

Data Virtualization: Fulfilling The Digital Transformation Requirement In Ban...

Semelhante a Presentation by Luc Delanglez (DataLumen) at the Data Vault Modelling and Data Governance conference on Oct. 17, 2019: From the Data Governance trenches: A real-life perspective

Building an Organization for Functional Analytics ---------------------------------------------------------------------- Many organizations are struggling to figure out how to move ahead with strategic use of data and insights to grow their business. A solid Analytics Strategy seems to elude them. Should they focus on a modern data warehouse in the cloud? Do they have “Big Data”? What about reporting and self-service analytics? How do they deliver information to their customers and suppliers? Which tools are right for them? In this presentation, Ken Raetz will address each of these concerns, outlining a simple, yet functional strategy to building a team and growing the use of analytics in their organization. You will learn: 1. Why centralizing analytics in IT doesn’t work. 2. The roles IT and business play in analytics 3. Selecting tools and processes for analytics 4. Building highly functional teams 5. Partnering with outside vendors to augment team and accelerate early work 6. Analytics Adoption – How to ensure the strategy of analytics continues forward in the years to come

Decentralizing Analytics - A Strategy for Organizing Effective Analytics Teams

Ken Raetz

Big data analytics

Vikram Nandini

Bi orientations

Samia NACIRI

Implementing a Successful, Scalable, Governed BI Program

Pyramid Analytics

The Briefing Room with Robin Bloor and IBM Live Webcast Sept. 24, 2013 Watch the archive: https://bloorgroup.webex.com/bloorgroup/lsr.php?AT=pb&SP=EC&rID=7501927&rKey=664935ceb7de1aec Where to begin? That question remains prominent for many organizations who are trying to leverage the value of big data analytics. Most sources of big data are quite different than traditional enterprise data systems. This requires new skill sets, both for the granular integration work, as well as the strategic business perspective required to design useful solutions. Register for this episode of The Briefing Room to hear veteran Analyst Dr. Robin Bloor as he explains the pain points associated with modern data volumes and types. He will be briefed by Rick Clements of IBM, who will tout IBM's big data platform, specifically InfoSphere BigInsights, InfoSphere Streams and InfoSphere Data Explorer. He will also present specific use cases that demonstrate how IT and the line of business can springboard over existing challenges, gain insight and improve operational performance. Visit InsideAnalysis.com for more information

Entry Points – How to Get Rolling with Big Data Analytics

Inside Analysis

<p>Good data is like good water: best served fresh, and ideally well-filtered. Data Management strategies can produce tremendous procedural improvements and increased profit margins across the board, but only if the data being managed is of a high quality. Determining how Data Quality should be engineered provides a useful framework for utilizing Data Quality Management effectively in support of business strategy, which in turn allows for speedy identification of business problems, delineation between structural and practice-oriented defects in Data Management, and proactive prevention of future issues. Organizations must realize what it means to utilize Data Quality engineering in support of business strategy. This webinar will illustrate how organizations with chronic business challenges often can trace the root of the problem to poor Data Quality. Showing how Data Quality should be engineered provides a useful framework in which to develop an effective approach. This in turn allows organizations to more quickly identify business problems as well as data problems caused by structural issues versus practice-oriented defects and prevent these from re-occurring.</p>   <p>Learning Objectives:</p>   <ul><li>Understand foundational Data Quality concepts based on the DAMA Guide to Data Management Book of Knowledge (DAMA DMBOK), as well as guiding principles, best practices, and steps for improving Data Quality at your organization</li><li>Recognize how chronic business challenges for organizations are often rooted in poor Data Quality</li><li>Share case studies illustrating the hallmarks and benefits of Data Quality success</li></ul>

Data Quality Success Stories

DATAVERSITY

Accelerate Revenue with a Customer Data Platform

Lattice Engines

Enterprise Architecture (EA) provides a visual blueprint of the organization, and shows key inter-relationships between data, process, applications, and more. By abstracting these assets in a graphical view, it’s possible to see key interrelationships, particularly as they relate to data and its business impact across the organization. Join us for a discussion on how Data Architecture is a key component of an overall enterprise architecture for enhanced business value and success.

DAS Slides: Enterprise Architecture vs. Data Architecture

DATAVERSITY

Business Intelligence Overview

Claudio Menozzi

Data Discovery Hype

Julie Severance

Future of Power: Big Data - Søren Ravn

IBM Danmark

Watch full webinar here: https://bit.ly/3c6v8K7 Banking, Financial Services and Insurance (BFSI) organizations are globally accelerating their digital journey, making rapid strides with their digitization efforts, and adding key capabilities to adapt and innovate in the new normal. Many companies find digital transformation challenging as they rely on established systems that are often not only poorly integrated but also highly resistant to modernization without downtime. Hear how the BFSI industry is leveraging data virtualization that facilitates digital transformation via a modern data integration/data delivery approach to gain greater agility, flexibility, and efficiency. In this session from Denodo, you will learn: - Industry key trends and challenges driving the digital transformation mandate and platform modernization initiatives - Key concepts of Data Virtualization, and how it can enable BFSI customers to develop critical capabilities for real-time / near real-time data integration - Success Stories on organizations who already use data virtualization to differentiate themselves from the competition.

Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...

Denodo

The interest in Data Catalogs is growing as more business & technical users are looking to gain insight from data using a self-service approach. Architectural techniques for Data Provisioning and Metadata Cataloging have evolved to cater to these new audiences and ways of working. This webinar provides concrete methods of architecting your Self-service BI & Analytics environment to foster collaboration while at the same time maintaining Data Quality and reducing risk.

Data Catalogues - Architecting for Collaboration & Self-Service

DATAVERSITY

Data Literacy is an increasing concern, as organizations look to become more data-driven. As the rise of the citizen data scientist and self-service data analytics becomes increasingly common, the need for business users to understand core Data Management fundamentals is more important than ever. At the same time, technical roles need a strong foundation in Data Architecture principles and best practices. Join this webinar to understand the key components of Data Literacy, and practical ways to implement a Data Literacy program in your organization.

Improving Data Literacy Around Data Architecture

DATAVERSITY

Financial Analytics pafp 11-21-13

gristak

Developing a Data Strategy for your organization can seem like a daunting task. The opportunity in getting it right can be significant, however, as data drives many of the key initiatives in today’s marketplace from digital transformation, to marketing, to customer centricity, population health, and more. This webinar will help de-mystify data strategy and data architecture and will provide concrete, practical ways to get started.

DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...

DATAVERSITY

Developing a Data Strategy for your organization can seem like a daunting task – but it’s worth the effort. Getting your Data Strategy right can provide significant value, as data drives many of the key initiatives in today’s marketplace – from digital transformation, to marketing, to customer centricity, to population health, and more. This webinar will help demystify Data Strategy and its relationship to Data Architecture and will provide concrete, practical ways to get started.

Building a Data Strategy – Practical Steps for Aligning with Business Goals

DATAVERSITY

Emerging Trends in Data Architecture – What’s the Next Big Thing?

DATAVERSITY

Clinical Trial Performance Metrics Conference Dec 2016

Mike Fitzpatrick

Developing a Data Strategy for your organization can seem like a daunting task. The opportunity in getting it right can be significant, however, as data drives many of the key initiatives in today’s marketplace: digital transformation, marketing, customer centricity, and more. This webinar will help de-mystify Data Strategy and Data Architecture and will provide concrete, practical ways to get started.

DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...

DATAVERSITY

Semelhante a Presentation by Luc Delanglez (DataLumen) at the Data Vault Modelling and Data Governance conference on Oct. 17, 2019: From the Data Governance trenches: A real-life perspective (20)

Decentralizing Analytics - A Strategy for Organizing Effective Analytics Teams

Big data analytics

Bi orientations

Implementing a Successful, Scalable, Governed BI Program

Entry Points – How to Get Rolling with Big Data Analytics

Data Quality Success Stories

Accelerate Revenue with a Customer Data Platform

DAS Slides: Enterprise Architecture vs. Data Architecture

Business Intelligence Overview

Data Discovery Hype

Future of Power: Big Data - Søren Ravn

Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...

Data Catalogues - Architecting for Collaboration & Self-Service

Improving Data Literacy Around Data Architecture

Financial Analytics pafp 11-21-13

DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...

Building a Data Strategy – Practical Steps for Aligning with Business Goals

Emerging Trends in Data Architecture – What’s the Next Big Thing?

Clinical Trial Performance Metrics Conference Dec 2016

DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...

Mais de Patrick Van Renterghem

Ethical AI at VDAB, presented by Vincent Buekenhout (Ethical AI Lead, VDAB) a...

Patrick Van Renterghem

Implementing error-proof, business-critical Machine Learning, presentation by...

Patrick Van Renterghem

Building Trust and Explainability into Chatbots: the Partena Ziekenfonds Busi...

Patrick Van Renterghem

AI & Ethics: The Belgian Industry Vision & Initiatives, presentation by Jelle...

Patrick Van Renterghem

Organisations need to make sure that they use AI in an appropriate way. Martijn and Hugo explain how to ensure that the developments are ethically sound and comply with regulations, how to have end-to-end governance, and how to address bias and fairness, interpretability and explainability, and robustness and security. During the conference, we looked at an example AI development process with focussing on the risks to be managed and the controls that can be established.

Responsible AI: An Example AI Development Process with Focus on Risks and Con...

Patrick Van Renterghem

Fairness and Transparency: Algorithmic Explainability, some Legal and Ethical...

Patrick Van Renterghem

How obedient digital twins and intelligent beings contribute to ethics and ex...

Patrick Van Renterghem

He Said, She Said: Finding and Fixing Bias in NLP (Natural Language Processin...

Patrick Van Renterghem

Introduction to Bias in Machine Learning, presented by Matthias Feys, CTO @ M...

Patrick Van Renterghem

Business Case: Ozitem Groupe, where 80% of the company is working remotely. R...

Patrick Van Renterghem

Digital Workplace Case Study: How the Municipality of Duffel successfully swi...

Patrick Van Renterghem

Unleashing the Full Potential of People, Teams and SOLVAY, presented by Bruce...

Patrick Van Renterghem

The Building Blocks of a Digital Workplace, presented by Sam Marshall at the ...

Patrick Van Renterghem

Engie's Digital Workplace and "Connecting the company" business case, present...

Patrick Van Renterghem

Face your communication challenges when implementing a digital workplace, bas...

Patrick Van Renterghem

The first steps in Recticel's Digital Workplace program by Kenneth Meuleman (...

Patrick Van Renterghem

Presentation by Dave Geentjens at the "Successful Digital Workplace Adoption"...

Patrick Van Renterghem

Presentation by Erik van der Hoeven (Wisdom as a Service) at the Data Vault M...

Patrick Van Renterghem

DataSense is, together with the internal team, implementing a new Enterprise Data Warehouse (EDW) at Bank Degroof Petercam. The goal of the EDW is to integrate and historicize all changes of data of the Belgian and Luxembourg entities in the medium term and also those of the for the other entities in the long term. All of this complying with and respecting regulations (legal reporting) and service obligations (tax certificates, reports, taxes on funds, return on portfolio, ...). The implementation is done according to the principles of Data Vault 2.0 and automation of the RAW Data Vault layer. For this purpose they use Talend (Enterprise Open Source data integration platform), Vaultspeed (Data Vault Automation) and Oracle (db platform).

Presentation by Bart Gielen (DataSense) at the Data Vault Modelling and Data ...

Patrick Van Renterghem

A Modern Data Architecture in Azure, presented by Armand van Oijen (Kadenza) ...

Patrick Van Renterghem

Mais de Patrick Van Renterghem (20)