Data Catalogs Are the Answer – What is the Question?

1
Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
Real-World Data Governance
Data Catalogs Are the Answer – What is the Question?
Monthly Webinar Series Hosted by DATAVERSITY
Robert S. Seiner – KIK Consulting / TDAN.com
February 16, 2023 – 11:00 a.m. PT / 2:00 p.m. ET

Data Intelligence + Human Brilliance™
What is Data Intelligence?
Jason Lim
February 16, 2023

What is Data Intelligence?
An organization’s ability to deliver the
• right data to the
• right person at the
• right time for the
• right purpose in the
• right medium/context.
A data intelligence
system learns
and manages the
who, what, when,
where, why and
how of data.

For a Data Intelligence System to be Successful

Read O’Reilly Report
alation.com → resources

Universal Connectivity to All Cloud and On-Prem
Data Sources

Augment the Catalog with Best-of-Breed Metadata

Alation Anywhere
Alation @ Slack Alation @ Tableau
Alation @
Teams
Alation @
Chrome
Alation @
Android
Alation
@ iOS

Data Analysts and Scientists
What data can I use?
What data should I use?

Data Engineers and DataOps
Where did the data come
from?
Is this quality data?
How much do people use
this data?

Business Users
What data can I use in my
spreadsheet?
How do I get updated data
quickly?
Is the data in this
spreadsheet compliant?

Risk & Compliance
Cloud Transformation
Risk & Compliance
Data Governance
Risk & Compliance
Self-Service Analytics
Adopted by 25 of the Fortune 100
And 450+ other enterprises as their data intelligence platform of choice
Pfizer
Zurich
Cargill
“96% of analysts said they were
able to save at least 15 minutes
to 2 hours a day with Alation.”
Scott Webber
BI Product Manager at Expedia
“Fund reports that used to take
eight hours to create can now be
pulled in minutes due to the
access to governed data in
Alation.”
Jai Subrahmanyam
SVP, Head of Data Governance
“With query log ingestion,
Alation is providing us insights
into the usage and the users of
data to help us prioritize what to
move to the cloud.”
Theresa Peachey
VP of Data Management, Enterprise Data & Analytics

Register for Test Flight of Alation
alation.com/snowﬂake-hands-on-lab/
Includes 14 day free-trial

2
Introduction
Real-World Data Governance – Monthly Webinar Series
March 16, 2023: Metadata Will Not Govern Itself – Metadata Governance
Third Thursday each Month @ 2pm EST – Register at TDAN.com, KIKconsulting.com, DATAVERSITY.net
Upcoming Events
Enterprise Data World Digital (EDWD) – Dataversity Virtual Event – March 27th – 31st
Data Governance & Information Quality West – Dataversity Conference – June 5th – 9th
Non-Invasive Data Governance Book
Available Now: ISBN 9781935504856 / Technics Publications / Amazon.com
2Q23: Non-Invasive Data Governance Strikes Again: Lessons Learned and Perspective Gained Through NIDG
Non-Invasive Data Governance / Metadata Governance Online Learning Plans
Latest: Business Glossaries, Data Dictionaries and Data Catalogs
DATAVERSITY Training Center – https://training.dataversity.net
KIK Consulting & Educational Services
KIKConsulting.com (“Knowledge is King”)
The Home of Non-Invasive Data Governance™
The Data Administration Newsletter (TDAN.com)
Twice Monthly: Data Articles, Columns, Blogs and Features
Carnegie Mellon University (CMU)
Adjunct Faculty: Heinz College Chief Data Officer (CDO) Certificate Program

3
• In this webinar, I will talk about …
– Selecting the Appropriate Metadata to Govern
– The Business and Technical Value of a Data Catalog
– Building the Catalog into People’s Routines
– Positioning the Data Catalog for Success
– Questions the Data Catalog can Answer
Abstract

4
Definitions
• Data Governance – The execution and enforcement of authority over data.
• Data Stewardship – Formal accountability for data.
• Data Steward – A person held formally accountable for their relationship to the data.
• Metadata – Data that improves both the business and technical understanding of the data.

5
There are so many.
Where can I find the data?
What will be the impact of this change?
How was the value calculated?
How can I transport the data?
What are the rules around this data?
Who should I ask if I have a question?
When was the data last updated?
How do I get access to the data?
How many different places do we have this data?
Where did the data come from?
Why are the same results different?
How has the data changed?

6
There are so many.
Where can I find the data?
What will be the impact of this change?
How was the value calculated?
How can I transport the data?
What are the rules around this data?
Who should I ask if I have a question?
When was the data last updated?
How do I get access to the data?
How many different places do we have this data?
Where did the data come from?
Why are the same results different?
What answers do YOU need
from your data catalog?
How has the data changed?

7
• Different Types of Data
• Different Types of Metadata
• Prioritizing Metadata to Manage
• What it Means to Govern Data / Metadata
• Places to Govern Your Data / Metadata
Selecting the Appropriate Metadata to Govern

8
• Different Types of Data
– Structured Data
– Unstructured Data
• Text
• Documents
• Records
• Content
• Knowledge
– Internal / External Data
– Real-Time Data
– Purchased
– Data You Have Influence Over
– Data You Don’t Have Influence Over
– The metadata about these different types of data
may be somewhat different.

9
• Different Types of Metadata
– Data About Data Definition
– Data About Data Production
– Data About Data Usage
– Data About the Data About the Data
– Who will use the metadata? How do you know?
– What are you going to do about it?

10
• Prioritizing Metadata to Manage
– What metadata do we have?
– Where is it located?
– Is it up to date?
– Who is responsible for it?
– How will people access it?
– What business value will the metadata have?
– Who will use it?
– When will it be most beneficial?
– What will it take to make it available?
– How will we measure its use?
– Where is there an immediate need?
– What will bring the most bang for your bucks?
– What is the low hanging fruit?

11
• What it Means to Govern Data / Metadata
– Execute and Enforce Authority over the Definition, Production, and Use of Data / Metadata
– Formalized Accountability for the Definition of Data / Metadata
– Formalized Accountability for the Production of Data / Metadata
– Formalized Accountability for the Usage of Data / Metadata
– Recorded Accountability is the 1st Step Toward Formalized Accountability
– Operationalized Accountability is the 2nd Step – And the most complex

12
• Places to Govern Your Data / Metadata
– In Its Native Source – The Natives are Restless
– In Spreadsheets, Documents, Desktop Databases – And Folders, Folders, Folders
– Automated Ingestion – Change Management at its Finest
– In a Data Catalog – Reference Guide for All Things Data
– At the Point of Distribution – Where Metadata Lives

13
• Catalog Functionality
• Aligning Functionality and Value
• Value to the Business Audience
• Value to the Technical Audience
• Value to the Governance Audience
The Business and Technical Value of a Data Catalog

14
• Catalog Functionality*
Business Metadata
Technical Metadata
Operational Metadata
Stewardship
Data Discovery
Inventory
Data Curation
Connectors
AI & ML
Glossary & Dictionary
Search & Discoverability
Lineage &ETL
* Summarized and updated from https://www.techtarget.com/searchdatamanagement/definition/data-catalog
Analytics & Decisioning
Efficiency & Effectiveness
Quality Improvements
Confidence Improvements
Regulatory Compliance
Storage Function
Governance Function
Tool Function
Business Use Function

15
• Aligning Functionality and Value
– Storage Function – Physical storage of metadata.
– Governance Function – Formal accountability and behavior for metadata.
– Tool Function – Ingestion and rationalization of metadata.
– Business Use Function – Value derived from use of metadata.

16
• Value to the Business Audience
– Analytics & Decisioning
– Efficiency & Effectiveness
– Quality Improvements
– Confidence Improvements
– Regulatory Compliance
Analytics & Decisioning
Efficiency & Effectiveness
Quality Improvements
Confidence Improvements
Regulatory Compliance
Business Use Function

17
• Value to the Technical Audience
– Inventory of
• Business, Technical, Operational Metadata
– Connectors
– Artificial Intelligence & Machine Learning
– Search & Discoverability
– Lineage & ETL
Business Metadata
Technical Metadata
Operational Metadata
Connectors
AI & ML
Glossary & Dictionary
Search & Discoverability
Lineage & ETL
Storage Function
Tool Function

18
Stewardship
Data Discovery
Inventory
Data Curation
Governance Function
• Value to the Governance Audience
– Formalize Stewardship
– Enable Data Discovery
– Enable Self-Service BI and Analytics
– Conduct Asset Inventory
– Provide Data Curation and Quality Improvement Service

19
• Meet the Data …
– Where It Lives
– Who It Lives With
– When It Lives
– How It Lives
– Why It Lives
Building the Catalog into People’s Routines

20
– Where It Lives
• Where people are defining data – glossary, dictionary, modeling, developing systems, …
• Where people are producing data – entry, new data, acquiring data, …
• Where people are using data – analytics, reporting, decision making, …

21
– Who It Lives With
• Stakeholders – decision makers, analysts,
operations, …
• Stewards – people held accountable for
defining, producing, and using data, …
• Analysts – people paid to draw conclusions
and make decisions, …
• Regulatory Stewards – people responsible
for reporting and compliance, …

22
– When It Lives
• Definition – when consistency, trust, and quality definition matters
• Production – when quality data production quality matters
• Use – when people need to know the rules around the data

23
– How It Lives
• Daily Operations
• Reporting and Analytics
• Sharing and Protection
• Collection and Monitoring

24
– Why It Lives
• Daily Operations
• Reporting and Analytics
• Sharing and Protection
• Collection and Monitoring

25
• Define Success
• Reward Contribution and Usage
• Reward Innovation
• Promote Success
Positioning the Data Catalog for Success

26
• Define Success
– For metadata management
• Metadata collected in a data catalog
• Metadata high in levels of quality and trust
• Metadata available to those that need it
– For data governance
• Increase data intelligence
• Increase data literacy

27
• Reward Contribution and Usage
– Recognize metadata definers, producer, and users.
– Engage these people as metadata stewards.
– Reward participation for improving the confidence in their data.
– Reward participation in data catalog activities and value.
– Reward stewards for data catalog usage – potentially gamifying the use of the catalog.

28
• Reward Innovation
– Introduce and Promote Innovative Methods for
• Data and Metadata Definition
• Data and Metadata Production
• Data and Metadata Usage

29
• Promote Success
– Through whatever means is necessary.
– Through whatever means is available.
– Through the face of your data governance program.
– Through the catalog itself.
– Through demonstrated success. And word of mouth.
– And by providing answers to data questions!

30
• Data Governance Framework Components
– Data Questions
– Role Questions
– Process Questions
– Communications Questions
– Metrics Questions
– Tool Questions?
Questions the Data Catalog can Answer

31
– Data Questions – from the perspective of the:
• Executive Level
• Strategic Level
• Tactical Level
• Operational Level
• Support Level

32
– Role Questions – from the perspective of the:
• Executive Level
• Strategic Level
• Tactical Level
• Support Level

33
– Process Questions – from the perspective of the:
• Executive Level
• Strategic Level
• Tactical Level
• Support Level

34
– Communications Questions – from the perspective of the:
• Executive Level
• Strategic Level
• Tactical Level
• Support Level

35
– Metrics Questions – from the perspective of the:
• Executive Level
• Strategic Level
• Tactical Level
• Support Level

36
– Tool Questions – from the perspective of the:
• Executive Level
• Strategic Level
• Tactical Level
• Support Level

37
• In the webinar, I shared …
– Selecting the Appropriate Metadata to Govern
– The Business and Technical Value of a Data Catalog
– Building the Catalog into People’s Routines
– Positioning the Data Catalog for Success
– Questions the Data Catalog can Answer
Summary

38
Q & A - Contact Information
• Robert S. Seiner
KIK Consulting & Educational Services – KIKconsulting.com
The Data Administration Newsletter – TDAN.com
rseiner@tdan.com @RSeiner
38

Data Catalogs Are the Answer – What is the Question?

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Data Catalogs Are the Answer – What is the Question?

Semelhante a Data Catalogs Are the Answer – What is the Question? (20)

Mais de DATAVERSITY

Mais de DATAVERSITY (20)

Último

Último (20)

Data Catalogs Are the Answer – What is the Question?