RWDG: Data Governance and Three Levels of Metadata

1
Copyright © 2018 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG @RSeiner
Data Governance and Three Levels of Metadata
Monthly Webinar Series Hosted by DATAVERSITY
Robert S. Seiner – KIK Consulting / TDAN.com
November 15, 2018 – 11:00 a.m. PT / 2:00 p.m. ET
Real-World Data Governance

erwin Inc. Snapshot
1
Founded March
2016
Combined erwin
with Corso, Casewise,
A&P Technology and
AnalytiX DS
Developed
new technologies
including data
governance and NoSQL
3,500+
customers with more
than 50,000 users
~300
employees in 7 offices
around the world
Industry-leading
NPS
satisfaction scores

The erwin
EDGE Platform
2
The industry’s most connected,
persona-based data management
and governance solution
Data Stewardship & Governance
Data Preparation & Automation
Modeling & Metadata Management

A Critical “Self Service” Enabler: Metadata Cataloging
© 2018 erwin, Inc. All rights reserved. 3
Delivers these data assets within
a business context, tracking their
physical existence and lineage,
and maximizing their security,
quality and value.
THE ENTERPRISE METADATA LANDSCAPE
DATA GOVERNANCE
Drives the design, deployment
and operation of systems that
deliver operational and analytical
data assets
DATA MANAGEMENT
Data Catalog
Harvested Metadata Representing
“Data At Rest” - Data Stores and Data Models
“Data In Motion” - Data Movement Processes

BI Reporting
ERP
Data Modeling Cloud
ETLRelational Databases
File-based systems
Script
Big Data
Big Data Code Generation
The
industry’s
broadest set
of connectors

Benefits for Every Stakeholder in the Data Value Chain
© 2018 erwin, Inc. All rights reserved. 5
Data Analyst ETL Developer Data Architect BI Developer
Business Analyst Data Steward Data Scientist Data Owner
INTELLIGENT AUTOMATION
Enhanced Capability Increased Efficiency Effective Collaboration
All Others
…

2
2
#RWDG @RSeiner
Introduction
• Real-World Data Governance – Monthly Webinar Series
December 20, 2018 – How to Govern Your Master Data
Third Thurs @ 2pm EST – Register at TDAN.com, KIKconsulting.com, DATAVERSITY.net
• Non-Invasive Data Governance Book
ISBN 9781935504856 / Technics Publishing / Amazon.com
• Speaking @ Dataversity Events
Data Governance Winter Conference – Delray Beach, FL – December 3-7, 2018
Enterprise Data Governance Online – Virtual Conference – January 23, 2019
Enterprise Data World 2018 – Boston, MA – March 17-22, 2019
• Non-Invasive Data Governance Online Learning Plan
DATAVERSITY Training Center
https://training.dataversity.net
• The Data Administration Newsletter (TDAN.com)
Twice Monthly – Articles, Columns, Blogs and Features
Produced by DATAVERSITY – Subscribe for emails
• KIK Consulting & Educational Services
KIKConsulting.com
Home of Non-Invasive Data Governance™

3
3
#RWDG @RSeiner
• In this webinar I will discuss:
– The three levels of metadata and how they differ
– Sources of the metadata at each level
– Metadata linkage between the levels
– Processes to govern the all levels of metadata
– Institutionalizing policy to assure quality metadata at all levels
Abstract

4
4
#RWDG @RSeiner
• Data Governance
– Data Governance is the Execution and Enforcement of Authority
Over the Management of Data and Data-Related Resources.
• Data Stewardship
– Data Stewardship is the Formalization of Accountability
Over the Management of Data and Data-Related Resources.
Definitions

5
5
#RWDG @RSeiner
• Non-Invasive Data Governance™
– The practice of:
• applying formal accountability & behavior
• through non-invasive roles & responsibilities
• to existing and / or new processes
• to assure that the definition, production & usage of data
• assures regulatory compliance, security, privacy, protection & quality.
– Non-Invasive describes how governance is applied to assure
non-threatening management of valuable data assets.
– The goal is to be
» Transparent
» Supportive
» Collaborative.
Definitions

6
6
#RWDG @RSeiner
• Metadata
– Data about Data.
– Data recorded in IT tools that improves the business and technical
understanding of the definition, production and usage of data.
Definitions

7
7
#RWDG @RSeiner
• Metadata
– Data
– Recorded in IT tools
– Improves the business and technical
– Understanding
– Definition, production and usage of data
Definitions

8
8
#RWDG @RSeiner
The Three Levels

9
9
#RWDG @RSeiner
• Three Tiers to Govern Metadata
– Semantic Layer – “Vocabulary”
– Business Language We Use / Terminology
– Metadata includes:
• Business Term
• Business Definition
• Business Domain
• Business Steward [or Business Ownership (sic)]
• Associated Metrics
• How term should be used or not used
• Related Terms
• Terms this term replace
The Three Levels

10
10
#RWDG @RSeiner
– Business Metadata – “Data Dictionary”
– Data in the Business Intelligence Environment
• Data Element Name
• Data Element Definition
• Data Element Domain – Subject Area
• Data Domain Steward
• Date / Time Stamp
The Three Levels

11
11
#RWDG @RSeiner
– Technical Metadata – “Data”
– Physical Data Structures, Reference Data Values
• Database, Table, Column Names
• View Names
• Reference Data Element Names, Values, Descriptions, Ranges
• Lineage – Extraction, Transformation, Load Metadata
• Technical Steward
• Date / Time Stamp
The Three Levels

12
12
#RWDG @RSeiner
The Three Levels

13
13
#RWDG @RSeiner

14
14
#RWDG @RSeiner
• Relationships Between
– Vocabulary & Vocabulary
• Business Term to Business Term
– Vocabulary & Data Dictionary
• Term to Business Data
Linkage between the Levels

15
15
#RWDG @RSeiner
• Relationships Between
– Data Dictionary & Data Dictionary
• Business Metadata to Business Metadata
– Data Dictionary & Data
• Business Metadata to Data
– Data & Data
Linkage between the Levels

16
16
#RWDG @RSeiner

17
17
#RWDG @RSeiner
• Metadata at the Semantic Tier
– Vocabulary Level
– Business Terminology
– Subject Areas (Domains)
– Not data focused.
– “Language we use.”
Sources of the Metadata

18
18
#RWDG @RSeiner
– Sources of Business Terms
• Corporate Documents
– Policies
– Guidelines
– Communications
• Handbooks
• Catalogs
• Contracts

19
19
#RWDG @RSeiner
– Focused on “things” that are important to the business.
– Names for things:
• Objects – may be too general
• Entities – may be too data
• Terms – may be just right
• Most basic components of your business

20
20
#RWDG @RSeiner
– Examples of things:
• Health Care
– Provider
– Subscriber
– Covered Individual
– Claim
– Policy
– Procedure …

21
21
#RWDG @RSeiner
– Not a lot of metadata needs to be collected about terms
– Examples of metadata at the Semantic Tier
• Term (Name)
• Term Definition
• Term Subject Area
• Term Business Area
• Term Usage

22
22
#RWDG @RSeiner
• Metadata at the Business Tier
– Often referred to as the Data Dictionary Level
– Business Data Elements
– Can Be Associated with Terms

23
23
#RWDG @RSeiner
– Two Categories Associated with Business Tier
• Standard Elements – Accepted to be used and linked-to
• System Elements – What something is called in a system

24
24
#RWDG @RSeiner
– Business Data Elements
• Data Element Name (Standard and System)
• Data Definition
• Data Attributes (Type, Size, Null …)
• Acceptable Values
• Relationships
• Business Rules
• Classification
• …

25
25
#RWDG @RSeiner
• Metadata at the Technical Tier
– Physical Data
• System Name
• Database Name
• Table / View Name
• Column Name
• Physical Attributes
• …

26
26
#RWDG @RSeiner
• What are some of the metadata processes that need to be governed?
– Metadata Change Management – will share a case study example
– Metadata Development Requests
– Selection of Critical Data Elements
– Standardization of Critical Data Elements
Processes to Govern

27
27
#RWDG @RSeiner
Processes to Govern

28
28
#RWDG @RSeiner
Processes to Govern

29
29
#RWDG @RSeiner
Processes to Govern

30
30
#RWDG @RSeiner
Processes to Govern

31
31
#RWDG @RSeiner
Processes to Govern

32
32
#RWDG @RSeiner
Processes to Govern

33
33
#RWDG @RSeiner
Metadata Governance
Policies and Procedures Associated with Metadata Governance

34
34
#RWDG @RSeiner
• What resources will be required for Data Governance …
– Senior Leadership Sponsor
– Data Governance Manager
– Data Governance Council
– Data Stewards
– Working Team(s)
– Information Technology (IT)
– Requestors
Assure Quality Metadata

35
35
#RWDG @RSeiner
• What resources will be required for Metadata Governance …
– Data Stewards
– Working Team(s)
– Requestors

36
36
#RWDG @RSeiner
• Resource Expectations to Assure Quality Metadata
• Support, Sponsor and Understand
• Very Limited Time Involvement
• Lead Approval Committee

37
37
#RWDG @RSeiner
• The truth is that Business Glossary efforts barely ever succeed
unless there is a high level of Senior Leadership desire to approve
the business understanding of the data.
• When Senior Leadership decides that improving business
understanding of the data is important, the glossary focuses on:
– Business Intelligence Data
– Master Data
– Big Data – Data used for analytical purposes.

38
38
#RWDG @RSeiner
• Manage the Business Glossary Processes
• Facilitate Business Glossary Resources
• Develop and Gain Approval of Business Glossary Policy
• Facilitate Change Management (Add/Change) Process
• Report Results to Management.

39
39
#RWDG @RSeiner
• Limited Time Commitment Required.
• Assign (sic) People to Research Vocabulary and Data Dictionary terms.
• Involvement in Validation and Approval Proceses.
• Recommend Changes to Semantic and Business Metadata.

40
40
#RWDG @RSeiner
– Data Stewards
• Vested Interest in All Three Tiers
– Semantic
– Business
– Technical
• Provide Business Definitions at the Data Dictionary Tier
• Involved in Validation Processes Before Approval
• Biggest User of the Business Glossary

41
41
#RWDG @RSeiner
– Working Team(s)
• Often the Critical Resources Associated with Business Glossary
• Given the responsibility to develop the first cut at the:
– Semantic Tier
– Business Tier
• Significant Time Commitment When Building the Business Glossary
• Involved in Researching Business Glossary Change Requests
• Less Time Commitment Once the Business Glossary is Developed

42
42
#RWDG @RSeiner
• Changes to Physical DB and Data Must Follow Add/Change Process
• Changes to Logical Data Models Must Follow Add/Change Process
• Time Commitment Required to Make Physical Changes
• May be Involved in Validation of Business Tier
• Follow Standards for Data and Database Design

43
43
#RWDG @RSeiner
– Requestors
• Can be anybody.
• Formal requests for adds/changes must have manager signature.
• Responsible for completing forms and submitting to DGM.

44
44
#RWDG @RSeiner
• In this webinar I discussed:
– The three levels of metadata and how they differ
– Sources of the metadata at each level
– Metadata linkage between the levels
– Processes to govern the all levels of metadata
– Institutionalizing policy to assure quality metadata at all levels
Summary

45
45
#RWDG @RSeiner
• Questions and Answers
Summary
• Reminder – Next Month – Real-World Data Governance Webinar Series
How to Govern Your Master Data
December 20th, 2018 – 2 pm ET
Sign up at TDAN.com, Dataversity.net, KIKConulting.com

46
46
#RWDG @RSeiner
• Robert S. Seiner
KIK Consulting & Educational Services – KIKconsulting.com
The Data Administration Newsletter – TDAN.com
Post Office Box 112571, Upper St. Clair, Pennsylvania 15241
412.220.9643, 412.220.9644 (Fax)
rseiner@kikconsulting.com
rseiner@tdan.com
@RSeiner #RWDG
Contact Information

RWDG: Data Governance and Three Levels of Metadata

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a RWDG: Data Governance and Three Levels of Metadata

Semelhante a RWDG: Data Governance and Three Levels of Metadata (20)

Mais de DATAVERSITY

Mais de DATAVERSITY (20)

Último

Último (20)

RWDG: Data Governance and Three Levels of Metadata