Anúncio

Data Catalogs Are the Answer – What is the Question?

Executive Editor at DATAVERSITY em DATAVERSITY
22 de Feb de 2023
Anúncio

Mais conteúdo relacionado

Apresentações para você(20)

Similar a Data Catalogs Are the Answer – What is the Question?(20)

Anúncio

Mais de DATAVERSITY(20)

Anúncio

Data Catalogs Are the Answer – What is the Question?

  1. 1 Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting Real-World Data Governance Data Catalogs Are the Answer – What is the Question? Monthly Webinar Series Hosted by DATAVERSITY Robert S. Seiner – KIK Consulting / TDAN.com February 16, 2023 – 11:00 a.m. PT / 2:00 p.m. ET
  2. Data Intelligence + Human Brilliance™ What is Data Intelligence? Jason Lim February 16, 2023
  3. Data Intelligence + Human Brilliance™ What is Data Intelligence? An organization’s ability to deliver the • right data to the • right person at the • right time for the • right purpose in the • right medium/context. A data intelligence system learns and manages the who, what, when, where, why and how of data.
  4. Data Intelligence + Human Brilliance™ For a Data Intelligence System to be Successful
  5. Data Intelligence + Human Brilliance™ Read O’Reilly Report alation.com → resources
  6. Data Intelligence + Human Brilliance™ Universal Connectivity to All Cloud and On-Prem Data Sources
  7. Data Intelligence + Human Brilliance™ Augment the Catalog with Best-of-Breed Metadata
  8. Data Intelligence + Human Brilliance™ Alation Anywhere Alation @ Slack Alation @ Tableau Alation @ Teams Alation @ Chrome Alation @ Android Alation @ iOS
  9. Data Intelligence + Human Brilliance™ Data Analysts and Scientists What data can I use? What data should I use?
  10. Data Intelligence + Human Brilliance™ Data Engineers and DataOps Where did the data come from? Is this quality data? How much do people use this data?
  11. Data Intelligence + Human Brilliance™ Business Users What data can I use in my spreadsheet? How do I get updated data quickly? Is the data in this spreadsheet compliant?
  12. Data Intelligence + Human Brilliance™ Risk & Compliance Cloud Transformation Risk & Compliance Data Governance Risk & Compliance Self-Service Analytics Adopted by 25 of the Fortune 100 And 450+ other enterprises as their data intelligence platform of choice Pfizer Zurich Cargill “96% of analysts said they were able to save at least 15 minutes to 2 hours a day with Alation.” Scott Webber BI Product Manager at Expedia “Fund reports that used to take eight hours to create can now be pulled in minutes due to the access to governed data in Alation.” Jai Subrahmanyam SVP, Head of Data Governance “With query log ingestion, Alation is providing us insights into the usage and the users of data to help us prioritize what to move to the cloud.” Theresa Peachey VP of Data Management, Enterprise Data & Analytics
  13. Data Intelligence + Human Brilliance™ Register for Test Flight of Alation alation.com/snowflake-hands-on-lab/ Includes 14 day free-trial
  14. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 2 Data Catalogs Are the Answer – What is the Question? Introduction Real-World Data Governance – Monthly Webinar Series March 16, 2023: Metadata Will Not Govern Itself – Metadata Governance Third Thursday each Month @ 2pm EST – Register at TDAN.com, KIKconsulting.com, DATAVERSITY.net Upcoming Events Enterprise Data World Digital (EDWD) – Dataversity Virtual Event – March 27th – 31st Data Governance & Information Quality West – Dataversity Conference – June 5th – 9th Non-Invasive Data Governance Book Available Now: ISBN 9781935504856 / Technics Publications / Amazon.com 2Q23: Non-Invasive Data Governance Strikes Again: Lessons Learned and Perspective Gained Through NIDG Non-Invasive Data Governance / Metadata Governance Online Learning Plans Latest: Business Glossaries, Data Dictionaries and Data Catalogs DATAVERSITY Training Center – https://training.dataversity.net KIK Consulting & Educational Services KIKConsulting.com (“Knowledge is King”) The Home of Non-Invasive Data Governance™ The Data Administration Newsletter (TDAN.com) Twice Monthly: Data Articles, Columns, Blogs and Features Carnegie Mellon University (CMU) Adjunct Faculty: Heinz College Chief Data Officer (CDO) Certificate Program
  15. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 3 • In this webinar, I will talk about … – Selecting the Appropriate Metadata to Govern – The Business and Technical Value of a Data Catalog – Building the Catalog into People’s Routines – Positioning the Data Catalog for Success – Questions the Data Catalog can Answer Data Catalogs Are the Answer – What is the Question? Abstract
  16. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 4 Data Catalogs Are the Answer – What is the Question? Definitions • Data Governance – The execution and enforcement of authority over data. • Data Stewardship – Formal accountability for data. • Data Steward – A person held formally accountable for their relationship to the data. • Metadata – Data that improves both the business and technical understanding of the data.
  17. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 5 Data Catalogs Are the Answer – What is the Question? There are so many. Where can I find the data? What will be the impact of this change? How was the value calculated? How can I transport the data? What are the rules around this data? Who should I ask if I have a question? When was the data last updated? How do I get access to the data? How many different places do we have this data? Where did the data come from? Why are the same results different? How has the data changed?
  18. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 6 Data Catalogs Are the Answer – What is the Question? There are so many. Where can I find the data? What will be the impact of this change? How was the value calculated? How can I transport the data? What are the rules around this data? Who should I ask if I have a question? When was the data last updated? How do I get access to the data? How many different places do we have this data? Where did the data come from? Why are the same results different? What answers do YOU need from your data catalog? How has the data changed?
  19. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 7 • Different Types of Data • Different Types of Metadata • Prioritizing Metadata to Manage • What it Means to Govern Data / Metadata • Places to Govern Your Data / Metadata Data Catalogs Are the Answer – What is the Question? Selecting the Appropriate Metadata to Govern
  20. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 8 • Different Types of Data – Structured Data – Unstructured Data • Text • Documents • Records • Content • Knowledge Data Catalogs Are the Answer – What is the Question? Selecting the Appropriate Metadata to Govern – Internal / External Data – Real-Time Data – Purchased – Data You Have Influence Over – Data You Don’t Have Influence Over – The metadata about these different types of data may be somewhat different.
  21. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 9 • Different Types of Metadata – Data About Data Definition – Data About Data Production – Data About Data Usage – Data About the Data About the Data – Who will use the metadata? How do you know? – What are you going to do about it? Data Catalogs Are the Answer – What is the Question? Selecting the Appropriate Metadata to Govern
  22. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 10 • Prioritizing Metadata to Manage – What metadata do we have? – Where is it located? – Is it up to date? – Who is responsible for it? – How will people access it? Data Catalogs Are the Answer – What is the Question? Selecting the Appropriate Metadata to Govern – What business value will the metadata have? – Who will use it? – When will it be most beneficial? – What will it take to make it available? – How will we measure its use? – Where is there an immediate need? – What will bring the most bang for your bucks? – What is the low hanging fruit?
  23. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 11 • What it Means to Govern Data / Metadata – Execute and Enforce Authority over the Definition, Production, and Use of Data / Metadata – Formalized Accountability for the Definition of Data / Metadata – Formalized Accountability for the Production of Data / Metadata – Formalized Accountability for the Usage of Data / Metadata – Recorded Accountability is the 1st Step Toward Formalized Accountability – Operationalized Accountability is the 2nd Step – And the most complex Data Catalogs Are the Answer – What is the Question? Selecting the Appropriate Metadata to Govern
  24. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 12 • Places to Govern Your Data / Metadata – In Its Native Source – The Natives are Restless – In Spreadsheets, Documents, Desktop Databases – And Folders, Folders, Folders – Automated Ingestion – Change Management at its Finest – In a Data Catalog – Reference Guide for All Things Data – At the Point of Distribution – Where Metadata Lives Data Catalogs Are the Answer – What is the Question? Selecting the Appropriate Metadata to Govern
  25. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 13 • Catalog Functionality • Aligning Functionality and Value • Value to the Business Audience • Value to the Technical Audience • Value to the Governance Audience Data Catalogs Are the Answer – What is the Question? The Business and Technical Value of a Data Catalog
  26. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 14 • Catalog Functionality* Data Catalogs Are the Answer – What is the Question? The Business and Technical Value of a Data Catalog Business Metadata Technical Metadata Operational Metadata Stewardship Data Discovery Self-Service Analytics Inventory Data Curation Connectors AI & ML Glossary & Dictionary Search & Discoverability Lineage &ETL * Summarized and updated from https://www.techtarget.com/searchdatamanagement/definition/data-catalog Analytics & Decisioning Efficiency & Effectiveness Quality Improvements Confidence Improvements Regulatory Compliance Storage Function Governance Function Tool Function Business Use Function
  27. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 15 • Aligning Functionality and Value – Storage Function – Physical storage of metadata. – Governance Function – Formal accountability and behavior for metadata. – Tool Function – Ingestion and rationalization of metadata. – Business Use Function – Value derived from use of metadata. Data Catalogs Are the Answer – What is the Question? The Business and Technical Value of a Data Catalog
  28. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 16 • Value to the Business Audience – Analytics & Decisioning – Efficiency & Effectiveness – Quality Improvements – Confidence Improvements – Regulatory Compliance Data Catalogs Are the Answer – What is the Question? The Business and Technical Value of a Data Catalog Analytics & Decisioning Efficiency & Effectiveness Quality Improvements Confidence Improvements Regulatory Compliance Business Use Function
  29. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 17 • Value to the Technical Audience – Inventory of • Business, Technical, Operational Metadata – Connectors – Artificial Intelligence & Machine Learning – Search & Discoverability – Lineage & ETL Data Catalogs Are the Answer – What is the Question? The Business and Technical Value of a Data Catalog Business Metadata Technical Metadata Operational Metadata Connectors AI & ML Glossary & Dictionary Search & Discoverability Lineage & ETL Storage Function Tool Function
  30. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 18 Stewardship Data Discovery Self-Service Analytics Inventory Data Curation Governance Function • Value to the Governance Audience – Formalize Stewardship – Enable Data Discovery – Enable Self-Service BI and Analytics – Conduct Asset Inventory – Provide Data Curation and Quality Improvement Service Data Catalogs Are the Answer – What is the Question? The Business and Technical Value of a Data Catalog
  31. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 19 • Meet the Data … – Where It Lives – Who It Lives With – When It Lives – How It Lives – Why It Lives Data Catalogs Are the Answer – What is the Question? Building the Catalog into People’s Routines
  32. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 20 • Meet the Data … – Where It Lives • Where people are defining data – glossary, dictionary, modeling, developing systems, … • Where people are producing data – entry, new data, acquiring data, … • Where people are using data – analytics, reporting, decision making, … Data Catalogs Are the Answer – What is the Question? Building the Catalog into People’s Routines
  33. 21 Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting • Meet the Data … – Who It Lives With • Stakeholders – decision makers, analysts, operations, … • Stewards – people held accountable for defining, producing, and using data, … • Analysts – people paid to draw conclusions and make decisions, … • Regulatory Stewards – people responsible for reporting and compliance, … Data Catalogs Are the Answer – What is the Question? Building the Catalog into People’s Routines
  34. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 22 • Meet the Data … – When It Lives • Definition – when consistency, trust, and quality definition matters • Production – when quality data production quality matters • Use – when people need to know the rules around the data Data Catalogs Are the Answer – What is the Question? Building the Catalog into People’s Routines
  35. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 23 • Meet the Data … – How It Lives • Daily Operations • Reporting and Analytics • Sharing and Protection • Collection and Monitoring Data Catalogs Are the Answer – What is the Question? Building the Catalog into People’s Routines
  36. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 24 • Meet the Data … – Why It Lives • Daily Operations • Reporting and Analytics • Sharing and Protection • Collection and Monitoring Data Catalogs Are the Answer – What is the Question? Building the Catalog into People’s Routines
  37. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 25 • Define Success • Reward Contribution and Usage • Reward Innovation • Promote Success Data Catalogs Are the Answer – What is the Question? Positioning the Data Catalog for Success
  38. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 26 • Define Success – For metadata management • Metadata collected in a data catalog • Metadata high in levels of quality and trust • Metadata available to those that need it – For data governance • Increase data intelligence • Increase data literacy Data Catalogs Are the Answer – What is the Question? Positioning the Data Catalog for Success
  39. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 27 • Reward Contribution and Usage – Recognize metadata definers, producer, and users. – Engage these people as metadata stewards. – Reward participation for improving the confidence in their data. – Reward participation in data catalog activities and value. – Reward stewards for data catalog usage – potentially gamifying the use of the catalog. Data Catalogs Are the Answer – What is the Question? Positioning the Data Catalog for Success
  40. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 28 • Reward Innovation – Introduce and Promote Innovative Methods for • Data and Metadata Definition • Data and Metadata Production • Data and Metadata Usage Data Catalogs Are the Answer – What is the Question? Positioning the Data Catalog for Success
  41. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 29 • Promote Success – Through whatever means is necessary. – Through whatever means is available. – Through the face of your data governance program. – Through the catalog itself. – Through demonstrated success. And word of mouth. – And by providing answers to data questions! Data Catalogs Are the Answer – What is the Question? Positioning the Data Catalog for Success
  42. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 30 • Data Governance Framework Components – Data Questions – Role Questions – Process Questions – Communications Questions – Metrics Questions – Tool Questions? Data Catalogs Are the Answer – What is the Question? Questions the Data Catalog can Answer
  43. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 31 • Data Governance Framework Components – Data Questions – from the perspective of the: • Executive Level • Strategic Level • Tactical Level • Operational Level • Support Level Data Catalogs Are the Answer – What is the Question? Questions the Data Catalog can Answer
  44. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 32 • Data Governance Framework Components – Role Questions – from the perspective of the: • Executive Level • Strategic Level • Tactical Level • Operational Level • Support Level Data Catalogs Are the Answer – What is the Question? Questions the Data Catalog can Answer
  45. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 33 • Data Governance Framework Components – Process Questions – from the perspective of the: • Executive Level • Strategic Level • Tactical Level • Operational Level • Support Level Data Catalogs Are the Answer – What is the Question? Questions the Data Catalog can Answer
  46. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 34 • Data Governance Framework Components – Communications Questions – from the perspective of the: • Executive Level • Strategic Level • Tactical Level • Operational Level • Support Level Data Catalogs Are the Answer – What is the Question? Questions the Data Catalog can Answer
  47. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 35 • Data Governance Framework Components – Metrics Questions – from the perspective of the: • Executive Level • Strategic Level • Tactical Level • Operational Level • Support Level Data Catalogs Are the Answer – What is the Question? Questions the Data Catalog can Answer
  48. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 36 • Data Governance Framework Components – Tool Questions – from the perspective of the: • Executive Level • Strategic Level • Tactical Level • Operational Level • Support Level Data Catalogs Are the Answer – What is the Question? Questions the Data Catalog can Answer
  49. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 37 • In the webinar, I shared … – Selecting the Appropriate Metadata to Govern – The Business and Technical Value of a Data Catalog – Building the Catalog into People’s Routines – Positioning the Data Catalog for Success – Questions the Data Catalog can Answer Data Catalogs Are the Answer – What is the Question? Summary
  50. Copyright © 2023 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting 38 Data Catalogs Are the Answer – What is the Question? Q & A - Contact Information • Robert S. Seiner KIK Consulting & Educational Services – KIKconsulting.com The Data Administration Newsletter – TDAN.com rseiner@tdan.com @RSeiner 38
Anúncio