SlideShare uma empresa Scribd logo
1 de 24
Baixar para ler offline
Unlocking Greater Insights
with Integrated Data
Quality for Collibra
Harald Smith, Dir. Product Marketing
Mike Sisolak, Sr. Sales Engineer
Housekeeping
Webcast Audio
• Today’s webcast audio is streamed through your computer speakers.
• If you need technical assistance with the web interface or audio,
please reach out to us using the chat window.
Questions Welcome
• Submit your questions at any time during the presentation
using the chat window.
• We will answer them during our Q&A session following the
presentation.
Recording and slides
• This webcast is being recorded. You will receive an
email following the webcast with a link to download
both the recording and the slides.
Speakers
Harald Smith
• Director Product Marketing, Syncsort Trillium
• 20+ years in Information Management incl. data quality, integration, and governance
• Co-author of Patterns of Information Management
• Author of two Redbooks on Information Governance and Data Integration
Michael Sisolak
• Pre-Sales Consultant for Syncsort
• Specializes in Data Quality, Data Governance, Data Integration and Big Data.
• 20+ years data management experience
• Trillium-Collibra integration expert
Terminology
Data Governance
The set of policies, processes, rules,
roles and responsibilities that help
organisations manage data as a
corporate asset.
Ensures the availability, usability,
integrity, accuracy, compliance and
security of data.
Data Quality
The processes and rules that help
ensure that data is “fit for use” in its
intended operational and decision-
making contexts.
Covers the accuracy, completeness,
consistency, relevance, timeliness and
validity of data.
4
5
Areas of common interest
Data Availability
Data Compliance
Defining Key Data
Elements
Assigning Data Stewards
& Council
Glossaries &
Dictionaries
Data Consistency
& Standardization
Monitoring
Analytics
Policies & Rules
Metrics
Data Lineage
Reporting
Cleansing
Enrichment
Parsing
Discovery & Profiling
Matching, Suppression &
Deduplication
Data Quality
ACCURACY
COMPLETENESS
CONSISTENCY
RELEVANCE
TIMELINESS
VALIDITY
Data Governance
PEOPLE
PROCESSES
POLICIES
RULES
STANDARDS
DOCUMENTATION
SECURITY
Relevant
Rules &
Policies
Data Quality needs appropriate Data Governance tools to ensure the data is
cleaned and maintained within an appropriate data framework which is relevant
and pertinent to the business needs
Symbiotic relationship between DQ & DG
High
Quality
Data
Data Governance needs appropriate Data Quality tools to not-only clean the raw
data, but to illustrate data errors, peculiarities and issues, in order to help
compile the best standards and monitor the data quality over time
DQDG
6
Comes down to three main facts of Data Governance
There is a need to know:
Why Trillium and Collibra?
Who owns the data?
Where can I get the data?
Can I trust the data?
7
Comes down to three main facts of Data Governance
There is a need to know:
Why Trillium and Collibra?
Who owns the data?
Where can I get the data?
Can I trust the data?
Data Quality provides that trust!
8
One common use case connecting Data Governance (policies) and
Data Quality (validation) is Report Certification
Use case:
• Focus on CDE's (Critical Data Elements) on a few key reports and have
Trillium supply the quality metrics to support those CDE’s
• This can typically be quickly accomplished with a small number of business
rules that ensure the quality of the data in Collibra for those CDE’s
• This allows for the ability to ensure that the data that is put on a regulatory
or compliance report is of the highest quality
Use case example
9
10
Business rule created in Collibra
Same rule ‘pushed’ to Trillium
11
Rule detail in Trillium before created by Data Steward
Description from Collibra
12
Rule detail in Trillium after created by Data Steward
Expression to evaluate rule against the data
13
Setting acceptable standards by Data Steward
Threshold is adjustable as required
14
Rule results captured in Trillium
Failing rows available to assist with root cause
analysis and Business Process adjustment
15
Updated rulebook in Collibra after ‘push back’
Data Quality Metric was created for rule results
16
Data quality rule and metric with data from Trillium
Predicate = Expression from Trillium
17
Data quality metrics for a business term
18
Data quality metrics over time
19
20
Connection to/from Collibra is straightforward
Connect
Application
• Out-of-the-box packaged workflow with Trillium Discovery
• Automatically connect and deliver content through Collibra
Connect Hub via REST API’s
• Collibra Connect Hub provides a single self-service API which
facilitates connecting integrations to Collibra DGC
Integrated data duality for Collibra
Collibra Data Governance Center
• Enables non-technical users to define
business policies and data quality rules in
plain language
• Makes data quality performance available
to all users
Trillium Discovery
• Imports DGC business rules so technical user
can convert to executable data quality rules
• Constantly runs data quality metrics on near
real-time basis, passes results back to Collibra
dashboards
Rulebooks to Rules
Quality test Results
Bi-directional connectivity Constant sync
Metric falling below
thresholds can
trigger workflow in
Collibra Issue
Management
21
• It is challenging for organizations to respond to data governance
policies and requirements in a timely manner even with tools like
Collibra DGC.
• Data typically comes from multiple disparate systems & sources
• The number of touchpoints for policies and rules has grown
dramatically.
• There is a higher demand and expectation for seeing data quality in
context.
• Regardless of the data governance policy, the simple fact is that
they all require metrics and insight based on actual data and
executed rules.
• Integrating data quality directly into data governance is more
critical than ever!
Summary
22
Questions
Unlocking Greater Insights with Integrated Data Quality for Collibra

Mais conteúdo relacionado

Mais procurados

Enabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationEnabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data Virtualization
Denodo
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
DATAVERSITY
 

Mais procurados (20)

Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...
Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...
Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data Architecture
 
Modern Data architecture Design
Modern Data architecture DesignModern Data architecture Design
Modern Data architecture Design
 
DAMA Feb2015 Mastering Master Data
DAMA Feb2015 Mastering Master DataDAMA Feb2015 Mastering Master Data
DAMA Feb2015 Mastering Master Data
 
Best Practices in Metadata Management
Best Practices in Metadata ManagementBest Practices in Metadata Management
Best Practices in Metadata Management
 
Metadata Strategies - Data Squared
Metadata Strategies - Data SquaredMetadata Strategies - Data Squared
Metadata Strategies - Data Squared
 
Building a modern data warehouse
Building a modern data warehouseBuilding a modern data warehouse
Building a modern data warehouse
 
Modernizing to a Cloud Data Architecture
Modernizing to a Cloud Data ArchitectureModernizing to a Cloud Data Architecture
Modernizing to a Cloud Data Architecture
 
Data Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationData Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital Transformation
 
Enterprise Data Architecture Deliverables
Enterprise Data Architecture DeliverablesEnterprise Data Architecture Deliverables
Enterprise Data Architecture Deliverables
 
The ABCs of Treating Data as Product
The ABCs of Treating Data as ProductThe ABCs of Treating Data as Product
The ABCs of Treating Data as Product
 
Data Governance and Metadata Management
Data Governance and Metadata ManagementData Governance and Metadata Management
Data Governance and Metadata Management
 
Enabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationEnabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data Virtualization
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
 
Gartner: Master Data Management Functionality
Gartner: Master Data Management FunctionalityGartner: Master Data Management Functionality
Gartner: Master Data Management Functionality
 
Future of Data Engineering
Future of Data EngineeringFuture of Data Engineering
Future of Data Engineering
 
Databricks: A Tool That Empowers You To Do More With Data
Databricks: A Tool That Empowers You To Do More With DataDatabricks: A Tool That Empowers You To Do More With Data
Databricks: A Tool That Empowers You To Do More With Data
 
Slides: Taking an Active Approach to Data Governance
Slides: Taking an Active Approach to Data GovernanceSlides: Taking an Active Approach to Data Governance
Slides: Taking an Active Approach to Data Governance
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data Architecture
 
8 Steps to Creating a Data Strategy
8 Steps to Creating a Data Strategy8 Steps to Creating a Data Strategy
8 Steps to Creating a Data Strategy
 

Semelhante a Unlocking Greater Insights with Integrated Data Quality for Collibra

Maximize ROI of Insurance Digital Transformation Initiatives with Proven Data...
Maximize ROI of Insurance Digital Transformation Initiatives with Proven Data...Maximize ROI of Insurance Digital Transformation Initiatives with Proven Data...
Maximize ROI of Insurance Digital Transformation Initiatives with Proven Data...
Precisely
 
Data Governance That Drives the Bottom Line
Data Governance That Drives the Bottom LineData Governance That Drives the Bottom Line
Data Governance That Drives the Bottom Line
Precisely
 

Semelhante a Unlocking Greater Insights with Integrated Data Quality for Collibra (20)

Building Rules for Data Governance
Building Rules for Data GovernanceBuilding Rules for Data Governance
Building Rules for Data Governance
 
Maximize ROI of Insurance Digital Transformation Initiatives with Proven Data...
Maximize ROI of Insurance Digital Transformation Initiatives with Proven Data...Maximize ROI of Insurance Digital Transformation Initiatives with Proven Data...
Maximize ROI of Insurance Digital Transformation Initiatives with Proven Data...
 
Trillium Discovery for Collibra
Trillium Discovery for CollibraTrillium Discovery for Collibra
Trillium Discovery for Collibra
 
Best Practices for Adopting Microsoft Dynamics 365
Best Practices for Adopting Microsoft Dynamics 365Best Practices for Adopting Microsoft Dynamics 365
Best Practices for Adopting Microsoft Dynamics 365
 
Empowering Business & IT Teams:  Modern Data Catalog Requirements
Empowering Business & IT Teams:  Modern Data Catalog RequirementsEmpowering Business & IT Teams:  Modern Data Catalog Requirements
Empowering Business & IT Teams:  Modern Data Catalog Requirements
 
Data Quality from Precisely: Trillium Quality & Discovery
Data Quality from Precisely: Trillium Quality & DiscoveryData Quality from Precisely: Trillium Quality & Discovery
Data Quality from Precisely: Trillium Quality & Discovery
 
Fueling Enterprise Data Governance with Data Quality
Fueling Enterprise Data Governance with Data QualityFueling Enterprise Data Governance with Data Quality
Fueling Enterprise Data Governance with Data Quality
 
Foundational Strategies for Trust in Big Data Part 3: Data Lineage
Foundational Strategies for Trust in Big Data Part 3: Data LineageFoundational Strategies for Trust in Big Data Part 3: Data Lineage
Foundational Strategies for Trust in Big Data Part 3: Data Lineage
 
Sabre: Mastering a strong foundation for operational excellence and enhanced ...
Sabre: Mastering a strong foundation for operational excellence and enhanced ...Sabre: Mastering a strong foundation for operational excellence and enhanced ...
Sabre: Mastering a strong foundation for operational excellence and enhanced ...
 
Data Governance That Drives the Bottom Line
Data Governance That Drives the Bottom LineData Governance That Drives the Bottom Line
Data Governance That Drives the Bottom Line
 
The New Trillium DQ: Big Data Insights When and Where You Need Them
The New Trillium DQ: Big Data Insights When and Where You Need ThemThe New Trillium DQ: Big Data Insights When and Where You Need Them
The New Trillium DQ: Big Data Insights When and Where You Need Them
 
Four Must-Haves for Data Governance in Financial Services
Four Must-Haves for Data Governance in Financial ServicesFour Must-Haves for Data Governance in Financial Services
Four Must-Haves for Data Governance in Financial Services
 
Data governance in a Cloud BI world
Data governance in a Cloud BI worldData governance in a Cloud BI world
Data governance in a Cloud BI world
 
What's New in Syncsort's Trillium Line of Data Quality Software - TSS Enterpr...
What's New in Syncsort's Trillium Line of Data Quality Software - TSS Enterpr...What's New in Syncsort's Trillium Line of Data Quality Software - TSS Enterpr...
What's New in Syncsort's Trillium Line of Data Quality Software - TSS Enterpr...
 
Introducing Trillium DQ for Big Data: Powerful Profiling and Data Quality for...
Introducing Trillium DQ for Big Data: Powerful Profiling and Data Quality for...Introducing Trillium DQ for Big Data: Powerful Profiling and Data Quality for...
Introducing Trillium DQ for Big Data: Powerful Profiling and Data Quality for...
 
Foundational Strategies for Trust in Big Data Part 1: Getting Data to the Pla...
Foundational Strategies for Trust in Big Data Part 1: Getting Data to the Pla...Foundational Strategies for Trust in Big Data Part 1: Getting Data to the Pla...
Foundational Strategies for Trust in Big Data Part 1: Getting Data to the Pla...
 
Dynamics 365 fall summit 2017 final uploaded
Dynamics 365 fall summit 2017 final uploadedDynamics 365 fall summit 2017 final uploaded
Dynamics 365 fall summit 2017 final uploaded
 
How to Build Data Governance Programs That Lasts: A Business-First Approach
 How to Build Data Governance Programs That Lasts: A Business-First Approach How to Build Data Governance Programs That Lasts: A Business-First Approach
How to Build Data Governance Programs That Lasts: A Business-First Approach
 
Democratized Data & Analytics for the Cloud​
Democratized Data & Analytics for the Cloud​Democratized Data & Analytics for the Cloud​
Democratized Data & Analytics for the Cloud​
 
Finding Data at Risk for CCPA Compliance
Finding Data at Risk for CCPA ComplianceFinding Data at Risk for CCPA Compliance
Finding Data at Risk for CCPA Compliance
 

Mais de Precisely

How to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdfHow to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdf
Precisely
 
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter MassendatenZukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Precisely
 
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Precisely
 
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3fTestjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Precisely
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
Precisely
 
Moving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and PreciselyMoving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and Precisely
Precisely
 
Automate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center ExcellenceAutomate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center Excellence
Precisely
 

Mais de Precisely (20)

How to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdfHow to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdf
 
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter MassendatenZukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Crucial Considerations for AI-ready Data.pdf
Crucial Considerations for AI-ready Data.pdfCrucial Considerations for AI-ready Data.pdf
Crucial Considerations for AI-ready Data.pdf
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Justifying Capacity Managment Webinar 4/10
Justifying Capacity Managment Webinar 4/10Justifying Capacity Managment Webinar 4/10
Justifying Capacity Managment Webinar 4/10
 
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
 
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
 
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3fTestjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
 
Data Innovation Summit: Data Integrity Trends
Data Innovation Summit: Data Integrity TrendsData Innovation Summit: Data Integrity Trends
Data Innovation Summit: Data Integrity Trends
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Optimisez la fonction financière en automatisant vos processus SAP
Optimisez la fonction financière en automatisant vos processus SAPOptimisez la fonction financière en automatisant vos processus SAP
Optimisez la fonction financière en automatisant vos processus SAP
 
SAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
SAPS/4HANA Migration - Transformation-Management + nachhaltige InvestitionenSAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
SAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
 
Automatisierte SAP Prozesse mit Hilfe von APIs
Automatisierte SAP Prozesse mit Hilfe von APIsAutomatisierte SAP Prozesse mit Hilfe von APIs
Automatisierte SAP Prozesse mit Hilfe von APIs
 
Moving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and PreciselyMoving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and Precisely
 
Effective Security Monitoring for IBM i: What You Need to Know
Effective Security Monitoring for IBM i: What You Need to KnowEffective Security Monitoring for IBM i: What You Need to Know
Effective Security Monitoring for IBM i: What You Need to Know
 
Automate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center ExcellenceAutomate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center Excellence
 
5 Keys to Improved IT Operation Management
5 Keys to Improved IT Operation Management5 Keys to Improved IT Operation Management
5 Keys to Improved IT Operation Management
 
Unlock Efficiency With Your Address Data Today For a Smarter Tomorrow
Unlock Efficiency With Your Address Data Today For a Smarter TomorrowUnlock Efficiency With Your Address Data Today For a Smarter Tomorrow
Unlock Efficiency With Your Address Data Today For a Smarter Tomorrow
 
Navigating Cloud Trends in 2024 Webinar Deck
Navigating Cloud Trends in 2024 Webinar DeckNavigating Cloud Trends in 2024 Webinar Deck
Navigating Cloud Trends in 2024 Webinar Deck
 

Último

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Último (20)

A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 

Unlocking Greater Insights with Integrated Data Quality for Collibra

  • 1. Unlocking Greater Insights with Integrated Data Quality for Collibra Harald Smith, Dir. Product Marketing Mike Sisolak, Sr. Sales Engineer
  • 2. Housekeeping Webcast Audio • Today’s webcast audio is streamed through your computer speakers. • If you need technical assistance with the web interface or audio, please reach out to us using the chat window. Questions Welcome • Submit your questions at any time during the presentation using the chat window. • We will answer them during our Q&A session following the presentation. Recording and slides • This webcast is being recorded. You will receive an email following the webcast with a link to download both the recording and the slides.
  • 3. Speakers Harald Smith • Director Product Marketing, Syncsort Trillium • 20+ years in Information Management incl. data quality, integration, and governance • Co-author of Patterns of Information Management • Author of two Redbooks on Information Governance and Data Integration Michael Sisolak • Pre-Sales Consultant for Syncsort • Specializes in Data Quality, Data Governance, Data Integration and Big Data. • 20+ years data management experience • Trillium-Collibra integration expert
  • 4. Terminology Data Governance The set of policies, processes, rules, roles and responsibilities that help organisations manage data as a corporate asset. Ensures the availability, usability, integrity, accuracy, compliance and security of data. Data Quality The processes and rules that help ensure that data is “fit for use” in its intended operational and decision- making contexts. Covers the accuracy, completeness, consistency, relevance, timeliness and validity of data. 4
  • 5. 5 Areas of common interest Data Availability Data Compliance Defining Key Data Elements Assigning Data Stewards & Council Glossaries & Dictionaries Data Consistency & Standardization Monitoring Analytics Policies & Rules Metrics Data Lineage Reporting Cleansing Enrichment Parsing Discovery & Profiling Matching, Suppression & Deduplication Data Quality ACCURACY COMPLETENESS CONSISTENCY RELEVANCE TIMELINESS VALIDITY Data Governance PEOPLE PROCESSES POLICIES RULES STANDARDS DOCUMENTATION SECURITY
  • 6. Relevant Rules & Policies Data Quality needs appropriate Data Governance tools to ensure the data is cleaned and maintained within an appropriate data framework which is relevant and pertinent to the business needs Symbiotic relationship between DQ & DG High Quality Data Data Governance needs appropriate Data Quality tools to not-only clean the raw data, but to illustrate data errors, peculiarities and issues, in order to help compile the best standards and monitor the data quality over time DQDG 6
  • 7. Comes down to three main facts of Data Governance There is a need to know: Why Trillium and Collibra? Who owns the data? Where can I get the data? Can I trust the data? 7
  • 8. Comes down to three main facts of Data Governance There is a need to know: Why Trillium and Collibra? Who owns the data? Where can I get the data? Can I trust the data? Data Quality provides that trust! 8
  • 9. One common use case connecting Data Governance (policies) and Data Quality (validation) is Report Certification Use case: • Focus on CDE's (Critical Data Elements) on a few key reports and have Trillium supply the quality metrics to support those CDE’s • This can typically be quickly accomplished with a small number of business rules that ensure the quality of the data in Collibra for those CDE’s • This allows for the ability to ensure that the data that is put on a regulatory or compliance report is of the highest quality Use case example 9
  • 11. Same rule ‘pushed’ to Trillium 11
  • 12. Rule detail in Trillium before created by Data Steward Description from Collibra 12
  • 13. Rule detail in Trillium after created by Data Steward Expression to evaluate rule against the data 13
  • 14. Setting acceptable standards by Data Steward Threshold is adjustable as required 14
  • 15. Rule results captured in Trillium Failing rows available to assist with root cause analysis and Business Process adjustment 15
  • 16. Updated rulebook in Collibra after ‘push back’ Data Quality Metric was created for rule results 16
  • 17. Data quality rule and metric with data from Trillium Predicate = Expression from Trillium 17
  • 18. Data quality metrics for a business term 18
  • 19. Data quality metrics over time 19
  • 20. 20 Connection to/from Collibra is straightforward Connect Application • Out-of-the-box packaged workflow with Trillium Discovery • Automatically connect and deliver content through Collibra Connect Hub via REST API’s • Collibra Connect Hub provides a single self-service API which facilitates connecting integrations to Collibra DGC
  • 21. Integrated data duality for Collibra Collibra Data Governance Center • Enables non-technical users to define business policies and data quality rules in plain language • Makes data quality performance available to all users Trillium Discovery • Imports DGC business rules so technical user can convert to executable data quality rules • Constantly runs data quality metrics on near real-time basis, passes results back to Collibra dashboards Rulebooks to Rules Quality test Results Bi-directional connectivity Constant sync Metric falling below thresholds can trigger workflow in Collibra Issue Management 21
  • 22. • It is challenging for organizations to respond to data governance policies and requirements in a timely manner even with tools like Collibra DGC. • Data typically comes from multiple disparate systems & sources • The number of touchpoints for policies and rules has grown dramatically. • There is a higher demand and expectation for seeing data quality in context. • Regardless of the data governance policy, the simple fact is that they all require metrics and insight based on actual data and executed rules. • Integrating data quality directly into data governance is more critical than ever! Summary 22