SlideShare uma empresa Scribd logo
1 de 11
Baixar para ler offline
Data Quality Services (DQS)
  First steps to Data Mining approach




Konstantin Khomyakov
konstantin.khomyakov@gmail.com
Agenda

   What is DQS ?
   Why use DQS ?
   Installation
   Knowledge base sources
   KB for Cleansing
   Matching Policy
   Demo
What is DQS ?

 A set of tools and services that allow data
  experts improve Data Quality
 Components:
   - Cleansing
   - Matching
   - Profiling
   - Monitoring
Why Use DQS ?

 To allow users with data domain knowledge to
  improve the quality of the data
 Manually define, match, cleanse
 Can ‘learn’
 Can incorporate 3rd party data
 Can integrate with other data processes (SSIS)
Installation DQS

 SQL Server 2012
 Not installed by default
 Must run ‘DQS Server Installer’ post SQL Install
Knowledge base sources
KB for Cleansing

   Using the DQS KB to do Cleansing
   Create or Open a Data Quality Project
   Map the DQS KB to the new data
   Perform Cleansing
   Manage/View Results
   Export corrected results
Matching Policy

 A matching policy consists of matching rules that
  asses how well one record matches to another
 Specify in the rule whether records values have
  to be an exact or similar
 Train a policy by running and tuning each rule
  separately
Demo

       Knowledge Base
              &
          Cleansing
Thanks for Attention


Konstantin Khomyakov
konstantin.khomyakov@gmail.com
Наши спонсоры

Mais conteúdo relacionado

Semelhante a Sql saturday 179 kharkov

SQL Server 2012 Certifications
SQL Server 2012 CertificationsSQL Server 2012 Certifications
SQL Server 2012 Certifications
Marcos Freccia
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
garyt1953
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
guest5a8ee60b
 

Semelhante a Sql saturday 179 kharkov (20)

SQLSaturday #188 - Enterprise Information Management
SQLSaturday #188  - Enterprise Information ManagementSQLSaturday #188  - Enterprise Information Management
SQLSaturday #188 - Enterprise Information Management
 
Data Base Testing Course Content
Data Base Testing Course ContentData Base Testing Course Content
Data Base Testing Course Content
 
Introduction-to-AWS-Architect-training by Apponix
Introduction-to-AWS-Architect-training by ApponixIntroduction-to-AWS-Architect-training by Apponix
Introduction-to-AWS-Architect-training by Apponix
 
Introduction-to-AWS-Architect-training.pptx
Introduction-to-AWS-Architect-training.pptxIntroduction-to-AWS-Architect-training.pptx
Introduction-to-AWS-Architect-training.pptx
 
Introduction-to-AWS-Architect-training.pptx
Introduction-to-AWS-Architect-training.pptxIntroduction-to-AWS-Architect-training.pptx
Introduction-to-AWS-Architect-training.pptx
 
Sql Server 2012
Sql Server 2012Sql Server 2012
Sql Server 2012
 
Defence IT 2012 - Data Quality and Financial Services - Solvency II
Defence IT 2012 - Data Quality and Financial Services - Solvency IIDefence IT 2012 - Data Quality and Financial Services - Solvency II
Defence IT 2012 - Data Quality and Financial Services - Solvency II
 
SQL Server 2012 Certifications
SQL Server 2012 CertificationsSQL Server 2012 Certifications
SQL Server 2012 Certifications
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
Steps towards business intelligence
Steps towards business intelligenceSteps towards business intelligence
Steps towards business intelligence
 
Elevate Your IT Operations: How DevOps as a Service Can Transform Your Business
Elevate Your IT Operations: How DevOps as a Service Can Transform Your BusinessElevate Your IT Operations: How DevOps as a Service Can Transform Your Business
Elevate Your IT Operations: How DevOps as a Service Can Transform Your Business
 
ISV Integrations
ISV IntegrationsISV Integrations
ISV Integrations
 
ISV Integrations
ISV IntegrationsISV Integrations
ISV Integrations
 
DQS & MDS in SQL Server 2016
DQS & MDS in SQL Server 2016DQS & MDS in SQL Server 2016
DQS & MDS in SQL Server 2016
 
Running GxP Compliant SAP Workloads on AWS
Running GxP Compliant SAP Workloads on AWSRunning GxP Compliant SAP Workloads on AWS
Running GxP Compliant SAP Workloads on AWS
 
Data Quality Services in SQL Server 2012
Data Quality Services in SQL Server 2012Data Quality Services in SQL Server 2012
Data Quality Services in SQL Server 2012
 
Microsoft Cloud Adoption Framework for Azure: Thru Partner Governance Workshop
Microsoft Cloud Adoption Framework for Azure: Thru Partner Governance WorkshopMicrosoft Cloud Adoption Framework for Azure: Thru Partner Governance Workshop
Microsoft Cloud Adoption Framework for Azure: Thru Partner Governance Workshop
 
Microsoft Cloud Adoption Framework
Microsoft Cloud Adoption FrameworkMicrosoft Cloud Adoption Framework
Microsoft Cloud Adoption Framework
 
How SQL Change Automation helps you deliver value faster
How SQL Change Automation helps you deliver value fasterHow SQL Change Automation helps you deliver value faster
How SQL Change Automation helps you deliver value faster
 

Sql saturday 179 kharkov

  • 1. Data Quality Services (DQS) First steps to Data Mining approach Konstantin Khomyakov konstantin.khomyakov@gmail.com
  • 2. Agenda  What is DQS ?  Why use DQS ?  Installation  Knowledge base sources  KB for Cleansing  Matching Policy  Demo
  • 3. What is DQS ?  A set of tools and services that allow data experts improve Data Quality  Components: - Cleansing - Matching - Profiling - Monitoring
  • 4. Why Use DQS ?  To allow users with data domain knowledge to improve the quality of the data  Manually define, match, cleanse  Can ‘learn’  Can incorporate 3rd party data  Can integrate with other data processes (SSIS)
  • 5. Installation DQS  SQL Server 2012  Not installed by default  Must run ‘DQS Server Installer’ post SQL Install
  • 7. KB for Cleansing  Using the DQS KB to do Cleansing  Create or Open a Data Quality Project  Map the DQS KB to the new data  Perform Cleansing  Manage/View Results  Export corrected results
  • 8. Matching Policy  A matching policy consists of matching rules that asses how well one record matches to another  Specify in the rule whether records values have to be an exact or similar  Train a policy by running and tuning each rule separately
  • 9. Demo Knowledge Base & Cleansing
  • 10. Thanks for Attention Konstantin Khomyakov konstantin.khomyakov@gmail.com