SlideShare uma empresa Scribd logo
1 de 14
• What is Data Validation Option
What can be tested
What is Data Validation Option
 Data Validation Option is a ETL Testing tool which comes along with
power center and enables to test and validate data
 Data Validation Option reads table definitions from PowerCenter
metadata repositories, and checks the data for inconsistencies

What can be tested
 Verify that moved or transformed data is complete and accurate and has
not been changed because of errors in the movement or transformation process
 Will not check the correctness of transformations or mappings designed in
Informatica
Data Validation Workflow
A typical workflow for data validation consists of multiple tasks-

 Data Validation Option reads one or more PowerCenter metadata repositories.
 We define the validation rules(creation of tests) in Data Validation Option

 We run the rules(tests) to ensure the data conforms to the validation rules. When w
Validation Option performs the following tasks:
1.
2.

Creates and executes all tests through PowerCenter.
Loads results into the Data Validation Option results database and displays them in the Data Valida

 We examine the results and identify data inconsistencies in the ETL process
 You repeat this process for new records.
Data Validation Option Client Layout
Overview
The Data Validation Option Client contains multiple areas that
allow us to perform different tasks.
• allow us to perform different tasks.
Repositories…
 Add
 Modify
 Delete
 Refresh
 Exporting Repository Metadata
Table Pairs
A table pair is the basis for all tests that compare one table to another. We can
select a relational
table, flat file, lookup view, or SQL view as one or both tables in a table pair.
 Add
 Modify
 Delete
Tests for Table Pairs
We can createrun the following types of tests on table pairs:
Aggregate • Includes COUNT, COUNT_DISTINCT, COUNT_ROWS, MIN, MAX, AVG, and SUM.
•
Set • Includes AinB, BinA, and AeqB.
•
Value • Includes VALUE and OUTER_VALUE

.

Note: When we run tests, the target folder must be closed in the Designer and Workflow
Manager. If the target folder is open, Data Validation Option cannot write to the folder,
and the tests return an error
Single Table Constraints Pairs
 single-table pair will be used to run tests on a single table. We can enforce valid
values, aggregates, formats, and uniqueness

 To run single-table constraints, we must create a single table. You can select a
relational table, flat file, lookup view, or SQL view as a single table
SQL Views
 SQL views facilitate the use of more complex functionality for single tables
and table pairs.
 An SQL view allows to use several tables and several calculations in a
query to produce a set of fields that you can use as a table in a single table
or table pair.
 This functionality is similar to the SQL override in PowerCenter or a view
in a relational database. You can use any valid SQL statement to create an
SQL view.
Lookup Views
 Data Validation Option lookup views allows to test the validity of the
lookup logic in transformation layer

 One disadvantage of the SQL view is that it does not allow the use of flat
files or heterogeneous database tables

 Join two heterogeneous sources with a lookup view
Import and export of Tests
 Data Validation Option allows you to export and import test metadata.

 Metadata import and export allows users to share tests and allows rapid generation o
scripting.

 You can import and export the following metadata:
• Table Pairs
• Single Tables
• PowerCenter Sources
• SQL views
• Lookup views
• Join views
Reports Generation
Data Validation Option stores all test definitions and test results
in the Data Validation Option repository. We can run reports to
display test definitions and results.
Types of reports:
 Summary of Testing Activities
 Table Pair Summary
 Detailed Test Results
Run tests through Command prompt
Invoke Data Validation Option capabilities at the command line.

Running tests at the command line allows you to schedule test execution. It also all
embed a specific test as part of the ETL workflow or as part of another process. For
can create an ETL process that moves data from source to staging, runs validation,
data into the target or an error table based on the validation results.

Send Emails
 Data Validation Option sends an email when the tests are complete.
 You can provide multiple email addresses separated by commas.

 The email specifies whether the test has passed or failed and provides a link to the
results.
END

Mais conteúdo relacionado

Mais procurados

Lesson 15 Using What If Analysis
Lesson 15   Using What If AnalysisLesson 15   Using What If Analysis
Lesson 15 Using What If Analysisguevarra_2000
 
2. Array in Data Structure
2. Array in Data Structure2. Array in Data Structure
2. Array in Data StructureMandeep Singh
 
Data validation - Excel
Data validation - ExcelData validation - Excel
Data validation - ExcelYi Chiao Cheng
 
Using macros in microsoft excel part 1
Using macros in microsoft excel   part 1Using macros in microsoft excel   part 1
Using macros in microsoft excel part 1Er. Nawaraj Bhandari
 
CS8383 Object Oriented Programming Laboratory Manual
CS8383 Object Oriented Programming Laboratory ManualCS8383 Object Oriented Programming Laboratory Manual
CS8383 Object Oriented Programming Laboratory ManualMuthu Vinayagam
 
Lect 08 materialized view
Lect 08 materialized viewLect 08 materialized view
Lect 08 materialized viewBilal khan
 
Transaction management and concurrency control
Transaction management and concurrency controlTransaction management and concurrency control
Transaction management and concurrency controlDhani Ahmad
 
Garbage collection
Garbage collectionGarbage collection
Garbage collectionMudit Gupta
 
C++ Standard Template Library
C++ Standard Template LibraryC++ Standard Template Library
C++ Standard Template LibraryIlio Catallo
 
Data validation
Data validationData validation
Data validationmuzzii27
 
Introduction To Multilevel Association Rule And Its Methods
Introduction To Multilevel Association Rule And Its MethodsIntroduction To Multilevel Association Rule And Its Methods
Introduction To Multilevel Association Rule And Its MethodsIJSRD
 
Informatica partitions
Informatica partitionsInformatica partitions
Informatica partitionssingh100
 
Standard Template Library
Standard Template LibraryStandard Template Library
Standard Template LibraryKumar Gaurav
 
Database basics
Database basicsDatabase basics
Database basicsprachin514
 
Business Intelligence (May – 2019) [Choice Based | Question Paper]
Business Intelligence (May – 2019) [Choice Based | Question Paper]Business Intelligence (May – 2019) [Choice Based | Question Paper]
Business Intelligence (May – 2019) [Choice Based | Question Paper]Mumbai B.Sc.IT Study
 
Introduction to data structure ppt
Introduction to data structure pptIntroduction to data structure ppt
Introduction to data structure pptNalinNishant3
 

Mais procurados (20)

Lesson 15 Using What If Analysis
Lesson 15   Using What If AnalysisLesson 15   Using What If Analysis
Lesson 15 Using What If Analysis
 
Iterator
IteratorIterator
Iterator
 
2. Array in Data Structure
2. Array in Data Structure2. Array in Data Structure
2. Array in Data Structure
 
Data validation - Excel
Data validation - ExcelData validation - Excel
Data validation - Excel
 
Using macros in microsoft excel part 1
Using macros in microsoft excel   part 1Using macros in microsoft excel   part 1
Using macros in microsoft excel part 1
 
CS8383 Object Oriented Programming Laboratory Manual
CS8383 Object Oriented Programming Laboratory ManualCS8383 Object Oriented Programming Laboratory Manual
CS8383 Object Oriented Programming Laboratory Manual
 
Lect 08 materialized view
Lect 08 materialized viewLect 08 materialized view
Lect 08 materialized view
 
Transaction management and concurrency control
Transaction management and concurrency controlTransaction management and concurrency control
Transaction management and concurrency control
 
Data integrity
Data integrityData integrity
Data integrity
 
Garbage collection
Garbage collectionGarbage collection
Garbage collection
 
C++ Standard Template Library
C++ Standard Template LibraryC++ Standard Template Library
C++ Standard Template Library
 
Data validation
Data validationData validation
Data validation
 
deque and it applications
deque and it applicationsdeque and it applications
deque and it applications
 
Introduction To Multilevel Association Rule And Its Methods
Introduction To Multilevel Association Rule And Its MethodsIntroduction To Multilevel Association Rule And Its Methods
Introduction To Multilevel Association Rule And Its Methods
 
Data structure
Data structureData structure
Data structure
 
Informatica partitions
Informatica partitionsInformatica partitions
Informatica partitions
 
Standard Template Library
Standard Template LibraryStandard Template Library
Standard Template Library
 
Database basics
Database basicsDatabase basics
Database basics
 
Business Intelligence (May – 2019) [Choice Based | Question Paper]
Business Intelligence (May – 2019) [Choice Based | Question Paper]Business Intelligence (May – 2019) [Choice Based | Question Paper]
Business Intelligence (May – 2019) [Choice Based | Question Paper]
 
Introduction to data structure ppt
Introduction to data structure pptIntroduction to data structure ppt
Introduction to data structure ppt
 

Semelhante a Data validation option

ETL Validator: Creating Data Model
ETL Validator: Creating Data ModelETL Validator: Creating Data Model
ETL Validator: Creating Data ModelDatagaps Inc
 
Modernizing SQL Server the Right Way
Modernizing SQL Server the Right WayModernizing SQL Server the Right Way
Modernizing SQL Server the Right WayJuan Fabian
 
QuerySurge integration with ETL / DataStage
QuerySurge integration with ETL / DataStageQuerySurge integration with ETL / DataStage
QuerySurge integration with ETL / DataStageAsad Abdullah
 
Software test management overview for managers
Software test management overview for managersSoftware test management overview for managers
Software test management overview for managersTJamesLeDoux
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing FrameworksMoataz Nabil
 
Data Driven Testing
Data Driven TestingData Driven Testing
Data Driven TestingMaveryx
 
Data driven testing
Data driven testingData driven testing
Data driven testingĐăng Minh
 
QuerySurge - the automated Data Testing solution
QuerySurge - the automated Data Testing solutionQuerySurge - the automated Data Testing solution
QuerySurge - the automated Data Testing solutionRTTS
 
Quality Center
Quality CenterQuality Center
Quality CenterSachin-QA
 
Test Management Tool HP ALM- Quality Center Part 1
Test Management Tool  HP ALM- Quality Center Part 1Test Management Tool  HP ALM- Quality Center Part 1
Test Management Tool HP ALM- Quality Center Part 1Murageppa-QA
 
HP Quality Center
HP Quality CenterHP Quality Center
HP Quality CenterANKUR-BA
 
Test Management Tool HP ALM- Quality Center Part 2
Test Management Tool  HP ALM- Quality Center Part 2Test Management Tool  HP ALM- Quality Center Part 2
Test Management Tool HP ALM- Quality Center Part 2Murageppa-QA
 
Leveraging HPE ALM & QuerySurge to test HPE Vertica
Leveraging HPE ALM & QuerySurge to test HPE VerticaLeveraging HPE ALM & QuerySurge to test HPE Vertica
Leveraging HPE ALM & QuerySurge to test HPE VerticaRTTS
 
05_DP_300T00A_Optimize.pptx
05_DP_300T00A_Optimize.pptx05_DP_300T00A_Optimize.pptx
05_DP_300T00A_Optimize.pptxKareemBullard1
 
Deliver Trusted Data by Leveraging ETL Testing
Deliver Trusted Data by Leveraging ETL TestingDeliver Trusted Data by Leveraging ETL Testing
Deliver Trusted Data by Leveraging ETL TestingCognizant
 
04 test controlling and tracking
04   test controlling and tracking04   test controlling and tracking
04 test controlling and trackingClemens Reijnen
 
Ssis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliSsis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliHong-Bing Li
 

Semelhante a Data validation option (20)

QTP_PRESENTATION_Andy
QTP_PRESENTATION_AndyQTP_PRESENTATION_Andy
QTP_PRESENTATION_Andy
 
CIS 282 Final Review
CIS 282 Final ReviewCIS 282 Final Review
CIS 282 Final Review
 
ETL Validator: Creating Data Model
ETL Validator: Creating Data ModelETL Validator: Creating Data Model
ETL Validator: Creating Data Model
 
Modernizing SQL Server the Right Way
Modernizing SQL Server the Right WayModernizing SQL Server the Right Way
Modernizing SQL Server the Right Way
 
QuerySurge integration with ETL / DataStage
QuerySurge integration with ETL / DataStageQuerySurge integration with ETL / DataStage
QuerySurge integration with ETL / DataStage
 
Software test management overview for managers
Software test management overview for managersSoftware test management overview for managers
Software test management overview for managers
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing Frameworks
 
Data Driven Testing
Data Driven TestingData Driven Testing
Data Driven Testing
 
Data driven testing
Data driven testingData driven testing
Data driven testing
 
QuerySurge - the automated Data Testing solution
QuerySurge - the automated Data Testing solutionQuerySurge - the automated Data Testing solution
QuerySurge - the automated Data Testing solution
 
Quality Center
Quality CenterQuality Center
Quality Center
 
Test Management Tool HP ALM- Quality Center Part 1
Test Management Tool  HP ALM- Quality Center Part 1Test Management Tool  HP ALM- Quality Center Part 1
Test Management Tool HP ALM- Quality Center Part 1
 
HP Quality Center
HP Quality CenterHP Quality Center
HP Quality Center
 
Test Management Tool HP ALM- Quality Center Part 2
Test Management Tool  HP ALM- Quality Center Part 2Test Management Tool  HP ALM- Quality Center Part 2
Test Management Tool HP ALM- Quality Center Part 2
 
Leveraging HPE ALM & QuerySurge to test HPE Vertica
Leveraging HPE ALM & QuerySurge to test HPE VerticaLeveraging HPE ALM & QuerySurge to test HPE Vertica
Leveraging HPE ALM & QuerySurge to test HPE Vertica
 
05_DP_300T00A_Optimize.pptx
05_DP_300T00A_Optimize.pptx05_DP_300T00A_Optimize.pptx
05_DP_300T00A_Optimize.pptx
 
Deliver Trusted Data by Leveraging ETL Testing
Deliver Trusted Data by Leveraging ETL TestingDeliver Trusted Data by Leveraging ETL Testing
Deliver Trusted Data by Leveraging ETL Testing
 
Etl testing
Etl testingEtl testing
Etl testing
 
04 test controlling and tracking
04   test controlling and tracking04   test controlling and tracking
04 test controlling and tracking
 
Ssis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliSsis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingli
 

Último

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdfChristopherTHyatt
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 

Último (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 

Data validation option

  • 1. • What is Data Validation Option What can be tested
  • 2. What is Data Validation Option  Data Validation Option is a ETL Testing tool which comes along with power center and enables to test and validate data  Data Validation Option reads table definitions from PowerCenter metadata repositories, and checks the data for inconsistencies What can be tested  Verify that moved or transformed data is complete and accurate and has not been changed because of errors in the movement or transformation process  Will not check the correctness of transformations or mappings designed in Informatica
  • 3. Data Validation Workflow A typical workflow for data validation consists of multiple tasks-  Data Validation Option reads one or more PowerCenter metadata repositories.  We define the validation rules(creation of tests) in Data Validation Option  We run the rules(tests) to ensure the data conforms to the validation rules. When w Validation Option performs the following tasks: 1. 2. Creates and executes all tests through PowerCenter. Loads results into the Data Validation Option results database and displays them in the Data Valida  We examine the results and identify data inconsistencies in the ETL process  You repeat this process for new records.
  • 4. Data Validation Option Client Layout Overview The Data Validation Option Client contains multiple areas that allow us to perform different tasks. • allow us to perform different tasks.
  • 5. Repositories…  Add  Modify  Delete  Refresh  Exporting Repository Metadata
  • 6. Table Pairs A table pair is the basis for all tests that compare one table to another. We can select a relational table, flat file, lookup view, or SQL view as one or both tables in a table pair.  Add  Modify  Delete
  • 7. Tests for Table Pairs We can createrun the following types of tests on table pairs: Aggregate • Includes COUNT, COUNT_DISTINCT, COUNT_ROWS, MIN, MAX, AVG, and SUM. • Set • Includes AinB, BinA, and AeqB. • Value • Includes VALUE and OUTER_VALUE . Note: When we run tests, the target folder must be closed in the Designer and Workflow Manager. If the target folder is open, Data Validation Option cannot write to the folder, and the tests return an error
  • 8. Single Table Constraints Pairs  single-table pair will be used to run tests on a single table. We can enforce valid values, aggregates, formats, and uniqueness  To run single-table constraints, we must create a single table. You can select a relational table, flat file, lookup view, or SQL view as a single table
  • 9. SQL Views  SQL views facilitate the use of more complex functionality for single tables and table pairs.  An SQL view allows to use several tables and several calculations in a query to produce a set of fields that you can use as a table in a single table or table pair.  This functionality is similar to the SQL override in PowerCenter or a view in a relational database. You can use any valid SQL statement to create an SQL view.
  • 10. Lookup Views  Data Validation Option lookup views allows to test the validity of the lookup logic in transformation layer  One disadvantage of the SQL view is that it does not allow the use of flat files or heterogeneous database tables  Join two heterogeneous sources with a lookup view
  • 11. Import and export of Tests  Data Validation Option allows you to export and import test metadata.  Metadata import and export allows users to share tests and allows rapid generation o scripting.  You can import and export the following metadata: • Table Pairs • Single Tables • PowerCenter Sources • SQL views • Lookup views • Join views
  • 12. Reports Generation Data Validation Option stores all test definitions and test results in the Data Validation Option repository. We can run reports to display test definitions and results. Types of reports:  Summary of Testing Activities  Table Pair Summary  Detailed Test Results
  • 13. Run tests through Command prompt Invoke Data Validation Option capabilities at the command line. Running tests at the command line allows you to schedule test execution. It also all embed a specific test as part of the ETL workflow or as part of another process. For can create an ETL process that moves data from source to staging, runs validation, data into the target or an error table based on the validation results. Send Emails  Data Validation Option sends an email when the tests are complete.  You can provide multiple email addresses separated by commas.  The email specifies whether the test has passed or failed and provides a link to the results.
  • 14. END