SlideShare uma empresa Scribd logo
1 de 14
TEST DATA TRANSFER TOOL (TDTT) – Hai Nguyen
Agenda
•Overview
•Demo
•QA
Goals
This tool is designed to transfer the data
between environments to create test or demo
environments with the latest data.
It shouldn’t be used to import data into the
production environment.
Goals (cont)
The Test Data Transfer Tool works by calling the Microsoft SQL Server
client tools bulk copy program, BCP.exe. BCP runs very quickly, thus
this tool runs faster than some other data transfer tools. The Test
Data Transfer Tool does not interact with the AOS.
You must have a CustomerSource or PartnerSource account to be
able to download the Test Data Transfer Tool installer. The installer
must be run by an administrator account.
As of today, you can download the tool from LCS (Life Cycle
Services).
Pre-requisites
• To be run on a system with SQL Server client tools installed.
• During import, you must run the tool directly from the
computer that is hosting the database.
• Select & Bulk Insert permissions on the SQL database and
ALTER INDEX permission on the table (this is needed if the
data violates the unique index constraints and you want index
to be
disabled automatically).
• Permission to execute SQL scripts that are executed pre- and
post export/import. These can be found in import and
export directory.
PROS and CONS
PROS
1. Very lightweight and simple to use tool.
2. Can be installed on any machine that has the SQL Server Client tools installed.
3. Can be handy tool in transferring the data among the different environments (for example
data transfer from production to the training environment).
4. This tool can be used to move subset of the data.
5. The tool can be used to import and export any AX entity but I found it more useful while
transferring configuration data among the environments. (for example module parameters
tables)
6. Fast when compare to other data migration tools for AX.
7. Can export or import data when an AOS instance is not running.
8. Export or import Microsoft Dynamics AX data more quickly compared to other methods.
9. Only minimal changes are made to the data that you import. This feature helps guarantee
that the data is stable over time. For example, the tool never renumbers RecIDs.
PROS (cont)
10. The data file format is text-based. Therefore, the data can be compared with earlier versions and
stored in a version control system.
11. The data file format is a standard format that is produced by bcp.
12. Exported data can be filtered. Therefore, specified tables, columns, or rows can be easily excluded
from the export.
13. Differences often occur during development. Because of this feature, data can often be imported
without user intervention, even when the table definitions have changed. For example, tables or fields
that have been renamed do not prevent import.
14. Entity IDs, such as table IDs, class IDs, and extended data type IDs, are updated to match the IDs of the
target system.
15. The tool reads and correctly updates the SYSTEMSEQUENCES table.
CONS
1.The usage of this tool requires you to have a SQL related skillset.
Since the tool is actually a wrapper on top of SQL Server Bulk Copy
Program (bcp) that’s why the expert level knowledge of the AX
database schema and T-SQL is a must.
2.Since the tool works directly on SQL Server database that’s why the
tool doesn’t make sure that your import produces a complete or
coherent database.
3.Need to have access to SQL database and can run as Admin
4.Command line and there is no UI
Export and import process illustrated
Syntax
DP.exe {direction} {directory} {database name} {server}
Syntax
Parameter Description Default value
Direction Parameters indicates the direction (Import/Export)
Specify IMPORT for Importing Data and EXPORT for
exporting data.
EXPORT
directory Indicates the directory
• from which to import data (or)
• To which to export data files
Defaults to current directory if not
specified
database The name of the database:
• from which to export data (or)
• To which import data in to.
AXDB
server The name of the sql server on which the database
is hosted
The current computer name
DEMO
Q&A

Mais conteúdo relacionado

Mais procurados

AX2012 Technical Track - Entreprise portal, Czesia Langoswka
AX2012 Technical Track -  Entreprise portal, Czesia LangoswkaAX2012 Technical Track -  Entreprise portal, Czesia Langoswka
AX2012 Technical Track - Entreprise portal, Czesia Langoswka
dynamicscom
 
Graviton BI Publisher Presentation
Graviton BI Publisher PresentationGraviton BI Publisher Presentation
Graviton BI Publisher Presentation
gravitonconsulting
 
Introduction of ssis
Introduction of ssisIntroduction of ssis
Introduction of ssis
deepakk073
 

Mais procurados (20)

Oracle BI Publsiher Using Data Template
Oracle BI Publsiher Using Data TemplateOracle BI Publsiher Using Data Template
Oracle BI Publsiher Using Data Template
 
AX2012 Technical Track - Entreprise portal, Czesia Langoswka
AX2012 Technical Track -  Entreprise portal, Czesia LangoswkaAX2012 Technical Track -  Entreprise portal, Czesia Langoswka
AX2012 Technical Track - Entreprise portal, Czesia Langoswka
 
An Introduction to the Dynamics AX Application Integration Framework
An Introduction to the Dynamics AX Application Integration FrameworkAn Introduction to the Dynamics AX Application Integration Framework
An Introduction to the Dynamics AX Application Integration Framework
 
Data Warehouse approaches with Dynamics AX
Data Warehouse  approaches with Dynamics AXData Warehouse  approaches with Dynamics AX
Data Warehouse approaches with Dynamics AX
 
Xml Publisher
Xml PublisherXml Publisher
Xml Publisher
 
SQL Server Integration Services
SQL Server Integration ServicesSQL Server Integration Services
SQL Server Integration Services
 
Microsoft Dynamics Ax 2012 extended architecture
Microsoft Dynamics Ax 2012 extended architectureMicrosoft Dynamics Ax 2012 extended architecture
Microsoft Dynamics Ax 2012 extended architecture
 
Oracle cloud security | User Security, Roles, Access Control and more
Oracle cloud security | User Security, Roles, Access Control and moreOracle cloud security | User Security, Roles, Access Control and more
Oracle cloud security | User Security, Roles, Access Control and more
 
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
 
What is Business Objects
What is Business Objects What is Business Objects
What is Business Objects
 
Graviton BI Publisher Presentation
Graviton BI Publisher PresentationGraviton BI Publisher Presentation
Graviton BI Publisher Presentation
 
MS SQL SERVER: SSIS and data mining
MS SQL SERVER: SSIS and data miningMS SQL SERVER: SSIS and data mining
MS SQL SERVER: SSIS and data mining
 
New features of sql server 2016 bi features
New features of sql server 2016 bi featuresNew features of sql server 2016 bi features
New features of sql server 2016 bi features
 
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
 
SQL Server Integration Services Best Practices
SQL Server Integration Services Best PracticesSQL Server Integration Services Best Practices
SQL Server Integration Services Best Practices
 
Data Aware Enterprise v2
Data Aware Enterprise v2Data Aware Enterprise v2
Data Aware Enterprise v2
 
SQL Server Integration Services
SQL Server Integration ServicesSQL Server Integration Services
SQL Server Integration Services
 
Bi publisher starter guide to develop first report
Bi publisher starter guide to develop first reportBi publisher starter guide to develop first report
Bi publisher starter guide to develop first report
 
Adx studio migration
Adx studio migrationAdx studio migration
Adx studio migration
 
Introduction of ssis
Introduction of ssisIntroduction of ssis
Introduction of ssis
 

Destaque

Destaque (6)

Master Data Management
Master Data ManagementMaster Data Management
Master Data Management
 
What's new in microsoft dynamics ax7
What's new in microsoft dynamics ax7What's new in microsoft dynamics ax7
What's new in microsoft dynamics ax7
 
SharePoint Benefits
SharePoint BenefitsSharePoint Benefits
SharePoint Benefits
 
12 Personality Traits Of A Great Boss
12 Personality Traits Of A Great Boss 12 Personality Traits Of A Great Boss
12 Personality Traits Of A Great Boss
 
Managing for Happiness by Jurgen Appelo
Managing for Happiness by Jurgen AppeloManaging for Happiness by Jurgen Appelo
Managing for Happiness by Jurgen Appelo
 
Master Data Management methodology
Master Data Management methodologyMaster Data Management methodology
Master Data Management methodology
 

Semelhante a Test Data Transfer Tool

introductionofssis-130418034853-phpapp01.pptx
introductionofssis-130418034853-phpapp01.pptxintroductionofssis-130418034853-phpapp01.pptx
introductionofssis-130418034853-phpapp01.pptx
YashaswiniSrinivasan1
 
Oracle application express ppt
Oracle application express pptOracle application express ppt
Oracle application express ppt
Abhinaw Kumar
 
Microsoft SQL Server - SQL Server Migrations Presentation
Microsoft SQL Server - SQL Server Migrations PresentationMicrosoft SQL Server - SQL Server Migrations Presentation
Microsoft SQL Server - SQL Server Migrations Presentation
Microsoft Private Cloud
 
Building the DW - ETL
Building the DW - ETLBuilding the DW - ETL
Building the DW - ETL
ganblues
 

Semelhante a Test Data Transfer Tool (20)

introductionofssis-130418034853-phpapp01.pptx
introductionofssis-130418034853-phpapp01.pptxintroductionofssis-130418034853-phpapp01.pptx
introductionofssis-130418034853-phpapp01.pptx
 
AWS RDS Migration Tool
AWS RDS Migration Tool AWS RDS Migration Tool
AWS RDS Migration Tool
 
Introduction to SQL, SQL*Plus
Introduction to SQL, SQL*PlusIntroduction to SQL, SQL*Plus
Introduction to SQL, SQL*Plus
 
IDUG 2015 NA Data Movement Utilities final
IDUG 2015 NA Data Movement Utilities finalIDUG 2015 NA Data Movement Utilities final
IDUG 2015 NA Data Movement Utilities final
 
Oracle application express
Oracle application expressOracle application express
Oracle application express
 
Oracle application express ppt
Oracle application express pptOracle application express ppt
Oracle application express ppt
 
Microsoft SQL Server - SQL Server Migrations Presentation
Microsoft SQL Server - SQL Server Migrations PresentationMicrosoft SQL Server - SQL Server Migrations Presentation
Microsoft SQL Server - SQL Server Migrations Presentation
 
Project Presentation
Project PresentationProject Presentation
Project Presentation
 
Novidades do SQL Server 2016
Novidades do SQL Server 2016Novidades do SQL Server 2016
Novidades do SQL Server 2016
 
Azure Data Fundamentals DP 900 Full Course
Azure Data Fundamentals DP 900 Full CourseAzure Data Fundamentals DP 900 Full Course
Azure Data Fundamentals DP 900 Full Course
 
Optimizing Data Accessin Sq Lserver2005
Optimizing Data Accessin Sq Lserver2005Optimizing Data Accessin Sq Lserver2005
Optimizing Data Accessin Sq Lserver2005
 
Deep Dive into Azure Data Factory v2
Deep Dive into Azure Data Factory v2Deep Dive into Azure Data Factory v2
Deep Dive into Azure Data Factory v2
 
SQL PPT.pptx
SQL PPT.pptxSQL PPT.pptx
SQL PPT.pptx
 
Ado
AdoAdo
Ado
 
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
 
People soft basics
People soft basicsPeople soft basics
People soft basics
 
Oracle applications r12.2, ebr, online patching means lot of work for devel...
Oracle applications r12.2, ebr, online patching   means lot of work for devel...Oracle applications r12.2, ebr, online patching   means lot of work for devel...
Oracle applications r12.2, ebr, online patching means lot of work for devel...
 
Building the DW - ETL
Building the DW - ETLBuilding the DW - ETL
Building the DW - ETL
 
Tech Days09 Sqldev
Tech Days09 SqldevTech Days09 Sqldev
Tech Days09 Sqldev
 
SQL Server 2008 for Developers
SQL Server 2008 for DevelopersSQL Server 2008 for Developers
SQL Server 2008 for Developers
 

Último

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Último (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 

Test Data Transfer Tool

  • 1. TEST DATA TRANSFER TOOL (TDTT) – Hai Nguyen
  • 3. Goals This tool is designed to transfer the data between environments to create test or demo environments with the latest data. It shouldn’t be used to import data into the production environment.
  • 4. Goals (cont) The Test Data Transfer Tool works by calling the Microsoft SQL Server client tools bulk copy program, BCP.exe. BCP runs very quickly, thus this tool runs faster than some other data transfer tools. The Test Data Transfer Tool does not interact with the AOS. You must have a CustomerSource or PartnerSource account to be able to download the Test Data Transfer Tool installer. The installer must be run by an administrator account. As of today, you can download the tool from LCS (Life Cycle Services).
  • 5. Pre-requisites • To be run on a system with SQL Server client tools installed. • During import, you must run the tool directly from the computer that is hosting the database. • Select & Bulk Insert permissions on the SQL database and ALTER INDEX permission on the table (this is needed if the data violates the unique index constraints and you want index to be disabled automatically). • Permission to execute SQL scripts that are executed pre- and post export/import. These can be found in import and export directory.
  • 7. PROS 1. Very lightweight and simple to use tool. 2. Can be installed on any machine that has the SQL Server Client tools installed. 3. Can be handy tool in transferring the data among the different environments (for example data transfer from production to the training environment). 4. This tool can be used to move subset of the data. 5. The tool can be used to import and export any AX entity but I found it more useful while transferring configuration data among the environments. (for example module parameters tables) 6. Fast when compare to other data migration tools for AX. 7. Can export or import data when an AOS instance is not running. 8. Export or import Microsoft Dynamics AX data more quickly compared to other methods. 9. Only minimal changes are made to the data that you import. This feature helps guarantee that the data is stable over time. For example, the tool never renumbers RecIDs.
  • 8. PROS (cont) 10. The data file format is text-based. Therefore, the data can be compared with earlier versions and stored in a version control system. 11. The data file format is a standard format that is produced by bcp. 12. Exported data can be filtered. Therefore, specified tables, columns, or rows can be easily excluded from the export. 13. Differences often occur during development. Because of this feature, data can often be imported without user intervention, even when the table definitions have changed. For example, tables or fields that have been renamed do not prevent import. 14. Entity IDs, such as table IDs, class IDs, and extended data type IDs, are updated to match the IDs of the target system. 15. The tool reads and correctly updates the SYSTEMSEQUENCES table.
  • 9. CONS 1.The usage of this tool requires you to have a SQL related skillset. Since the tool is actually a wrapper on top of SQL Server Bulk Copy Program (bcp) that’s why the expert level knowledge of the AX database schema and T-SQL is a must. 2.Since the tool works directly on SQL Server database that’s why the tool doesn’t make sure that your import produces a complete or coherent database. 3.Need to have access to SQL database and can run as Admin 4.Command line and there is no UI
  • 10. Export and import process illustrated
  • 11. Syntax DP.exe {direction} {directory} {database name} {server}
  • 12. Syntax Parameter Description Default value Direction Parameters indicates the direction (Import/Export) Specify IMPORT for Importing Data and EXPORT for exporting data. EXPORT directory Indicates the directory • from which to import data (or) • To which to export data files Defaults to current directory if not specified database The name of the database: • from which to export data (or) • To which import data in to. AXDB server The name of the sql server on which the database is hosted The current computer name
  • 13. DEMO
  • 14. Q&A

Notas do Editor

  1. Here is the architecture of the tool. The Left side is Export process, The right side is Import process and the middle one is where the output files are created. Export Metadata.xml – A list of table definitions in your AX system. We need to update this file before export. There is a job that shipped with the tool. You need to import the job into AX, run the job, it will update the Metadatafile.xml with all the tables in the AOT. DP.exe processes user input from the command line, a metadata file, and data from the AX 2012 model database , and transfers the information to three files for each table that is being exported: an .out file, an .outModel file, and an.xml file that contains SQL Server metadata Output – .Out file: A bcp data file that contains table data. Columns are separated by #|EOC|# and rows are separated by #|EOR|#\n .Outmodel file: A file that contains metadata that is specific to Microsoft Dynamics AX. This metadata includes all names and IDs of the table and its fields. This file also includes the elementType attribute, which stores the names and IDs of any Microsoft Dynamics AX tables, classes, or extended data types that are referenced by the table. This information is used during import to match up fields that have been renamed. The information is also used to update the table IDs, class IDs, or data type IDs so that those IDs match the IDs in the target database. Data in the .outmodel file is constructed from the Metadata.xml file. This file is generated by an X++ job that you run from Microsoft Dynamics AX on the source database. .xml file: A bcp data file that contains sql metadata (column descriptors) Import Three files that result from the export process are used as input to DP.exe, along with command-line parameters. DP.exe then transfers the data to the AX 2012 database and model database in the test environment. The results of the import process are stored in an .xml file called DPLog.xml
  2. The syntax is very simple. We can break it down to 4 component Direction: IMPORT or EXPORT Directory: If it is EXPORT process, it is the location of the output files that will created. If it is IMPORT process, it is also the same location where output files were created. Normally, Direcotry should be the same for both IMPORT and PROCESS Database name: SQL Server name