SlideShare a Scribd company logo
1 of 45
SQL Server 2019
Master Data Service
Kenichiro Nakamura
Before starting the session…
Big thanks to Peter Myers for great content.
Check out his great contents if you are interested in data.
https://www.youtube.com/results?search_query=
peter+myers+data
Key Takeaways
After taking the session, you can
- explain what’s Master Data Management
- explain what’s Master Data Service of SQL Server 2019
- install, configure and start using MDS for your projects
This session doesn’t cover followings
- Programming to consume master data
- HA/DR/Performance related information
- Migration from prior versions
- Integration Scenario from other system
Agenda
- Overview
- MDS Components
- MDS Model Development
- MDS Management
- MDS Integration
- MDS Administration
Overview
What’s Master Data Management
In business, master data management (MDM) is a method used to
define and manage the critical data of an organization to provide, with
data integration, a single point of reference. The data that is mastered
may include reference data - the set of permissible values, and the
analytical data that supports decision making.
https://en.wikipedia.org/wiki/Master_data_management
What are the challenges to solve?
• Master data in many different systems
• Different versions of data co-exists
• Duplicate data in one or many system across the organization
• Different business rules and validation for same type of data
Inaccurate reporting causes bad decision making via BI
SQL Server Services
Database Engine - Hosting Database
SSAS - Analysis Service
SSIS - Extract, Transform and Load
SSRS - Reporting Engine
ML Services - Machine Learning Services for R and Python
DQS - Data Quality Management
MDS - Master Data Management
https://docs.microsoft.com/en-us/sql/sql-server/sql-server-technical-documentation?view=sql-server-ver15
History
• Since SQL Server 2008 R2
• Improve features in SQL 2012
• Not much change in SQL 2014
• What’s new in SQL 2016
• What’s new in SQL 2017
• SQL Server 2019 - No Silverlight
10+ years product
MDS Components
Master Data Manager
Excel Add-in MDS Repository
MDS Architecture
Browser
Notification
Other system
DQS
Master Data Service Repository
• SQL Server to host MDS repository
• Enterprise Edition/Developer Edition (please check latest info after GA)
• Single Database
• MDS system objects
• User define objects
https://docs.microsoft.com/en-us/sql/master-data-services/install-
windows/create-a-master-data-services-database?view=sql-server-ver15
Master Data Manager (Web App)
• ASP.NET Web Application (no Silverlight since SQL 2019)
• IIS required
• Explorer
• System Administration
• Integration Management
• Version Management
• Excel Add-in
• User/Group management
https://docs.microsoft.com/en-us/sql/master-data-
services/install-windows/create-a-master-data-manager-web-
application-master-data-services?view=sql-server-ver15
Master Data Manager Excel Add-in
• Master data CRUD operation
• Create master list
• Apply Business Rules
• Batch operation
• Offline
• Support connecting to multiple MDS
• Conflict resolution
• Work with DQS
https://docs.microsoft.com/en-us/sql/master-data-services/microsoft-excel-add-
in/overview-exporting-data-to-excel-mds-add-in-for-excel?view=sql-server-ver15
Database Mail Profile
• SQL Server Database Mail Profile
• SMTP server required
https://docs.microsoft.com/en-us/sql/master-data-services/create-database-
mail-profile-and-account-dialog-box?view=sql-server-ver15
Master Data Services Configuration Manage
• MDS Repository Configuration
• Web Configuration
• DQS Integration
MDS Model Development
MDS Development
• MDS objects
• Models
• Entities
• Attributes/Attribute Groups
• Indexes
• Relationship, etc.
• Creating Business Rules
• Changeset
• Manipulate data
Developing Models
• A model has entities (tables)
• An entity has attributes (fields)
• Transaction Log type
• Member – Change logs as history
• None – No change logging
• Compression
• Approval
• Code and name required attributes
• Code : Unique value
• Name : Description of the member
Model
Entities
Attributes
https://docs.microsoft.com/en-us/sql/master-data-
services/models-master-data-services?view=sql-server-ver15
https://docs.microsoft.com/en-us/sql/master-data-
services/entities-master-data-services?view=sql-server-ver15
Attribute
• Free-form
• Text, Numbers, Dates or Links
• File
• File, document, images
• Domain Based Attribute
• Specific set of values (Lookup)
• Filter for hierarchy
https://docs.microsoft.com/en-us/sql/master-data-
services/attributes-master-data-services?view=sql-server-ver15
Indexes
• Auto index creation for Code attribute
• Unique Index
• Non-unique indexes
• Non-clustered Index at SQL level
https://docs.microsoft.com/en-us/sql/master-data-
services/custom-index-master-data-services?view=sql-server-ver15
Hierarchy
• Explicit Hierarchies (Same Entity)
• Mandatory Explicit Hierarchy
• Non-Mandatory Explicit Hierarchy
• Derived Hierarchies (Different Entity)
• 1:N
• N:N
https://docs.microsoft.com/en-us/sql/master-data-
services/hierarchies-master-data-services?view=sql-server-ver15
Creating Business Rules
• Enforce business logic to member
• Multiple business rules per attribute
• Variety of options
• Order matters
• Notification
• Custom Business Rule (extension)
• User defined function for condition in usr schema
• Stored procedure for action in usr schema
https://docs.microsoft.com/en-us/sql/master-data-services/business-rules-
master-data-services?view=sql-server-ver15
Custom Business Rules
User defined function
• Return BIT (1:true 0:false)
• Take 1 input - NVarchar, Datetime2, Decimal (38/0-7)
Stored procedure
• Table input parameter: @MemberIdList
• NVarchar input parameters: @ModelName, @VersionName,
@EntityName, @BusinessRuleName
https://docs.microsoft.com/en-us/sql/master-data-services/business-rules-
extension-master-data-services?view=sql-server-ver15
Demo
MDS Management
Explorer
• Entities
• CRUD member, Filter, Apply rules, Export to excel, history
• Entity Dependencies
• Hierarchies
• Collections
• Changesets
https://docs.microsoft.com/en-us/sql/master-data-services/explorer-
functional-area-master-data-manager?view=sql-server-ver15
Changeset
• Approval Required
• Entity level settings
• Entity Admin can approve/reject
• Local user change
• Stage for change
• Commit to reflect change
Versioning
• Open
• Anyone can edit
• Lock
• Only admin can edit
• Validate
• Run validation
• Commit
• Cannot change anymore
• Copy
• Create new version
Entity Sync
Synchronize data from source to target in different models
• Sync Job as SQL Agent job
• One time
• On-demand
• Schedule
• Target limitation
• Target model needs to be open status
• Target entity will be locked
• No business rule
• Domain base attribute will be skipped
Excel Add-in
• Most features are same as Data Management Web
• Query
• Merge Conflict
• Settings
• Combine Data & Data Quality
https://docs.microsoft.com/en-us/sql/master-data-services/microsoft-excel-add-
in/overview-exporting-data-to-excel-mds-add-in-for-excel?view=sql-server-ver15
Demo
MDS Integration
Create View
• Subscription View
• mdm schema
• Version Option
• Data Source
• Format
• Leaf
• History
• SCD Type 2
• Vertical and horizontal filters
• Use created view to consume data
Staging table
• Staging table for each entity
• stg schema
• Import Type
• 1: Create new members
2: Create new members. Replace existing MDS data with staged data.
3: Deactivate the member, based on the Code value.
4: Permanently delete the member, based on the Code value.
• Staging Stored Procedure
• stg.udp_<name>_Leaf
• stg.udp_<name>_Consolidated
• stg.udp_<name>_Relationship
https://docs.microsoft.com/en-us/sql/master-data-services/staging-
stored-procedure-master-data-services?view=sql-server-ver15
Demo
MDS Deployment
Model Deployment
• Master Data Manager
• Package Model without data
• Deploy Model without data
• MDSModelDeploy
• Package Model with/without data
• Deploy Model with/without data
• ModelPackageEditor
• Edit package
MDS Administration
Configuring MDS
• Master Data Configuration Manager
• MDS Repositories
• MDS Management portal
• DQS integration
Securing MDS
• AD or local user
• AD or local group
• Role base security
• Permissions
• Grant permission
• Deny permission
• Granular settings
• Model level
• Entity level
• Attribute level
• Member level
System Admin
MDS Admin
Model Admin
Data Admin
Consumer
References
References
edX : Creating a Master Data Solution with SQL Server Master Data
Services (MDS) * SQL Server 2016
https://courses.edx.org/courses/course-v1:Microsoft+DAT226x+3T2018
Microsoft Ignite New Zealand 2015 End to End SQL Server Master Data
Services * SQL Server 2012
https://www.youtube.com/watch?v=ghChzpt_-FY&t=2862s
References
Official Document
https://docs.microsoft.com/en-us/sql/master-data-services/master-data-
services-overview-mds?view=sql-server-ver15
Fin.

More Related Content

What's hot

Master Data Services - 2016 - Huntington Beach
Master Data Services - 2016 - Huntington BeachMaster Data Services - 2016 - Huntington Beach
Master Data Services - 2016 - Huntington Beach
Jeff Prom
 
Enabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationEnabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data Virtualization
Denodo
 
‏‏‏‏Chapter 9: Data Warehousing and Business Intelligence Management
‏‏‏‏Chapter 9: Data Warehousing and Business Intelligence Management‏‏‏‏Chapter 9: Data Warehousing and Business Intelligence Management
‏‏‏‏Chapter 9: Data Warehousing and Business Intelligence Management
Ahmed Alorage
 
Data Architecture for Data Governance
Data Architecture for Data GovernanceData Architecture for Data Governance
Data Architecture for Data Governance
DATAVERSITY
 
Data Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshData Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to Mesh
Jeffrey T. Pollock
 

What's hot (20)

Building a modern data warehouse
Building a modern data warehouseBuilding a modern data warehouse
Building a modern data warehouse
 
Master Data Services - 2016 - Huntington Beach
Master Data Services - 2016 - Huntington BeachMaster Data Services - 2016 - Huntington Beach
Master Data Services - 2016 - Huntington Beach
 
Differentiate Big Data vs Data Warehouse use cases for a cloud solution
Differentiate Big Data vs Data Warehouse use cases for a cloud solutionDifferentiate Big Data vs Data Warehouse use cases for a cloud solution
Differentiate Big Data vs Data Warehouse use cases for a cloud solution
 
Building the Data Lake with Azure Data Factory and Data Lake Analytics
Building the Data Lake with Azure Data Factory and Data Lake AnalyticsBuilding the Data Lake with Azure Data Factory and Data Lake Analytics
Building the Data Lake with Azure Data Factory and Data Lake Analytics
 
Data Warehousing Trends, Best Practices, and Future Outlook
Data Warehousing Trends, Best Practices, and Future OutlookData Warehousing Trends, Best Practices, and Future Outlook
Data Warehousing Trends, Best Practices, and Future Outlook
 
Enabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationEnabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data Virtualization
 
Ebook - The Guide to Master Data Management
Ebook - The Guide to Master Data Management Ebook - The Guide to Master Data Management
Ebook - The Guide to Master Data Management
 
Five Things to Consider About Data Mesh and Data Governance
Five Things to Consider About Data Mesh and Data GovernanceFive Things to Consider About Data Mesh and Data Governance
Five Things to Consider About Data Mesh and Data Governance
 
Requirements for a Master Data Management (MDM) Solution - Presentation
Requirements for a Master Data Management (MDM) Solution - PresentationRequirements for a Master Data Management (MDM) Solution - Presentation
Requirements for a Master Data Management (MDM) Solution - Presentation
 
‏‏‏‏Chapter 9: Data Warehousing and Business Intelligence Management
‏‏‏‏Chapter 9: Data Warehousing and Business Intelligence Management‏‏‏‏Chapter 9: Data Warehousing and Business Intelligence Management
‏‏‏‏Chapter 9: Data Warehousing and Business Intelligence Management
 
Data Warehousing in the Cloud: Practical Migration Strategies
Data Warehousing in the Cloud: Practical Migration Strategies Data Warehousing in the Cloud: Practical Migration Strategies
Data Warehousing in the Cloud: Practical Migration Strategies
 
Should I move my database to the cloud?
Should I move my database to the cloud?Should I move my database to the cloud?
Should I move my database to the cloud?
 
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...
DMBOK 2.0 and other frameworks including TOGAF & COBIT - keynote from DAMA Au...
 
Master Data Management
Master Data ManagementMaster Data Management
Master Data Management
 
Building Modern Data Platform with Microsoft Azure
Building Modern Data Platform with Microsoft AzureBuilding Modern Data Platform with Microsoft Azure
Building Modern Data Platform with Microsoft Azure
 
Azure Data Factory V2; The Data Flows
Azure Data Factory V2; The Data FlowsAzure Data Factory V2; The Data Flows
Azure Data Factory V2; The Data Flows
 
Data Architecture for Data Governance
Data Architecture for Data GovernanceData Architecture for Data Governance
Data Architecture for Data Governance
 
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...
 
Data Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshData Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to Mesh
 
ExpertsLive NL 2022 - Microsoft Purview - What's in it for my organization?
ExpertsLive NL 2022 - Microsoft Purview - What's in it for my organization?ExpertsLive NL 2022 - Microsoft Purview - What's in it for my organization?
ExpertsLive NL 2022 - Microsoft Purview - What's in it for my organization?
 

Similar to SQL Server 2019 Master Data Service

24 HOP edición Español -Diferentes técnicas de administración de logins y usu...
24 HOP edición Español -Diferentes técnicas de administración de logins y usu...24 HOP edición Español -Diferentes técnicas de administración de logins y usu...
24 HOP edición Español -Diferentes técnicas de administración de logins y usu...
SpanishPASSVC
 
SQL Server Workshop for Developers - Visual Studio Live! NY 2012
SQL Server Workshop for Developers - Visual Studio Live! NY 2012SQL Server Workshop for Developers - Visual Studio Live! NY 2012
SQL Server Workshop for Developers - Visual Studio Live! NY 2012
Andrew Brust
 

Similar to SQL Server 2019 Master Data Service (20)

New features of sql server 2016 bi features
New features of sql server 2016 bi featuresNew features of sql server 2016 bi features
New features of sql server 2016 bi features
 
24 Hours of PASS -- Enterprise Data Mining with SQL Server
24 Hours of PASS -- Enterprise Data Mining with SQL Server24 Hours of PASS -- Enterprise Data Mining with SQL Server
24 Hours of PASS -- Enterprise Data Mining with SQL Server
 
DQS & MDS in SQL Server 2016
DQS & MDS in SQL Server 2016DQS & MDS in SQL Server 2016
DQS & MDS in SQL Server 2016
 
Introduction to Master Data Services in SQL Server 2012
Introduction to Master Data Services in SQL Server 2012Introduction to Master Data Services in SQL Server 2012
Introduction to Master Data Services in SQL Server 2012
 
Sql server master data services
Sql server master data servicesSql server master data services
Sql server master data services
 
24 HOP edición Español -Diferentes técnicas de administración de logins y usu...
24 HOP edición Español -Diferentes técnicas de administración de logins y usu...24 HOP edición Español -Diferentes técnicas de administración de logins y usu...
24 HOP edición Español -Diferentes técnicas de administración de logins y usu...
 
Hybrid Analytics in Healthcare: Leveraging Power BI and Office 365 to Make Sm...
Hybrid Analytics in Healthcare: Leveraging Power BI and Office 365 to Make Sm...Hybrid Analytics in Healthcare: Leveraging Power BI and Office 365 to Make Sm...
Hybrid Analytics in Healthcare: Leveraging Power BI and Office 365 to Make Sm...
 
SQL Server 2019 Big Data Cluster
SQL Server 2019 Big Data ClusterSQL Server 2019 Big Data Cluster
SQL Server 2019 Big Data Cluster
 
SQL Server 2016 BI updates
SQL Server 2016 BI updatesSQL Server 2016 BI updates
SQL Server 2016 BI updates
 
Practical SharePoint 2013 Development Environment
Practical SharePoint 2013  Development EnvironmentPractical SharePoint 2013  Development Environment
Practical SharePoint 2013 Development Environment
 
SSAS, MDX , Cube understanding, Browsing and Tools information
SSAS, MDX , Cube understanding, Browsing and Tools information SSAS, MDX , Cube understanding, Browsing and Tools information
SSAS, MDX , Cube understanding, Browsing and Tools information
 
SQL Server Workshop for Developers - Visual Studio Live! NY 2012
SQL Server Workshop for Developers - Visual Studio Live! NY 2012SQL Server Workshop for Developers - Visual Studio Live! NY 2012
SQL Server Workshop for Developers - Visual Studio Live! NY 2012
 
Real-world BISM in SQL Server 2012 SSAS
Real-world BISM in SQL Server 2012 SSASReal-world BISM in SQL Server 2012 SSAS
Real-world BISM in SQL Server 2012 SSAS
 
M|18 Analytics as a Service
M|18 Analytics as a ServiceM|18 Analytics as a Service
M|18 Analytics as a Service
 
Informatica mdm online training in chennai
Informatica mdm online training in chennaiInformatica mdm online training in chennai
Informatica mdm online training in chennai
 
SQLSaturday 664 - Troubleshoot SQL Server performance problems like a Microso...
SQLSaturday 664 - Troubleshoot SQL Server performance problems like a Microso...SQLSaturday 664 - Troubleshoot SQL Server performance problems like a Microso...
SQLSaturday 664 - Troubleshoot SQL Server performance problems like a Microso...
 
Building your first Analysis Services Tabular BI Semantic model with SQL Serv...
Building your first Analysis Services Tabular BI Semantic model with SQL Serv...Building your first Analysis Services Tabular BI Semantic model with SQL Serv...
Building your first Analysis Services Tabular BI Semantic model with SQL Serv...
 
Data mining tools for excel and sql server
Data mining tools for excel and sql serverData mining tools for excel and sql server
Data mining tools for excel and sql server
 
SPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDSSPS Vancouver 2018 - What is CDM and CDS
SPS Vancouver 2018 - What is CDM and CDS
 
Pysyvästi laadukasta masterdataa SmartMDM:n avulla
Pysyvästi laadukasta masterdataa SmartMDM:n avullaPysyvästi laadukasta masterdataa SmartMDM:n avulla
Pysyvästi laadukasta masterdataa SmartMDM:n avulla
 

More from Kenichiro Nakamura

LT: 開発者が意識するべき チャットボットの UX と アーキテクチャ
LT: 開発者が意識するべきチャットボットの UX とアーキテクチャLT: 開発者が意識するべきチャットボットの UX とアーキテクチャ
LT: 開発者が意識するべき チャットボットの UX と アーキテクチャ
Kenichiro Nakamura
 

More from Kenichiro Nakamura (20)

JSSUG Azure SQL Analytics
JSSUG Azure SQL AnalyticsJSSUG Azure SQL Analytics
JSSUG Azure SQL Analytics
 
LINE Developer Day 2019 how to optimize bot development lifecycle with dev ops
LINE Developer Day 2019 how to optimize bot development lifecycle with dev opsLINE Developer Day 2019 how to optimize bot development lifecycle with dev ops
LINE Developer Day 2019 how to optimize bot development lifecycle with dev ops
 
MTDDC 2019 LINE ボットからみた MT Data API の可能性
MTDDC 2019 LINE ボットからみた MT Data API の可能性MTDDC 2019 LINE ボットからみた MT Data API の可能性
MTDDC 2019 LINE ボットからみた MT Data API の可能性
 
Tokyo Azure Meetup #29 AKS
Tokyo Azure Meetup #29 AKSTokyo Azure Meetup #29 AKS
Tokyo Azure Meetup #29 AKS
 
TypeScript Meetup #1 Build 2019 update
TypeScript Meetup #1 Build 2019 updateTypeScript Meetup #1 Build 2019 update
TypeScript Meetup #1 Build 2019 update
 
ボット開発でも DevOps! BotBuilder のテスト手法
ボット開発でも DevOps! BotBuilder のテスト手法ボット開発でも DevOps! BotBuilder のテスト手法
ボット開発でも DevOps! BotBuilder のテスト手法
 
.NET ラボ 勉強会 C# でラインプラットフォーム開発
.NET ラボ 勉強会 C# でラインプラットフォーム開発.NET ラボ 勉強会 C# でラインプラットフォーム開発
.NET ラボ 勉強会 C# でラインプラットフォーム開発
 
Microsoft Azure Cognitive Services
Microsoft Azure Cognitive ServicesMicrosoft Azure Cognitive Services
Microsoft Azure Cognitive Services
 
EdgeAI: Azure IoT Edge カスタムモジュール開発
EdgeAI: Azure IoT Edge カスタムモジュール開発EdgeAI: Azure IoT Edge カスタムモジュール開発
EdgeAI: Azure IoT Edge カスタムモジュール開発
 
エッジ・組み込みAI勉強会 : コンテナで使う Cognitive Service
エッジ・組み込みAI勉強会 : コンテナで使う Cognitive Serviceエッジ・組み込みAI勉強会 : コンテナで使う Cognitive Service
エッジ・組み込みAI勉強会 : コンテナで使う Cognitive Service
 
いま考えられる限り最も速く対話型アプリを開発する方法
いま考えられる限り最も速く対話型アプリを開発する方法いま考えられる限り最も速く対話型アプリを開発する方法
いま考えられる限り最も速く対話型アプリを開発する方法
 
Azure for hackathon
Azure for hackathonAzure for hackathon
Azure for hackathon
 
Extended Events 101 : Japan SQL Server User Group
Extended Events 101 : Japan SQL Server User GroupExtended Events 101 : Japan SQL Server User Group
Extended Events 101 : Japan SQL Server User Group
 
Tech-on Meet Up #02 Microsoft のコンテナ活用事例
Tech-on Meet Up #02 Microsoft のコンテナ活用事例Tech-on Meet Up #02 Microsoft のコンテナ活用事例
Tech-on Meet Up #02 Microsoft のコンテナ活用事例
 
JSSUG: SQL Sever Index Tuning
JSSUG: SQL Sever Index TuningJSSUG: SQL Sever Index Tuning
JSSUG: SQL Sever Index Tuning
 
JSSUG: SQL Sever Performance Tuning
JSSUG: SQL Sever Performance TuningJSSUG: SQL Sever Performance Tuning
JSSUG: SQL Sever Performance Tuning
 
LT: 開発者が意識するべき チャットボットの UX と アーキテクチャ
LT: 開発者が意識するべきチャットボットの UX とアーキテクチャLT: 開発者が意識するべきチャットボットの UX とアーキテクチャ
LT: 開発者が意識するべき チャットボットの UX と アーキテクチャ
 
今更聞けない!?Microsoft Graph で始める Office 365 データ活用と事例の紹介
今更聞けない!?Microsoft Graph で始める Office 365 データ活用と事例の紹介今更聞けない!?Microsoft Graph で始める Office 365 データ活用と事例の紹介
今更聞けない!?Microsoft Graph で始める Office 365 データ活用と事例の紹介
 
LINE Bot リッチメニュー使ってる?
LINE Bot リッチメニュー使ってる?LINE Bot リッチメニュー使ってる?
LINE Bot リッチメニュー使ってる?
 
Line Bot with C#
Line Bot with C#Line Bot with C#
Line Bot with C#
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Recently uploaded (20)

Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 

SQL Server 2019 Master Data Service

  • 1. SQL Server 2019 Master Data Service Kenichiro Nakamura
  • 2. Before starting the session… Big thanks to Peter Myers for great content. Check out his great contents if you are interested in data. https://www.youtube.com/results?search_query= peter+myers+data
  • 3. Key Takeaways After taking the session, you can - explain what’s Master Data Management - explain what’s Master Data Service of SQL Server 2019 - install, configure and start using MDS for your projects This session doesn’t cover followings - Programming to consume master data - HA/DR/Performance related information - Migration from prior versions - Integration Scenario from other system
  • 4. Agenda - Overview - MDS Components - MDS Model Development - MDS Management - MDS Integration - MDS Administration
  • 6. What’s Master Data Management In business, master data management (MDM) is a method used to define and manage the critical data of an organization to provide, with data integration, a single point of reference. The data that is mastered may include reference data - the set of permissible values, and the analytical data that supports decision making. https://en.wikipedia.org/wiki/Master_data_management
  • 7. What are the challenges to solve? • Master data in many different systems • Different versions of data co-exists • Duplicate data in one or many system across the organization • Different business rules and validation for same type of data Inaccurate reporting causes bad decision making via BI
  • 8. SQL Server Services Database Engine - Hosting Database SSAS - Analysis Service SSIS - Extract, Transform and Load SSRS - Reporting Engine ML Services - Machine Learning Services for R and Python DQS - Data Quality Management MDS - Master Data Management https://docs.microsoft.com/en-us/sql/sql-server/sql-server-technical-documentation?view=sql-server-ver15
  • 9. History • Since SQL Server 2008 R2 • Improve features in SQL 2012 • Not much change in SQL 2014 • What’s new in SQL 2016 • What’s new in SQL 2017 • SQL Server 2019 - No Silverlight 10+ years product
  • 11. Master Data Manager Excel Add-in MDS Repository MDS Architecture Browser Notification Other system DQS
  • 12. Master Data Service Repository • SQL Server to host MDS repository • Enterprise Edition/Developer Edition (please check latest info after GA) • Single Database • MDS system objects • User define objects https://docs.microsoft.com/en-us/sql/master-data-services/install- windows/create-a-master-data-services-database?view=sql-server-ver15
  • 13. Master Data Manager (Web App) • ASP.NET Web Application (no Silverlight since SQL 2019) • IIS required • Explorer • System Administration • Integration Management • Version Management • Excel Add-in • User/Group management https://docs.microsoft.com/en-us/sql/master-data- services/install-windows/create-a-master-data-manager-web- application-master-data-services?view=sql-server-ver15
  • 14. Master Data Manager Excel Add-in • Master data CRUD operation • Create master list • Apply Business Rules • Batch operation • Offline • Support connecting to multiple MDS • Conflict resolution • Work with DQS https://docs.microsoft.com/en-us/sql/master-data-services/microsoft-excel-add- in/overview-exporting-data-to-excel-mds-add-in-for-excel?view=sql-server-ver15
  • 15. Database Mail Profile • SQL Server Database Mail Profile • SMTP server required https://docs.microsoft.com/en-us/sql/master-data-services/create-database- mail-profile-and-account-dialog-box?view=sql-server-ver15
  • 16. Master Data Services Configuration Manage • MDS Repository Configuration • Web Configuration • DQS Integration
  • 18. MDS Development • MDS objects • Models • Entities • Attributes/Attribute Groups • Indexes • Relationship, etc. • Creating Business Rules • Changeset • Manipulate data
  • 19. Developing Models • A model has entities (tables) • An entity has attributes (fields) • Transaction Log type • Member – Change logs as history • None – No change logging • Compression • Approval • Code and name required attributes • Code : Unique value • Name : Description of the member Model Entities Attributes https://docs.microsoft.com/en-us/sql/master-data- services/models-master-data-services?view=sql-server-ver15 https://docs.microsoft.com/en-us/sql/master-data- services/entities-master-data-services?view=sql-server-ver15
  • 20. Attribute • Free-form • Text, Numbers, Dates or Links • File • File, document, images • Domain Based Attribute • Specific set of values (Lookup) • Filter for hierarchy https://docs.microsoft.com/en-us/sql/master-data- services/attributes-master-data-services?view=sql-server-ver15
  • 21. Indexes • Auto index creation for Code attribute • Unique Index • Non-unique indexes • Non-clustered Index at SQL level https://docs.microsoft.com/en-us/sql/master-data- services/custom-index-master-data-services?view=sql-server-ver15
  • 22. Hierarchy • Explicit Hierarchies (Same Entity) • Mandatory Explicit Hierarchy • Non-Mandatory Explicit Hierarchy • Derived Hierarchies (Different Entity) • 1:N • N:N https://docs.microsoft.com/en-us/sql/master-data- services/hierarchies-master-data-services?view=sql-server-ver15
  • 23. Creating Business Rules • Enforce business logic to member • Multiple business rules per attribute • Variety of options • Order matters • Notification • Custom Business Rule (extension) • User defined function for condition in usr schema • Stored procedure for action in usr schema https://docs.microsoft.com/en-us/sql/master-data-services/business-rules- master-data-services?view=sql-server-ver15
  • 24. Custom Business Rules User defined function • Return BIT (1:true 0:false) • Take 1 input - NVarchar, Datetime2, Decimal (38/0-7) Stored procedure • Table input parameter: @MemberIdList • NVarchar input parameters: @ModelName, @VersionName, @EntityName, @BusinessRuleName https://docs.microsoft.com/en-us/sql/master-data-services/business-rules- extension-master-data-services?view=sql-server-ver15
  • 25. Demo
  • 27. Explorer • Entities • CRUD member, Filter, Apply rules, Export to excel, history • Entity Dependencies • Hierarchies • Collections • Changesets https://docs.microsoft.com/en-us/sql/master-data-services/explorer- functional-area-master-data-manager?view=sql-server-ver15
  • 28. Changeset • Approval Required • Entity level settings • Entity Admin can approve/reject • Local user change • Stage for change • Commit to reflect change
  • 29. Versioning • Open • Anyone can edit • Lock • Only admin can edit • Validate • Run validation • Commit • Cannot change anymore • Copy • Create new version
  • 30. Entity Sync Synchronize data from source to target in different models • Sync Job as SQL Agent job • One time • On-demand • Schedule • Target limitation • Target model needs to be open status • Target entity will be locked • No business rule • Domain base attribute will be skipped
  • 31. Excel Add-in • Most features are same as Data Management Web • Query • Merge Conflict • Settings • Combine Data & Data Quality https://docs.microsoft.com/en-us/sql/master-data-services/microsoft-excel-add- in/overview-exporting-data-to-excel-mds-add-in-for-excel?view=sql-server-ver15
  • 32. Demo
  • 34. Create View • Subscription View • mdm schema • Version Option • Data Source • Format • Leaf • History • SCD Type 2 • Vertical and horizontal filters • Use created view to consume data
  • 35. Staging table • Staging table for each entity • stg schema • Import Type • 1: Create new members 2: Create new members. Replace existing MDS data with staged data. 3: Deactivate the member, based on the Code value. 4: Permanently delete the member, based on the Code value. • Staging Stored Procedure • stg.udp_<name>_Leaf • stg.udp_<name>_Consolidated • stg.udp_<name>_Relationship https://docs.microsoft.com/en-us/sql/master-data-services/staging- stored-procedure-master-data-services?view=sql-server-ver15
  • 36. Demo
  • 38. Model Deployment • Master Data Manager • Package Model without data • Deploy Model without data • MDSModelDeploy • Package Model with/without data • Deploy Model with/without data • ModelPackageEditor • Edit package
  • 40. Configuring MDS • Master Data Configuration Manager • MDS Repositories • MDS Management portal • DQS integration
  • 41. Securing MDS • AD or local user • AD or local group • Role base security • Permissions • Grant permission • Deny permission • Granular settings • Model level • Entity level • Attribute level • Member level System Admin MDS Admin Model Admin Data Admin Consumer
  • 43. References edX : Creating a Master Data Solution with SQL Server Master Data Services (MDS) * SQL Server 2016 https://courses.edx.org/courses/course-v1:Microsoft+DAT226x+3T2018 Microsoft Ignite New Zealand 2015 End to End SQL Server Master Data Services * SQL Server 2012 https://www.youtube.com/watch?v=ghChzpt_-FY&t=2862s
  • 45. Fin.