SlideShare uma empresa Scribd logo
1 de 29
Generating XML Schemas from a canonical model - a practical example George McGeachie Metadata Matters Limited Enterprise Data World Chicago April 5th, 2010
The ‘C’ word Managing XSDs using a master (canonical) XML schema The flexibility of PowerDesigner The XML Schema Model in PowerDesigner Which Canonical Model Should You Use? Factors To Be Considered Generating XML Models in Power Designer Enterprise Data World, Chicago, April 5th 2011 2
About Me I’ve been involved with modelling and managing data and metadata for longer than I care to remember. When I first came across XML Schemas, I was struck by their simplicity and versatility. When I saw how some people use them, I realised that the days of unmanaged COBOL copybooks had returned to haunt me. This is my attempt to exorcise the XML demon. Enterprise Data World, Chicago, April 5th 2011 3
The ‘C’ word It’s difficult to avoid the word ‘Canonical’ when discussing standard XML messages To some, the message schemas are the ‘canonical’ To others, the underlying model is the ‘canonical’ When I use the word, I mean both of them Enterprise Data World, Chicago, April 5th 2011 4
Managing XSDs using a master (canonical) XML schema An XML master schema must be hierarchical It cannot easily show all the complex relationships between the data concepts It cannot be flexible enough to support multiple views of the data You need to understand XML to create, edit or read the model Enterprise Data World, Chicago, April 5th 2011 5
Managing XSDs using a master (canonical) XML schema How would we integrate the metadata represented by a schema with our other metadata? Reverse-engineer it into a repository or modelling tool? How would we Ensure consistency of XSDs with each other? Enable impact analysis? Manage the variations necessary between dependent schemas? Enterprise Data World, Chicago, April 5th 2011 6
The flexibility of PowerDesigner Enterprise Data World, Chicago, April 5th 2011 7 PowerDesigner has a dedicated XML Schema Model Several different approaches supported out of the box Generating XSDs from a class model Generating an XML Schema model from a class model or a physical data model, then generating XSDs Reverse-engineering existing XML Schemas into a class model or XML Schema Model Can then generate a logical or conceptual view
Generation options in PowerDesigner Enterprise Data World, Chicago, April 5th 2011 8
The XML Schema Model in PowerDesigner Enterprise Data World, Chicago, April 5th 2011 9 This can link to an XML model, or an XSD Referenced Elements (in another XSD) Complex Type Note the XML-specific object types
XML-specific Model Objects 10 Enterprise Data World, Chicago, April 5th 2011 Here’s the detail of one of the sequences in the schema Filter the displayed properties Add additional items to the sequence
The XML Model Dedicated to modelling XML Schema 1 schema per XML model, traceable to source models Mapping Editor – drag and drop mappings between models Supports XSD, XDR and DTD Multiple Namespaces supported Can use 1 XML model for multiple schemas in the same target namespace Enterprise Data World, Chicago, April 5th 2011 11
The flexibility of PowerDesigner Linkages are automatically maintained between models as you generate them Additional mappings can be added between any two models The generation process can be customised You have control over the naming standards and data types used in each model Impact and Lineage analysis is enabled by the generation and mapping links Enterprise Data World, Chicago, April 5th 2011 12
Generation Links For each model, you can trace links to other models in the generation sequence Enterprise Data World, Chicago, April 5th 2011 13
Mapping Editor Visually check mappings Enterprise Data World, Chicago, April 5th 2011 14
Impact of deleting XML Attribute - diagram Enterprise Data World, Chicago, April 5th 2011 15 Dependencies between PDM tables PDM Tables mapped to the Element Our attribute XML Element Simple Type (no longer required) Remember:  this diagram traces back to the model the XML attribute was generated from; in this case, the XML model was generated from a PDM, so the impact analysis traces to the PDM
Visible Links Between Models Using the ‘project’ feature, we can see the links between models We can also include external objects, and create our own links to them An XSD and an HTML file in this case Enterprise Data World, Chicago, April 5th 2011 16
Which canonical model? One (or more) that you can sell within your organisation Standard models Standard Universal Data Models e.g. IBM, Teradata, Oracle, EWS Solutions, Len Silverston’s Universal Data Models Industry Universal Data Models e.g. standard messaging structures, such as from the OAG See www.industrydatamodels.com  Some organisations use several of these, which will need to be cross-referenced Your own model(s) possibly used to extend one of the above Enterprise Data World, Chicago, April 5th 2011 17
A simple example of a relational canonical model Enterprise Data World, Chicago, April 5th 2011 18 This is an amended version of the ‘Project Management’ PDM supplied with PowerDesigner
The ‘Team Members’ schema Enterprise Data World, Chicago, April 5th 2011 19
The ‘Project’ schema Enterprise Data World, Chicago, April 5th 2011 20
Factors To Be Considered Generating a Type Library vs. generating Schemas Physical Design Challenges Model Management Challenges 21 Enterprise Data World, Chicago, April 5th 2011
Generating a type library often straightforward to generate no structure manual control of re-use in schemas "let the service people design the schemas" no impact analysis across schemas may be the only acceptable first step low impact on work patterns gains initial acceptance of the role of a canonical model Enterprise Data World, Chicago, April 5th 2011 22
Generating Individual Schemas A 'container' for each schema Model, Submodel, Subject Area, Package etc defines scope provides documentation facilitates governance Complete generation Nothing changed post-generation Requires high degree of control over generation process Enterprise Data World, Chicago, April 5th 2011 23
Generating Individual Schemas all types can be local no need to 'include' or 'import' a base schema the 'standard' types are used to generate the schema, rather than being referred to by the schema The standard types are in the canonical data model potential for impact analysis can choose when to update each individual schema Enterprise Data World, Chicago, April 5th 2011 24
Sample Message Schema This was generated from the same data model as the type library; it only contains what the message actually needs Enterprise Data World, Chicago, April 5th 2011 25
Physical Design Challenges Some of these challenges are similar to those we face when we use a single Logical Data Model for designing multiple database schemas Differences between Schemas Handling Sub-types and inherited attributes Denormalising attributes and entities Data Type and Name conversions Scalability of Process  Automating & future-proofing the generation process Enterprise Data World, Chicago, April 5th 2011 26
Model Management Challenges Multiple reference models require careful consideration E.g. Using OAG messaging standard as a reference model, extending it where required Provides a quick-start for defining schemas Be careful what you remove; perhaps remove nothing How do you identify the parts that are actually in use? How do you know what extensions are needed? Have to map the standard to your own models Enterprise Data World, Chicago, April 5th 2011 27
Generating XML Models in PowerDesigner Two options Generate XML Model using default options, from selected tables, and tinker the XML afterwards Use XML Builder to design and generate almost exactly what is required, and then tinker the XML model 28 Enterprise Data World, Chicago, April 5th 2011
Contact Me Telephone: +44 (0) 20 8123 8756 (forwarded to mobile) UK mobile: +44 (0) 794 293 0648 Skype: gmcgeachie Twitter: metadatajunkie Email:  George.McGeachie @ MetadataMatters.com Blog: http://metadatajunkie.wordpress.com/ Enterprise Data World, Chicago, April 5th 2011 29

Mais conteúdo relacionado

Semelhante a Generating XML schemas from a Logical Data Model (EDW 2011)

BI Publisher Data model design document
BI Publisher Data model design documentBI Publisher Data model design document
BI Publisher Data model design documentadivasoft
 
BI Publisher 11g : Data Model Design document
BI Publisher 11g : Data Model Design documentBI Publisher 11g : Data Model Design document
BI Publisher 11g : Data Model Design documentadivasoft
 
AutoML - Heralding a New Era of Machine Learning - CASOUG Oct 2021
AutoML - Heralding a New Era of Machine Learning - CASOUG Oct 2021AutoML - Heralding a New Era of Machine Learning - CASOUG Oct 2021
AutoML - Heralding a New Era of Machine Learning - CASOUG Oct 2021Sandesh Rao
 
An introduction to the MDA
An introduction to the MDAAn introduction to the MDA
An introduction to the MDALai Ha
 
1-SDLC - Development Models – Waterfall, Rapid Application Development, Agile...
1-SDLC - Development Models – Waterfall, Rapid Application Development, Agile...1-SDLC - Development Models – Waterfall, Rapid Application Development, Agile...
1-SDLC - Development Models – Waterfall, Rapid Application Development, Agile...JOHNLEAK1
 
Model versioning in context of living
Model versioning in context of livingModel versioning in context of living
Model versioning in context of livingijseajournal
 
Simulating Enterprise Architecture Models
Simulating Enterprise Architecture Models Simulating Enterprise Architecture Models
Simulating Enterprise Architecture Models balbirbarn
 
Object Oriented Database
Object Oriented DatabaseObject Oriented Database
Object Oriented DatabaseMegan Espinoza
 
Learn Entity Framework in a day with Code First, Model First and Database First
Learn Entity Framework in a day with Code First, Model First and Database FirstLearn Entity Framework in a day with Code First, Model First and Database First
Learn Entity Framework in a day with Code First, Model First and Database FirstJibran Rasheed Khan
 
4) databases
4) databases4) databases
4) databasestechbed
 
Financial Industry Business Unified Model (FIBUM)
Financial Industry Business Unified Model (FIBUM)Financial Industry Business Unified Model (FIBUM)
Financial Industry Business Unified Model (FIBUM)Jurgen Ziemer
 
Data modeling star schema
Data modeling star schemaData modeling star schema
Data modeling star schemaSayed Ahmed
 
Be a database professional
Be a database professionalBe a database professional
Be a database professionalSayed Ahmed
 
Be a database professional
Be a database professionalBe a database professional
Be a database professionalSayed Ahmed
 

Semelhante a Generating XML schemas from a Logical Data Model (EDW 2011) (20)

BI Publisher Data model design document
BI Publisher Data model design documentBI Publisher Data model design document
BI Publisher Data model design document
 
BI Publisher 11g : Data Model Design document
BI Publisher 11g : Data Model Design documentBI Publisher 11g : Data Model Design document
BI Publisher 11g : Data Model Design document
 
AutoML - Heralding a New Era of Machine Learning - CASOUG Oct 2021
AutoML - Heralding a New Era of Machine Learning - CASOUG Oct 2021AutoML - Heralding a New Era of Machine Learning - CASOUG Oct 2021
AutoML - Heralding a New Era of Machine Learning - CASOUG Oct 2021
 
An introduction to the MDA
An introduction to the MDAAn introduction to the MDA
An introduction to the MDA
 
1-SDLC - Development Models – Waterfall, Rapid Application Development, Agile...
1-SDLC - Development Models – Waterfall, Rapid Application Development, Agile...1-SDLC - Development Models – Waterfall, Rapid Application Development, Agile...
1-SDLC - Development Models – Waterfall, Rapid Application Development, Agile...
 
02010 ppt ch02
02010 ppt ch0202010 ppt ch02
02010 ppt ch02
 
Model versioning in context of living
Model versioning in context of livingModel versioning in context of living
Model versioning in context of living
 
Simulating Enterprise Architecture Models
Simulating Enterprise Architecture Models Simulating Enterprise Architecture Models
Simulating Enterprise Architecture Models
 
Object Oriented Database
Object Oriented DatabaseObject Oriented Database
Object Oriented Database
 
Learn Entity Framework in a day with Code First, Model First and Database First
Learn Entity Framework in a day with Code First, Model First and Database FirstLearn Entity Framework in a day with Code First, Model First and Database First
Learn Entity Framework in a day with Code First, Model First and Database First
 
4) databases
4) databases4) databases
4) databases
 
Chapter1
Chapter1Chapter1
Chapter1
 
Schema webinar
Schema webinarSchema webinar
Schema webinar
 
Ef overview
Ef overviewEf overview
Ef overview
 
Financial Industry Business Unified Model (FIBUM)
Financial Industry Business Unified Model (FIBUM)Financial Industry Business Unified Model (FIBUM)
Financial Industry Business Unified Model (FIBUM)
 
Data Modeling.docx
Data Modeling.docxData Modeling.docx
Data Modeling.docx
 
Day5
Day5Day5
Day5
 
Data modeling star schema
Data modeling star schemaData modeling star schema
Data modeling star schema
 
Be a database professional
Be a database professionalBe a database professional
Be a database professional
 
Be a database professional
Be a database professionalBe a database professional
Be a database professional
 

Mais de George McGeachie

SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...
SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...
SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...George McGeachie
 
Data Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSONData Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSONGeorge McGeachie
 
George McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner featuresGeorge McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner featuresGeorge McGeachie
 
Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018George McGeachie
 
Lightning talk at UK PG Day, 2014 - Get Modelling!
Lightning talk at UK PG Day,  2014 - Get Modelling!Lightning talk at UK PG Day,  2014 - Get Modelling!
Lightning talk at UK PG Day, 2014 - Get Modelling!George McGeachie
 
What can power designer do for me
What can power designer do for meWhat can power designer do for me
What can power designer do for meGeorge McGeachie
 

Mais de George McGeachie (6)

SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...
SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...
SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...
 
Data Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSONData Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSON
 
George McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner featuresGeorge McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner features
 
Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018
 
Lightning talk at UK PG Day, 2014 - Get Modelling!
Lightning talk at UK PG Day,  2014 - Get Modelling!Lightning talk at UK PG Day,  2014 - Get Modelling!
Lightning talk at UK PG Day, 2014 - Get Modelling!
 
What can power designer do for me
What can power designer do for meWhat can power designer do for me
What can power designer do for me
 

Último

A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbuapidays
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusZilliz
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 

Último (20)

A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 

Generating XML schemas from a Logical Data Model (EDW 2011)

  • 1. Generating XML Schemas from a canonical model - a practical example George McGeachie Metadata Matters Limited Enterprise Data World Chicago April 5th, 2010
  • 2. The ‘C’ word Managing XSDs using a master (canonical) XML schema The flexibility of PowerDesigner The XML Schema Model in PowerDesigner Which Canonical Model Should You Use? Factors To Be Considered Generating XML Models in Power Designer Enterprise Data World, Chicago, April 5th 2011 2
  • 3. About Me I’ve been involved with modelling and managing data and metadata for longer than I care to remember. When I first came across XML Schemas, I was struck by their simplicity and versatility. When I saw how some people use them, I realised that the days of unmanaged COBOL copybooks had returned to haunt me. This is my attempt to exorcise the XML demon. Enterprise Data World, Chicago, April 5th 2011 3
  • 4. The ‘C’ word It’s difficult to avoid the word ‘Canonical’ when discussing standard XML messages To some, the message schemas are the ‘canonical’ To others, the underlying model is the ‘canonical’ When I use the word, I mean both of them Enterprise Data World, Chicago, April 5th 2011 4
  • 5. Managing XSDs using a master (canonical) XML schema An XML master schema must be hierarchical It cannot easily show all the complex relationships between the data concepts It cannot be flexible enough to support multiple views of the data You need to understand XML to create, edit or read the model Enterprise Data World, Chicago, April 5th 2011 5
  • 6. Managing XSDs using a master (canonical) XML schema How would we integrate the metadata represented by a schema with our other metadata? Reverse-engineer it into a repository or modelling tool? How would we Ensure consistency of XSDs with each other? Enable impact analysis? Manage the variations necessary between dependent schemas? Enterprise Data World, Chicago, April 5th 2011 6
  • 7. The flexibility of PowerDesigner Enterprise Data World, Chicago, April 5th 2011 7 PowerDesigner has a dedicated XML Schema Model Several different approaches supported out of the box Generating XSDs from a class model Generating an XML Schema model from a class model or a physical data model, then generating XSDs Reverse-engineering existing XML Schemas into a class model or XML Schema Model Can then generate a logical or conceptual view
  • 8. Generation options in PowerDesigner Enterprise Data World, Chicago, April 5th 2011 8
  • 9. The XML Schema Model in PowerDesigner Enterprise Data World, Chicago, April 5th 2011 9 This can link to an XML model, or an XSD Referenced Elements (in another XSD) Complex Type Note the XML-specific object types
  • 10. XML-specific Model Objects 10 Enterprise Data World, Chicago, April 5th 2011 Here’s the detail of one of the sequences in the schema Filter the displayed properties Add additional items to the sequence
  • 11. The XML Model Dedicated to modelling XML Schema 1 schema per XML model, traceable to source models Mapping Editor – drag and drop mappings between models Supports XSD, XDR and DTD Multiple Namespaces supported Can use 1 XML model for multiple schemas in the same target namespace Enterprise Data World, Chicago, April 5th 2011 11
  • 12. The flexibility of PowerDesigner Linkages are automatically maintained between models as you generate them Additional mappings can be added between any two models The generation process can be customised You have control over the naming standards and data types used in each model Impact and Lineage analysis is enabled by the generation and mapping links Enterprise Data World, Chicago, April 5th 2011 12
  • 13. Generation Links For each model, you can trace links to other models in the generation sequence Enterprise Data World, Chicago, April 5th 2011 13
  • 14. Mapping Editor Visually check mappings Enterprise Data World, Chicago, April 5th 2011 14
  • 15. Impact of deleting XML Attribute - diagram Enterprise Data World, Chicago, April 5th 2011 15 Dependencies between PDM tables PDM Tables mapped to the Element Our attribute XML Element Simple Type (no longer required) Remember: this diagram traces back to the model the XML attribute was generated from; in this case, the XML model was generated from a PDM, so the impact analysis traces to the PDM
  • 16. Visible Links Between Models Using the ‘project’ feature, we can see the links between models We can also include external objects, and create our own links to them An XSD and an HTML file in this case Enterprise Data World, Chicago, April 5th 2011 16
  • 17. Which canonical model? One (or more) that you can sell within your organisation Standard models Standard Universal Data Models e.g. IBM, Teradata, Oracle, EWS Solutions, Len Silverston’s Universal Data Models Industry Universal Data Models e.g. standard messaging structures, such as from the OAG See www.industrydatamodels.com Some organisations use several of these, which will need to be cross-referenced Your own model(s) possibly used to extend one of the above Enterprise Data World, Chicago, April 5th 2011 17
  • 18. A simple example of a relational canonical model Enterprise Data World, Chicago, April 5th 2011 18 This is an amended version of the ‘Project Management’ PDM supplied with PowerDesigner
  • 19. The ‘Team Members’ schema Enterprise Data World, Chicago, April 5th 2011 19
  • 20. The ‘Project’ schema Enterprise Data World, Chicago, April 5th 2011 20
  • 21. Factors To Be Considered Generating a Type Library vs. generating Schemas Physical Design Challenges Model Management Challenges 21 Enterprise Data World, Chicago, April 5th 2011
  • 22. Generating a type library often straightforward to generate no structure manual control of re-use in schemas "let the service people design the schemas" no impact analysis across schemas may be the only acceptable first step low impact on work patterns gains initial acceptance of the role of a canonical model Enterprise Data World, Chicago, April 5th 2011 22
  • 23. Generating Individual Schemas A 'container' for each schema Model, Submodel, Subject Area, Package etc defines scope provides documentation facilitates governance Complete generation Nothing changed post-generation Requires high degree of control over generation process Enterprise Data World, Chicago, April 5th 2011 23
  • 24. Generating Individual Schemas all types can be local no need to 'include' or 'import' a base schema the 'standard' types are used to generate the schema, rather than being referred to by the schema The standard types are in the canonical data model potential for impact analysis can choose when to update each individual schema Enterprise Data World, Chicago, April 5th 2011 24
  • 25. Sample Message Schema This was generated from the same data model as the type library; it only contains what the message actually needs Enterprise Data World, Chicago, April 5th 2011 25
  • 26. Physical Design Challenges Some of these challenges are similar to those we face when we use a single Logical Data Model for designing multiple database schemas Differences between Schemas Handling Sub-types and inherited attributes Denormalising attributes and entities Data Type and Name conversions Scalability of Process Automating & future-proofing the generation process Enterprise Data World, Chicago, April 5th 2011 26
  • 27. Model Management Challenges Multiple reference models require careful consideration E.g. Using OAG messaging standard as a reference model, extending it where required Provides a quick-start for defining schemas Be careful what you remove; perhaps remove nothing How do you identify the parts that are actually in use? How do you know what extensions are needed? Have to map the standard to your own models Enterprise Data World, Chicago, April 5th 2011 27
  • 28. Generating XML Models in PowerDesigner Two options Generate XML Model using default options, from selected tables, and tinker the XML afterwards Use XML Builder to design and generate almost exactly what is required, and then tinker the XML model 28 Enterprise Data World, Chicago, April 5th 2011
  • 29. Contact Me Telephone: +44 (0) 20 8123 8756 (forwarded to mobile) UK mobile: +44 (0) 794 293 0648 Skype: gmcgeachie Twitter: metadatajunkie Email: George.McGeachie @ MetadataMatters.com Blog: http://metadatajunkie.wordpress.com/ Enterprise Data World, Chicago, April 5th 2011 29

Notas do Editor

  1. I’m a modeller at heart, not an XML Guru, and not a developer.
  2. Why use a canonical data model?In this presentation, I assume that the use of a canonical model is a given; we all see the need to manage our understanding and metadataSee Designing Canonicals for SOA: Bridging ER and XML Worlds Mehmet Orun & Jeff Pekrul, Genentechhttp://sfdama.org/Presentations/2007-02-07_Canonical_for_SOA_%20ER_XML.pdf
  3. It’s possible to manage the content of XML Schemas by using a single master (canonical) XML Schema, which defines all the allowed types. The hierarchical nature of an XML Schema makes it impossible for a master schema to do any more than specify the possible building blocks for schemas; it cannot govern the ways in which those building blocks are assembled. A canonical data model managed as an XSD can only be a type library; it cannot possibly control the ways in which the types can be assembledMany of the challenges (see later) we face when generating XSDs also apply to an XML Master Schema
  4. A stand-alone canonical XML schema is an island of metadata, providing no impact and lineage analysis capabilities
  5. The dedicated XML model in PowerDesigner enables us to manage XML schema designs in an integrated manner; have a look at the options in the next slide
  6. You can see how the XML Schema Model forms an integral part of the PowerDesigner model management philosophy.This slide only shows the ‘downward’ generation options; it also possible for a model to generate another model of the same type, or another model of a ‘higher’ type. E.g. a PDM can be generated from an XSM.
  7. This is an OAGi XML Schema, reverse-engineered into PowerDesigner. The only change I’ve made is to move some symbols closer to each other. This schema inherits all the simple types from other schemas, which is why there aren’t any here.
  8. The arrows show the navigation path through the model required to create the schema; note that some relationships are traversed from parent to child, others from child to parent. Also note that no attributes are extracted from the ‘Team Member’ entity; we use it as a route to the details of the Employee. The grey parts of the model are not used in this schema.
  9. A more complex schemaThe arrows show the navigation path through the model required to create the schema; note that some relationships are traversed from parent to child, others from child to parent. Also note that no attributes are extracted from the ‘Team Member’ entity; we use it as a route to the details of the Employee.
  10. Differences between SchemasAttribute and relationship optionality and cardinalityExcluding attributesFewer or more enumerationsDenormalising attributes and entitiesAttributes may appear in >1 element1 element may include attributes from multiple entitiesScalability of Process We can handle 5 XSDs, but what about 500 XSDs?
  11. From PDM