SlideShare uma empresa Scribd logo
1 de 28
Baixar para ler offline
Bringing Agility and Flexibility to
Data Design and Integration
Phasic Systems Inc
Delivering Agile Data

www.phasicsystemsinc.com
888-735-1774
2


Introduction to Phasic Systems Inc

• Bringing Agile capabilities to data lifecycle for business success
• Methods and tools tested and refined over years of in-depth large-
  scale efforts
• Solve toughest data problems where traditional methods fail
• Based on extensive consulting lessons learned and real-world
  results
• Began in 2005 to commercialize advanced Agile methods
  successfully deployed in competitive development contracts
3


Phasic Systems Inc Management

• Geoffrey Malafsky, Ph.D, Founder and CEO
  ▫ Research scientist
  ▫ Supported many organizations in their quest to access the right
    information at the right time
• Tim Traverso, Sr VP Federal
  ▫ Technical Director, Navy Deputy CIO
• Marshall Maglothin, Sr VP HealthCare
  ▫ Sr. Executive multiple large health care systems
• Deborah Malafsky Sr VP Business Development
4


Our Agile Methods
• Why be Agile?
  ▫ Provide flexibility and adaptability to changing business needs while
    maintaining accuracy and commonality
  ▫ Segmented approach is too slow, rigid, and costly
• How?
  ▫ Treat data lifecycle as one continuous operation from governance to
    modeling to integration to warehouses to Business Intelligence
  ▫ Emphasize value produced at each step and overall coordination
  ▫ Seamlessly fit with existing organization, procedures, tools but add Agility,
    commonality, flexibility, and reduced cost and time
• We are Agile and comprehensive
  ▫ Typical 60-90 day engagement
   ▫ Deliver completed products not just plans or partial results
5


 Methods and Tools
• DataStar Discovery: Agile data governance, standards and design
  ▫ Add business and security context to data
  ▫ Flexible, common data definitions/ semantics, models

• DataStar Unifier: Agile warehousing and aggregation
  ▫ Simplified, common semantics using Corporate NoSQL™
  ▫ Source to target mapping with flexibility, standardization
  ▫ Aggregate data using all use case and system variations simply and
    easily into standard or NoSQL databases
6


PSI Customer Testimonial
     “As a COO of a Wall Street firm and a former Vice Admiral in the United
 States Navy in charge of a large integrated organization of thousands of people
 and numerous IT systems, I have seen firsthand the critical role that high-quality
 enterprise data plays in day-to-day operations of an organization. Without
 timely access to reliable and trusted data all of our operations were vulnerable
 to poor decision making, weak performance, and a failure to compete. With
 Phasic Systems Inc.’s agile methodology and technology, we were finally able to
 solve our data challenges at a fraction of the time, cost, and organizational
 turmoil that all the previous and more expensive, time-consuming approaches
 failed to do. Phasic Systems Inc. offers a new and much-needed approach to
 this important area of Business Intelligence.”


                                  VADM (ret) J. “Kevin” Moran
7


The Business Case
Today’s Response Timeline (15 to 27 Months)
        3 to 6 Months                       6 to 9 Months                         3 to 6 Months           3 to 6 Months

  Business Groups                          IT Groups                             BI Groups                   Users
  • Requirements                • Develop Systems & Applications                                      • Capability Problems
                                                                                • BI Data Models
  • Conceptual/Logical Models   • Physical Data Models                                                • New Capabilities
                                                                                • Reports
  • Data Quality                • Databases / Data Warehouse                                          • Missing Data
                                                                                • Dashboards
  • Business Rules              • ETL controls
  • Standards                   • MDM




Tomorrow’s Initial Response Timeline with PSI (Subsequent Response Timeline – Days)
                                         2 to 6 Months
                                     •   Requirements            •   Develop Systems & Applications
                                     •   Conceptual Data Model   •   Physical Data Models
                                     •   Logical Data Model      •   Databases / Data Warehouse
                                     •   Business Rules          •   ETL controls
                                     •   Standards               •   MDM
                                     •   BI Data Models
                                     •   Data Quality
8


Agile: Overcome Hurdles
• Group rivalry
  ▫ Embrace important business variations; recognize no valid reason
    to force everyone to use only one view exclusively.
• Terminology confusion
  ▫ Use a guided framework of well-known concepts to rapidly identify,
    and implement variations as related entities.
• Poor knowledge sharing
  ▫ Use integrated metadata where important products (business
    models, data models, glossaries, code lists, and integration rules)
    are visible, coordinated, and referenceable
• Inflexible designs
  ▫ Use a hybrid approach (Corporate NoSQL™) for Agile
    warehousing and integration blending traditional tables and
    NoSQL for its immense flexibility and inherent speed
Schema Are Not Enough
Governance       Integration                       CEO/CFO/CIO       SAP/IBM/ORACLE
  Design     ?      MDM                             Sales,       ?
                                                    Accounting


                                                                        D. Loshin 2008

Which Value? Whose?                                My “customer” or your “customer”?


                               How is data used?


 Must be agile in order to adapt quickly to new business needs
   ▫ Continuous change is norm: requirements, consolidation
   ▫ We must use all the important business variations of key terms (e.g.
     account, client, policy) – No such thing as single version for all!
10



Status Quo: Non-Agile   Agile: Visible, Common
11


Unified Business Model™   Intuitive, List-based
12


Real Estate Listing Example

• Seems simple and well-defined
  ▫ Each house has a type, id, address, etc..
  ▫ Industry standards: OSCRE, RETS
• Yet, data systems are very different
  ▫ Data model tied tightly to business workflow
  ▫ Extensions and “make-it-work” changes added over time
• Similar to customer relationship mgmt, ERP, and many
  other fields
13

Semantic Conflict in
Real Estate Models                             NKY


                   HOMESEEKERS

                 NKY attribute ‘basement’
                does not have a corollary in
                     HOMESEEKERS
14
Data Value Semantic
Errors = Inconsistent,   Lot_dimensions: implied semantics for size
Difficult to Merge,          data. Actually has all sorts of data

Report, Analyze
                            Semiannual_taxes: implied semantics for
                           numeric data. Actually has all sorts of data
15

NKY   HomeSeekers   Texas
16
17


Fully Integrated Metadata for Business, IT, and BI
18
19
20


DataStar Corporate NoSQL™
• Large systems use NoSQL for its flexibility, performance,
  and adaptability
  ▫ But, it is poorly suited for corporate use – lacks connection to
    business
• DataStar Corporate NoSQLTM
  ▫ Blends traditional techniques and NoSQL                       Speed
  ▫ Entities come directly from Unified Business Model              &
                                                                  Agility
  ▫ Object structure with simple tables
  ▫ Key-value pairs are basic repeating structure of all tables
  ▫ Business driven terminology
  ▫ Easily handles semantic variations & updates w/o changes to
    logical or physical models
  ▫ Can be as ‘dimensional’ or ‘normalized’ as desired
21


Position Data Model
Results
• Applied to production data:
  ▫ Fully cleaned & integrated data governance approved
     Requirement: 500,000 records in 2 hrs on Sun E25K
     Actual: 50 minutes on 3 year low-cost server
• Governance documents produced and approved
  ▫ Legacy data models – first time in ten years
  ▫ Common data model – directly derived from ontology.
    Position-Resume model
• Standing governance board created with short decision-
  making monthly meetings
  ▫ Position-Resume Governance Board
• Process approach and technology applied to new IT
  systems
Navy HR Data Analysis
• Groups “share” data and control only if they don’t lose project
  control or funds
• Governance, business process, data engineers create separate
  designs and don’t know how to coordinate
• Try hard to follow industry guidance but stuck
• Actual data is very different than policy, mgmt awareness
  ▫ Example 1: Multiple Rate/Rating entries. Person xxxxxx has 5
    entries: 4 end on the same date, 2 have start dates after they
    their end dates , 2 start and end on the same days but are
    different
  ▫ Example 2: 30 different values used for RACE but only 6 allowed
    values in the Navy Military Personnel Manual derived from DoD
    policy
24


Agile Warehousing and BI
25


Agile Warehousing and BI
              v
26


Resume Data Model
27


Key-Value Vocabulary   Resume Identifiers
28


Key-Value Vocabulary   Competency KSAs

Mais conteúdo relacionado

Mais procurados

Agile Data Warehouse Design for Big Data Presentation
Agile Data Warehouse Design for Big Data PresentationAgile Data Warehouse Design for Big Data Presentation
Agile Data Warehouse Design for Big Data Presentation
Vishal Kumar
 
Edr mds a less is more approach to MDM
Edr mds a less is more approach to MDMEdr mds a less is more approach to MDM
Edr mds a less is more approach to MDM
Thor Henning Hetland
 
3 Keys To Successful Master Data Management - Final Presentation
3 Keys To Successful Master Data Management - Final Presentation3 Keys To Successful Master Data Management - Final Presentation
3 Keys To Successful Master Data Management - Final Presentation
James Chi
 
Best Practices: Datawarehouse Automation Conference September 20, 2012 - Amst...
Best Practices: Datawarehouse Automation Conference September 20, 2012 - Amst...Best Practices: Datawarehouse Automation Conference September 20, 2012 - Amst...
Best Practices: Datawarehouse Automation Conference September 20, 2012 - Amst...
Erik Fransen
 
ETIS11 - Agile Business Intelligence - Presentation
ETIS11 -  Agile Business Intelligence - PresentationETIS11 -  Agile Business Intelligence - Presentation
ETIS11 - Agile Business Intelligence - Presentation
David Walker
 
Master Data Management (MDM) 101 & Oracle Trading Community Architecture (TCA...
Master Data Management (MDM) 101 & Oracle Trading Community Architecture (TCA...Master Data Management (MDM) 101 & Oracle Trading Community Architecture (TCA...
Master Data Management (MDM) 101 & Oracle Trading Community Architecture (TCA...
Rhapsody Technologies, Inc.
 

Mais procurados (20)

Agile Data Warehouse Design for Big Data Presentation
Agile Data Warehouse Design for Big Data PresentationAgile Data Warehouse Design for Big Data Presentation
Agile Data Warehouse Design for Big Data Presentation
 
White Paper - The Business Case For Business Intelligence
White Paper -  The Business Case For Business IntelligenceWhite Paper -  The Business Case For Business Intelligence
White Paper - The Business Case For Business Intelligence
 
Edr mds a less is more approach to MDM
Edr mds a less is more approach to MDMEdr mds a less is more approach to MDM
Edr mds a less is more approach to MDM
 
5 Steps To Master Data Management
5 Steps To Master Data Management5 Steps To Master Data Management
5 Steps To Master Data Management
 
3 Keys To Successful Master Data Management - Final Presentation
3 Keys To Successful Master Data Management - Final Presentation3 Keys To Successful Master Data Management - Final Presentation
3 Keys To Successful Master Data Management - Final Presentation
 
Agile BI: How to Deliver More Value in Less Time
Agile BI: How to Deliver More Value in Less TimeAgile BI: How to Deliver More Value in Less Time
Agile BI: How to Deliver More Value in Less Time
 
Tips & tricks to drive effective Master Data Management & ERP harmonization
Tips & tricks to drive effective Master Data Management & ERP harmonizationTips & tricks to drive effective Master Data Management & ERP harmonization
Tips & tricks to drive effective Master Data Management & ERP harmonization
 
Best Practices: Datawarehouse Automation Conference September 20, 2012 - Amst...
Best Practices: Datawarehouse Automation Conference September 20, 2012 - Amst...Best Practices: Datawarehouse Automation Conference September 20, 2012 - Amst...
Best Practices: Datawarehouse Automation Conference September 20, 2012 - Amst...
 
How to Use a Semantic Layer on Big Data to Drive AI & BI Impact
How to Use a Semantic Layer on Big Data to Drive AI & BI ImpactHow to Use a Semantic Layer on Big Data to Drive AI & BI Impact
How to Use a Semantic Layer on Big Data to Drive AI & BI Impact
 
Improving the customer experience using big data customer-centric measurement...
Improving the customer experience using big data customer-centric measurement...Improving the customer experience using big data customer-centric measurement...
Improving the customer experience using big data customer-centric measurement...
 
Sustaining Data Governance and Adding Value for the Long Term
Sustaining Data Governance and Adding Value for the Long TermSustaining Data Governance and Adding Value for the Long Term
Sustaining Data Governance and Adding Value for the Long Term
 
Data, Information And Knowledge Management Framework And The Data Management ...
Data, Information And Knowledge Management Framework And The Data Management ...Data, Information And Knowledge Management Framework And The Data Management ...
Data, Information And Knowledge Management Framework And The Data Management ...
 
ETIS11 - Agile Business Intelligence - Presentation
ETIS11 -  Agile Business Intelligence - PresentationETIS11 -  Agile Business Intelligence - Presentation
ETIS11 - Agile Business Intelligence - Presentation
 
Stop the madness - Never doubt the quality of BI again using Data Governance
Stop the madness - Never doubt the quality of BI again using Data GovernanceStop the madness - Never doubt the quality of BI again using Data Governance
Stop the madness - Never doubt the quality of BI again using Data Governance
 
Improving Quality and Adoption: EIM SQL Server 2012
Improving Quality and Adoption: EIM SQL Server 2012Improving Quality and Adoption: EIM SQL Server 2012
Improving Quality and Adoption: EIM SQL Server 2012
 
What Is My Enterprise Data Maturity 2021
What Is My Enterprise Data Maturity 2021What Is My Enterprise Data Maturity 2021
What Is My Enterprise Data Maturity 2021
 
Adopting a Process-Driven Approach to Master Data Management
Adopting a Process-Driven Approach to Master Data ManagementAdopting a Process-Driven Approach to Master Data Management
Adopting a Process-Driven Approach to Master Data Management
 
Bi governance v moulakakis
Bi governance v moulakakisBi governance v moulakakis
Bi governance v moulakakis
 
Master Data Management (MDM) 101 & Oracle Trading Community Architecture (TCA...
Master Data Management (MDM) 101 & Oracle Trading Community Architecture (TCA...Master Data Management (MDM) 101 & Oracle Trading Community Architecture (TCA...
Master Data Management (MDM) 101 & Oracle Trading Community Architecture (TCA...
 
Data Governance Best Practices
Data Governance Best PracticesData Governance Best Practices
Data Governance Best Practices
 

Destaque

Agile Data Management & Integration
Agile Data Management & IntegrationAgile Data Management & Integration
Agile Data Management & Integration
mgleason8
 
Building Data Marts – a Sprint Not A Marathon (Forward Intelligence) v5
Building Data Marts – a Sprint Not A Marathon (Forward Intelligence) v5 Building Data Marts – a Sprint Not A Marathon (Forward Intelligence) v5
Building Data Marts – a Sprint Not A Marathon (Forward Intelligence) v5
David Waters
 

Destaque (7)

Agile Data Management & Integration
Agile Data Management & IntegrationAgile Data Management & Integration
Agile Data Management & Integration
 
Complete Baby Solution in China 2014
Complete Baby Solution in China 2014Complete Baby Solution in China 2014
Complete Baby Solution in China 2014
 
The Hive Data Virtualization Introduction - Sanjay Krishnamurti, Chief Archit...
The Hive Data Virtualization Introduction - Sanjay Krishnamurti, Chief Archit...The Hive Data Virtualization Introduction - Sanjay Krishnamurti, Chief Archit...
The Hive Data Virtualization Introduction - Sanjay Krishnamurti, Chief Archit...
 
Building Data Marts – a Sprint Not A Marathon (Forward Intelligence) v5
Building Data Marts – a Sprint Not A Marathon (Forward Intelligence) v5 Building Data Marts – a Sprint Not A Marathon (Forward Intelligence) v5
Building Data Marts – a Sprint Not A Marathon (Forward Intelligence) v5
 
Agile Data Warehousing at Telstra, TDWI Melbourne, October 2013
Agile Data Warehousing at Telstra, TDWI Melbourne, October 2013Agile Data Warehousing at Telstra, TDWI Melbourne, October 2013
Agile Data Warehousing at Telstra, TDWI Melbourne, October 2013
 
Thawing the "Frozen Middle”
Thawing the "Frozen Middle”Thawing the "Frozen Middle”
Thawing the "Frozen Middle”
 
Scaling Agile Data Warehousing with the Scaled Agile Framework (SAFe)
Scaling Agile Data Warehousing with the Scaled Agile Framework (SAFe)Scaling Agile Data Warehousing with the Scaled Agile Framework (SAFe)
Scaling Agile Data Warehousing with the Scaled Agile Framework (SAFe)
 

Semelhante a Bringing Agility and Flexibility to Data Design and Integration

E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...
E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...
E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...
InSync2011
 

Semelhante a Bringing Agility and Flexibility to Data Design and Integration (20)

MDM & BI Strategy For Large Enterprises
MDM & BI Strategy For Large EnterprisesMDM & BI Strategy For Large Enterprises
MDM & BI Strategy For Large Enterprises
 
Building a strong Data Management capability with TOGAF and ArchiMate
Building a strong Data Management capability with TOGAF and ArchiMateBuilding a strong Data Management capability with TOGAF and ArchiMate
Building a strong Data Management capability with TOGAF and ArchiMate
 
What Data Do You Have and Where is It?
What Data Do You Have and Where is It? What Data Do You Have and Where is It?
What Data Do You Have and Where is It?
 
Balancing Data Governance and Innovation
Balancing Data Governance and InnovationBalancing Data Governance and Innovation
Balancing Data Governance and Innovation
 
E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...
E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...
E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...
 
Big Data: Setting Up the Big Data Lake
Big Data: Setting Up the Big Data LakeBig Data: Setting Up the Big Data Lake
Big Data: Setting Up the Big Data Lake
 
Why Data Science Projects Fail
Why Data Science Projects FailWhy Data Science Projects Fail
Why Data Science Projects Fail
 
Why Data Science Projects Fail
Why Data Science Projects FailWhy Data Science Projects Fail
Why Data Science Projects Fail
 
Five Attributes to a Successful Big Data Strategy
Five Attributes to a Successful Big Data StrategyFive Attributes to a Successful Big Data Strategy
Five Attributes to a Successful Big Data Strategy
 
The Data Lake - Balancing Data Governance and Innovation
The Data Lake - Balancing Data Governance and Innovation The Data Lake - Balancing Data Governance and Innovation
The Data Lake - Balancing Data Governance and Innovation
 
DAS Slides: Metadata Management From Technical Architecture & Business Techni...
DAS Slides: Metadata Management From Technical Architecture & Business Techni...DAS Slides: Metadata Management From Technical Architecture & Business Techni...
DAS Slides: Metadata Management From Technical Architecture & Business Techni...
 
Zakipoint Introduction
Zakipoint IntroductionZakipoint Introduction
Zakipoint Introduction
 
Increasing Agility Through Data Virtualization
Increasing Agility Through Data VirtualizationIncreasing Agility Through Data Virtualization
Increasing Agility Through Data Virtualization
 
Building a business intelligence architecture fit for the 21st century by Jon...
Building a business intelligence architecture fit for the 21st century by Jon...Building a business intelligence architecture fit for the 21st century by Jon...
Building a business intelligence architecture fit for the 21st century by Jon...
 
Big Data Boom
Big Data BoomBig Data Boom
Big Data Boom
 
Auxilion - The Implications of Big Data on the Roadmap Towards Business Intel...
Auxilion - The Implications of Big Data on the Roadmap Towards Business Intel...Auxilion - The Implications of Big Data on the Roadmap Towards Business Intel...
Auxilion - The Implications of Big Data on the Roadmap Towards Business Intel...
 
Managing Data Warehouse Growth in the New Era of Big Data
Managing Data Warehouse Growth in the New Era of Big DataManaging Data Warehouse Growth in the New Era of Big Data
Managing Data Warehouse Growth in the New Era of Big Data
 
2022 Trends in Enterprise Analytics
2022 Trends in Enterprise Analytics2022 Trends in Enterprise Analytics
2022 Trends in Enterprise Analytics
 
Foundational Strategies for Trusted Data: Getting Your Data to the Cloud
Foundational Strategies for Trusted Data: Getting Your Data to the CloudFoundational Strategies for Trusted Data: Getting Your Data to the Cloud
Foundational Strategies for Trusted Data: Getting Your Data to the Cloud
 
Data Lake Acceleration vs. Data Virtualization - What’s the difference?
Data Lake Acceleration vs. Data Virtualization - What’s the difference?Data Lake Acceleration vs. Data Virtualization - What’s the difference?
Data Lake Acceleration vs. Data Virtualization - What’s the difference?
 

Mais de DATAVERSITY

The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
DATAVERSITY
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
DATAVERSITY
 

Mais de DATAVERSITY (20)

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and Governance
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data Literacy
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for You
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling Fundamentals
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic Project
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at Scale
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and Forwards
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement Today
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best Practices
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive Advantage
 

Último

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Último (20)

🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 

Bringing Agility and Flexibility to Data Design and Integration

  • 1. Bringing Agility and Flexibility to Data Design and Integration Phasic Systems Inc Delivering Agile Data www.phasicsystemsinc.com 888-735-1774
  • 2. 2 Introduction to Phasic Systems Inc • Bringing Agile capabilities to data lifecycle for business success • Methods and tools tested and refined over years of in-depth large- scale efforts • Solve toughest data problems where traditional methods fail • Based on extensive consulting lessons learned and real-world results • Began in 2005 to commercialize advanced Agile methods successfully deployed in competitive development contracts
  • 3. 3 Phasic Systems Inc Management • Geoffrey Malafsky, Ph.D, Founder and CEO ▫ Research scientist ▫ Supported many organizations in their quest to access the right information at the right time • Tim Traverso, Sr VP Federal ▫ Technical Director, Navy Deputy CIO • Marshall Maglothin, Sr VP HealthCare ▫ Sr. Executive multiple large health care systems • Deborah Malafsky Sr VP Business Development
  • 4. 4 Our Agile Methods • Why be Agile? ▫ Provide flexibility and adaptability to changing business needs while maintaining accuracy and commonality ▫ Segmented approach is too slow, rigid, and costly • How? ▫ Treat data lifecycle as one continuous operation from governance to modeling to integration to warehouses to Business Intelligence ▫ Emphasize value produced at each step and overall coordination ▫ Seamlessly fit with existing organization, procedures, tools but add Agility, commonality, flexibility, and reduced cost and time • We are Agile and comprehensive ▫ Typical 60-90 day engagement ▫ Deliver completed products not just plans or partial results
  • 5. 5 Methods and Tools • DataStar Discovery: Agile data governance, standards and design ▫ Add business and security context to data ▫ Flexible, common data definitions/ semantics, models • DataStar Unifier: Agile warehousing and aggregation ▫ Simplified, common semantics using Corporate NoSQL™ ▫ Source to target mapping with flexibility, standardization ▫ Aggregate data using all use case and system variations simply and easily into standard or NoSQL databases
  • 6. 6 PSI Customer Testimonial “As a COO of a Wall Street firm and a former Vice Admiral in the United States Navy in charge of a large integrated organization of thousands of people and numerous IT systems, I have seen firsthand the critical role that high-quality enterprise data plays in day-to-day operations of an organization. Without timely access to reliable and trusted data all of our operations were vulnerable to poor decision making, weak performance, and a failure to compete. With Phasic Systems Inc.’s agile methodology and technology, we were finally able to solve our data challenges at a fraction of the time, cost, and organizational turmoil that all the previous and more expensive, time-consuming approaches failed to do. Phasic Systems Inc. offers a new and much-needed approach to this important area of Business Intelligence.” VADM (ret) J. “Kevin” Moran
  • 7. 7 The Business Case Today’s Response Timeline (15 to 27 Months) 3 to 6 Months 6 to 9 Months 3 to 6 Months 3 to 6 Months Business Groups IT Groups BI Groups Users • Requirements • Develop Systems & Applications • Capability Problems • BI Data Models • Conceptual/Logical Models • Physical Data Models • New Capabilities • Reports • Data Quality • Databases / Data Warehouse • Missing Data • Dashboards • Business Rules • ETL controls • Standards • MDM Tomorrow’s Initial Response Timeline with PSI (Subsequent Response Timeline – Days) 2 to 6 Months • Requirements • Develop Systems & Applications • Conceptual Data Model • Physical Data Models • Logical Data Model • Databases / Data Warehouse • Business Rules • ETL controls • Standards • MDM • BI Data Models • Data Quality
  • 8. 8 Agile: Overcome Hurdles • Group rivalry ▫ Embrace important business variations; recognize no valid reason to force everyone to use only one view exclusively. • Terminology confusion ▫ Use a guided framework of well-known concepts to rapidly identify, and implement variations as related entities. • Poor knowledge sharing ▫ Use integrated metadata where important products (business models, data models, glossaries, code lists, and integration rules) are visible, coordinated, and referenceable • Inflexible designs ▫ Use a hybrid approach (Corporate NoSQL™) for Agile warehousing and integration blending traditional tables and NoSQL for its immense flexibility and inherent speed
  • 9. Schema Are Not Enough Governance Integration CEO/CFO/CIO SAP/IBM/ORACLE Design ? MDM Sales, ? Accounting D. Loshin 2008 Which Value? Whose? My “customer” or your “customer”? How is data used? Must be agile in order to adapt quickly to new business needs ▫ Continuous change is norm: requirements, consolidation ▫ We must use all the important business variations of key terms (e.g. account, client, policy) – No such thing as single version for all!
  • 10. 10 Status Quo: Non-Agile Agile: Visible, Common
  • 11. 11 Unified Business Model™ Intuitive, List-based
  • 12. 12 Real Estate Listing Example • Seems simple and well-defined ▫ Each house has a type, id, address, etc.. ▫ Industry standards: OSCRE, RETS • Yet, data systems are very different ▫ Data model tied tightly to business workflow ▫ Extensions and “make-it-work” changes added over time • Similar to customer relationship mgmt, ERP, and many other fields
  • 13. 13 Semantic Conflict in Real Estate Models NKY HOMESEEKERS NKY attribute ‘basement’ does not have a corollary in HOMESEEKERS
  • 14. 14 Data Value Semantic Errors = Inconsistent, Lot_dimensions: implied semantics for size Difficult to Merge, data. Actually has all sorts of data Report, Analyze Semiannual_taxes: implied semantics for numeric data. Actually has all sorts of data
  • 15. 15 NKY HomeSeekers Texas
  • 16. 16
  • 17. 17 Fully Integrated Metadata for Business, IT, and BI
  • 18. 18
  • 19. 19
  • 20. 20 DataStar Corporate NoSQL™ • Large systems use NoSQL for its flexibility, performance, and adaptability ▫ But, it is poorly suited for corporate use – lacks connection to business • DataStar Corporate NoSQLTM ▫ Blends traditional techniques and NoSQL Speed ▫ Entities come directly from Unified Business Model & Agility ▫ Object structure with simple tables ▫ Key-value pairs are basic repeating structure of all tables ▫ Business driven terminology ▫ Easily handles semantic variations & updates w/o changes to logical or physical models ▫ Can be as ‘dimensional’ or ‘normalized’ as desired
  • 22. Results • Applied to production data: ▫ Fully cleaned & integrated data governance approved  Requirement: 500,000 records in 2 hrs on Sun E25K  Actual: 50 minutes on 3 year low-cost server • Governance documents produced and approved ▫ Legacy data models – first time in ten years ▫ Common data model – directly derived from ontology. Position-Resume model • Standing governance board created with short decision- making monthly meetings ▫ Position-Resume Governance Board • Process approach and technology applied to new IT systems
  • 23. Navy HR Data Analysis • Groups “share” data and control only if they don’t lose project control or funds • Governance, business process, data engineers create separate designs and don’t know how to coordinate • Try hard to follow industry guidance but stuck • Actual data is very different than policy, mgmt awareness ▫ Example 1: Multiple Rate/Rating entries. Person xxxxxx has 5 entries: 4 end on the same date, 2 have start dates after they their end dates , 2 start and end on the same days but are different ▫ Example 2: 30 different values used for RACE but only 6 allowed values in the Navy Military Personnel Manual derived from DoD policy
  • 27. 27 Key-Value Vocabulary Resume Identifiers
  • 28. 28 Key-Value Vocabulary Competency KSAs