SlideShare uma empresa Scribd logo
1 de 12
Data integration
A case study on the creation
of an integration framework
for the Oil & Gas industry




www.etlsolutions.com
Introduction
    Transformation Manager, our data integration toolkit for developers,
    is used to efficiently connect oil and gas data stores with the
    industry„s leading integration standard.


•   Our client is a global oilfield services
    company with a long track record in the Oil
    & Gas industry.
•   To maintain their position as the leader in
    the sector, the client‟s new product
    development plan included a Professional
    Petroleum Data Model (PPDM) based
    software product.
The challenge


•   The product required a data integration
    framework capable of tackling multiple and
    diverse Exploration & Production (E&P) data
    sources.
•   The challenge was to develop scalable export
    components from the underlying PPDM
    database to LAS, DLIS and WITSML.
The solution
•   After evaluating a range of potential data integration
    tools, the client chose our professional services and
    Transformation Manager software for a number of                   Transformation
    reasons:                                                           Manager data
     •   We have a long and successful track record in E&P           movement software
         technical data management.
     •   We offer a comprehensive service to help in the design
         and development of all the required export components, in
         a highly competitive and risk sharing commercial
         arrangement.
     •   We have a track record of delivering on budget and to
         client deadline.                                               Consultancy
     •   Transformation Manager offers a tried and tested toolset        services
         for the efficient delivery of the project.
     •   Transformation Manager has the ability to connect and
         transform all the data types and footprint required.
     •   We were able to provide an integrated solution fitting
         directly into the client architecture.
•   The project was divided into three stages…
Phase 1: Design phase

•   The architecture design defined the
    deployment code framework, specifying the
    interaction between the client‟s product
    architecture and Transformation Manager‟s
    own deployment code.
•   Mapping rules were defined in conjunction
    with the client. A mapping rule spreadsheet
    was created for each export function,
    containing the PPDM table/element level
    mappings to file format specifications.
•   Output file formats were also specified,
    particularly any requirements not already
    defined by the standards. These included
    ordering, spacing, custom sections and data
    type representation.
Phase 2: deployment code framework development

•   The deployment code was developed to a
    range of specifications, including export
    parameters and reporting requirements.
•   The framework‟s interfaces were hooked up to
    the implementations required by the client‟s
    product using JNDI. This obtained a database
    connection and performed the other tasks
    required.
•   The export code included transforms
    generated with Transformation Manager.
    Using the software‟s TM Designer application,
    the client‟s developers are now able to specify
    the rules by which the PPDM source data is
    mapped to the target data.
Phase 3: Export function development

•   As mentioned, the project focused on three file
    formats: LAS, DLIS and WITSML. For each format,
    a set of tests were defined. These tests consisted
    of a sample set of PPDM data and the export file to
    be produced, which were then used for final
    acceptance testing.
•   Our consultants tested the deployment code and
    mapping implementation, and also conducted
    performance testing. Integration testing was a joint
    activity between our consultants and the client‟s
    developers. The client carried out acceptance and
    final performance testing, with support from our
    team.
•   The transforms created in this phase conformed to
    the mapping rules defined in Phase 1. The adapter
    for each file format was designed to be scalable to
    meet the requirements defined during the design
    phase.
The result


•   We used our expertise, tools and
    commercial flexibility to meet a challenging
    client requirement. Our team delivered a
    component which can efficiently deploy
    PPDM data to a range of the most popular
    file formats.
•   The client is able to benefit from reduced
    risk and cost, alongside increased control
    and transparency of their own clients‟ E&P
    data.
Why Transformation Manager?

For the user:    Everything under one roof
                 Greater control and
                  transparency
                 Identify and test against errors
                  iteratively
                 Greater understanding of the
                  transformation requirement
                 Automatically document
                 Re-use and change
                  management
                 Uses domain specific
                  terminology in the mapping
Why Transformation Manager?

For the business:    Reduces cost and effort
                     Reduces risk in the project
                     Delivers higher quality and
                      reduces error
                     Increases control and
                      transparency in the
                      development
                     Single product
                     Reduces time to market
Why ETL Solutions?

                                                         ““We‟ve cut a six-month project
• 10-year track record in data                              down to three months…a
  management, working with global blue                  sophisticated product that is easy
                                                         to work with and maintain AND
  chip clients                                             gives us great performance.
• Unparalleled knowledge from our team of                 We‟re very confident with the
                                                                    solution."
  data integration experts, many of whom                       Arnaud Daeschner,
  have been with us since inception                               BNP Paribas

• Our Transformation Manager and
  DataHub software have been proven in
  even the most complex data movements                      “Honda has been seeking to
                                                              achieve Dealer Network
• Expert support: first line of contact is with          Integration for the last ten years.
                                                          With the help of ETL Solutions,
  a developer or consultant                               this has finally been achieved.
• Data integration focus – it‟s all that we do           Considering the success, Honda
                                                           is now planning to extend this
                                                             approach to the European
                                                                      dealers.”
                                                            Michael Doyle, Honda UK


                                  ©2009 ETL Solutions
Contact us for more information:
   Karl Glenn, Business Development Director
   kg@etlsolutions.com
   +44 (0) 1912 894040


   Read more on our website:
   www.etlsolutions.com




                                                                     Raising data
                                                                     management
                                                                      standards
www.etlsolutions.com
 www.etlsolutions.com
                                               Images from Free Digital Photos freedigitalphotos.net

Mais conteúdo relacionado

Mais procurados

PJM01_RUC_2003_Presentation
PJM01_RUC_2003_PresentationPJM01_RUC_2003_Presentation
PJM01_RUC_2003_PresentationLisa Statland
 
Blaine Wolff Resume
Blaine Wolff ResumeBlaine Wolff Resume
Blaine Wolff Resumebwolff52
 
Sandip Mukherjee Profile
Sandip Mukherjee ProfileSandip Mukherjee Profile
Sandip Mukherjee Profilesandipm
 
Resume G Bisanz Detailed Feb22012
Resume G Bisanz Detailed Feb22012Resume G Bisanz Detailed Feb22012
Resume G Bisanz Detailed Feb22012Gregory Bisanz
 
Cipher Introduction
Cipher IntroductionCipher Introduction
Cipher Introductionmmmmmm_mala
 
Bohill Consulting Project Management And Solutions Consultancy
Bohill Consulting   Project Management And Solutions ConsultancyBohill Consulting   Project Management And Solutions Consultancy
Bohill Consulting Project Management And Solutions Consultancygabrielleburns
 
Software Development 1 June2012
Software Development 1 June2012Software Development 1 June2012
Software Development 1 June2012Jay Encarnacion
 
Overview of Rational Services Offerings
Overview of Rational Services OfferingsOverview of Rational Services Offerings
Overview of Rational Services OfferingsIBM Rational software
 
Jack Holcombe
Jack HolcombeJack Holcombe
Jack Holcombejack0352
 
Nagaraj Nayakar Resume IBM
Nagaraj Nayakar Resume IBMNagaraj Nayakar Resume IBM
Nagaraj Nayakar Resume IBMnagaraj nayakar
 
ITIL compliant Open Source tools
ITIL compliant Open Source toolsITIL compliant Open Source tools
ITIL compliant Open Source toolsBruno Cornec
 
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...Strongstep - Innovation in software quality
 
Business Process Management - From Market Consolidation to Process Innovation
Business Process Management - From Market Consolidation to Process InnovationBusiness Process Management - From Market Consolidation to Process Innovation
Business Process Management - From Market Consolidation to Process InnovationMichael zur Muehlen
 
Guide to New Product Development (NPD)
Guide to New Product Development (NPD)Guide to New Product Development (NPD)
Guide to New Product Development (NPD)Technology Multipliers
 
Rapid Software Development Process
Rapid Software Development ProcessRapid Software Development Process
Rapid Software Development ProcessThanh Nguyen
 
How business process mapping saved an IT project.
How business process mapping saved an IT project.How business process mapping saved an IT project.
How business process mapping saved an IT project.Garrett Hunter
 

Mais procurados (20)

PJM01_RUC_2003_Presentation
PJM01_RUC_2003_PresentationPJM01_RUC_2003_Presentation
PJM01_RUC_2003_Presentation
 
Blaine Wolff Resume
Blaine Wolff ResumeBlaine Wolff Resume
Blaine Wolff Resume
 
Sandip Mukherjee Profile
Sandip Mukherjee ProfileSandip Mukherjee Profile
Sandip Mukherjee Profile
 
Resume G Bisanz Detailed Feb22012
Resume G Bisanz Detailed Feb22012Resume G Bisanz Detailed Feb22012
Resume G Bisanz Detailed Feb22012
 
Cipher Introduction
Cipher IntroductionCipher Introduction
Cipher Introduction
 
Bohill Consulting Project Management And Solutions Consultancy
Bohill Consulting   Project Management And Solutions ConsultancyBohill Consulting   Project Management And Solutions Consultancy
Bohill Consulting Project Management And Solutions Consultancy
 
DianaTChua
DianaTChuaDianaTChua
DianaTChua
 
Software Development 1 June2012
Software Development 1 June2012Software Development 1 June2012
Software Development 1 June2012
 
Overview of Rational Services Offerings
Overview of Rational Services OfferingsOverview of Rational Services Offerings
Overview of Rational Services Offerings
 
Jack Holcombe
Jack HolcombeJack Holcombe
Jack Holcombe
 
Short version
Short versionShort version
Short version
 
Nagaraj Nayakar Resume IBM
Nagaraj Nayakar Resume IBMNagaraj Nayakar Resume IBM
Nagaraj Nayakar Resume IBM
 
ITIL compliant Open Source tools
ITIL compliant Open Source toolsITIL compliant Open Source tools
ITIL compliant Open Source tools
 
Indranil Pujari - v2
Indranil Pujari - v2Indranil Pujari - v2
Indranil Pujari - v2
 
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
 
Business Process Management - From Market Consolidation to Process Innovation
Business Process Management - From Market Consolidation to Process InnovationBusiness Process Management - From Market Consolidation to Process Innovation
Business Process Management - From Market Consolidation to Process Innovation
 
Guide to New Product Development (NPD)
Guide to New Product Development (NPD)Guide to New Product Development (NPD)
Guide to New Product Development (NPD)
 
Sheldon cousino resume
Sheldon cousino resumeSheldon cousino resume
Sheldon cousino resume
 
Rapid Software Development Process
Rapid Software Development ProcessRapid Software Development Process
Rapid Software Development Process
 
How business process mapping saved an IT project.
How business process mapping saved an IT project.How business process mapping saved an IT project.
How business process mapping saved an IT project.
 

Semelhante a Data integration case study: Oil & Gas industry

Data integration case study: Automotive industry
Data integration case study: Automotive industryData integration case study: Automotive industry
Data integration case study: Automotive industryETLSolutions
 
Cynoteck - Salesforce Presentation - Consulting Services
Cynoteck  -  Salesforce Presentation - Consulting ServicesCynoteck  -  Salesforce Presentation - Consulting Services
Cynoteck - Salesforce Presentation - Consulting ServicesRosa Aguiar Catraio
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Microsoft Décideurs IT
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Microsoft Technet France
 
Add Agility to Your Business Communications
Add Agility to Your Business CommunicationsAdd Agility to Your Business Communications
Add Agility to Your Business CommunicationsPrecisely
 
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...WSO2
 
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...Dell World
 
GrayCell Corporate Presentation
GrayCell Corporate PresentationGrayCell Corporate Presentation
GrayCell Corporate PresentationAmit-GrayCell
 
Goken Corporate Presentation - Interiors & Seating
Goken Corporate Presentation - Interiors & SeatingGoken Corporate Presentation - Interiors & Seating
Goken Corporate Presentation - Interiors & SeatingAshleyTaylor66055
 
ITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION
 
Cp Company Overview
Cp Company OverviewCp Company Overview
Cp Company Overviewssbhatia
 
shoubhik_Resume_latest
shoubhik_Resume_latestshoubhik_Resume_latest
shoubhik_Resume_latestShoubhik Ghosh
 
Cobb Solutions Overview 6-28-12
Cobb Solutions Overview 6-28-12Cobb Solutions Overview 6-28-12
Cobb Solutions Overview 6-28-12Michael Swart
 
Benchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development PerformanceBenchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development PerformanceDCG Software Value
 
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31TechSoup
 
Satyam Business Honeycomb Booklet
Satyam Business Honeycomb BookletSatyam Business Honeycomb Booklet
Satyam Business Honeycomb Bookletguestff9c4c73
 

Semelhante a Data integration case study: Oil & Gas industry (20)

Data integration case study: Automotive industry
Data integration case study: Automotive industryData integration case study: Automotive industry
Data integration case study: Automotive industry
 
Cynoteck - Salesforce Presentation - Consulting Services
Cynoteck  -  Salesforce Presentation - Consulting ServicesCynoteck  -  Salesforce Presentation - Consulting Services
Cynoteck - Salesforce Presentation - Consulting Services
 
DevOps with Chef
DevOps with ChefDevOps with Chef
DevOps with Chef
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
 
Add Agility to Your Business Communications
Add Agility to Your Business CommunicationsAdd Agility to Your Business Communications
Add Agility to Your Business Communications
 
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
 
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
 
GrayCell Corporate Presentation
GrayCell Corporate PresentationGrayCell Corporate Presentation
GrayCell Corporate Presentation
 
Goken Corporate Presentation - Interiors & Seating
Goken Corporate Presentation - Interiors & SeatingGoken Corporate Presentation - Interiors & Seating
Goken Corporate Presentation - Interiors & Seating
 
It assessment case study
It assessment case studyIt assessment case study
It assessment case study
 
ITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clients
 
Cp Company Overview
Cp Company OverviewCp Company Overview
Cp Company Overview
 
Everything ITROI
Everything  ITROIEverything  ITROI
Everything ITROI
 
shoubhik_Resume_latest
shoubhik_Resume_latestshoubhik_Resume_latest
shoubhik_Resume_latest
 
Cobb Solutions Overview 6-28-12
Cobb Solutions Overview 6-28-12Cobb Solutions Overview 6-28-12
Cobb Solutions Overview 6-28-12
 
Benchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development PerformanceBenchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development Performance
 
About Atidan 2016
About Atidan 2016About Atidan 2016
About Atidan 2016
 
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
 
Satyam Business Honeycomb Booklet
Satyam Business Honeycomb BookletSatyam Business Honeycomb Booklet
Satyam Business Honeycomb Booklet
 

Mais de ETLSolutions

How to create a successful proof of concept
How to create a successful proof of conceptHow to create a successful proof of concept
How to create a successful proof of conceptETLSolutions
 
DMS data integration: 6 ways to get it right
DMS data integration: 6 ways to get it rightDMS data integration: 6 ways to get it right
DMS data integration: 6 ways to get it rightETLSolutions
 
WITSML to PPDM mapping project
WITSML to PPDM mapping projectWITSML to PPDM mapping project
WITSML to PPDM mapping projectETLSolutions
 
How to prepare data before a data migration
How to prepare data before a data migrationHow to prepare data before a data migration
How to prepare data before a data migrationETLSolutions
 
E&P data management: Implementing data standards
E&P data management: Implementing data standardsE&P data management: Implementing data standards
E&P data management: Implementing data standardsETLSolutions
 
An example of a successful proof of concept
An example of a successful proof of conceptAn example of a successful proof of concept
An example of a successful proof of conceptETLSolutions
 
Migrating data: How to reduce risk
Migrating data: How to reduce riskMigrating data: How to reduce risk
Migrating data: How to reduce riskETLSolutions
 
Preparing a data migration plan: A practical guide
Preparing a data migration plan: A practical guidePreparing a data migration plan: A practical guide
Preparing a data migration plan: A practical guideETLSolutions
 
A 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data managementA 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data managementETLSolutions
 
Automotive data integration: An example of a successful project structure
Automotive data integration: An example of a successful project structureAutomotive data integration: An example of a successful project structure
Automotive data integration: An example of a successful project structureETLSolutions
 

Mais de ETLSolutions (10)

How to create a successful proof of concept
How to create a successful proof of conceptHow to create a successful proof of concept
How to create a successful proof of concept
 
DMS data integration: 6 ways to get it right
DMS data integration: 6 ways to get it rightDMS data integration: 6 ways to get it right
DMS data integration: 6 ways to get it right
 
WITSML to PPDM mapping project
WITSML to PPDM mapping projectWITSML to PPDM mapping project
WITSML to PPDM mapping project
 
How to prepare data before a data migration
How to prepare data before a data migrationHow to prepare data before a data migration
How to prepare data before a data migration
 
E&P data management: Implementing data standards
E&P data management: Implementing data standardsE&P data management: Implementing data standards
E&P data management: Implementing data standards
 
An example of a successful proof of concept
An example of a successful proof of conceptAn example of a successful proof of concept
An example of a successful proof of concept
 
Migrating data: How to reduce risk
Migrating data: How to reduce riskMigrating data: How to reduce risk
Migrating data: How to reduce risk
 
Preparing a data migration plan: A practical guide
Preparing a data migration plan: A practical guidePreparing a data migration plan: A practical guide
Preparing a data migration plan: A practical guide
 
A 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data managementA 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data management
 
Automotive data integration: An example of a successful project structure
Automotive data integration: An example of a successful project structureAutomotive data integration: An example of a successful project structure
Automotive data integration: An example of a successful project structure
 

Último

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 

Último (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 

Data integration case study: Oil & Gas industry

  • 1. Data integration A case study on the creation of an integration framework for the Oil & Gas industry www.etlsolutions.com
  • 2. Introduction Transformation Manager, our data integration toolkit for developers, is used to efficiently connect oil and gas data stores with the industry„s leading integration standard. • Our client is a global oilfield services company with a long track record in the Oil & Gas industry. • To maintain their position as the leader in the sector, the client‟s new product development plan included a Professional Petroleum Data Model (PPDM) based software product.
  • 3. The challenge • The product required a data integration framework capable of tackling multiple and diverse Exploration & Production (E&P) data sources. • The challenge was to develop scalable export components from the underlying PPDM database to LAS, DLIS and WITSML.
  • 4. The solution • After evaluating a range of potential data integration tools, the client chose our professional services and Transformation Manager software for a number of Transformation reasons: Manager data • We have a long and successful track record in E&P movement software technical data management. • We offer a comprehensive service to help in the design and development of all the required export components, in a highly competitive and risk sharing commercial arrangement. • We have a track record of delivering on budget and to client deadline. Consultancy • Transformation Manager offers a tried and tested toolset services for the efficient delivery of the project. • Transformation Manager has the ability to connect and transform all the data types and footprint required. • We were able to provide an integrated solution fitting directly into the client architecture. • The project was divided into three stages…
  • 5. Phase 1: Design phase • The architecture design defined the deployment code framework, specifying the interaction between the client‟s product architecture and Transformation Manager‟s own deployment code. • Mapping rules were defined in conjunction with the client. A mapping rule spreadsheet was created for each export function, containing the PPDM table/element level mappings to file format specifications. • Output file formats were also specified, particularly any requirements not already defined by the standards. These included ordering, spacing, custom sections and data type representation.
  • 6. Phase 2: deployment code framework development • The deployment code was developed to a range of specifications, including export parameters and reporting requirements. • The framework‟s interfaces were hooked up to the implementations required by the client‟s product using JNDI. This obtained a database connection and performed the other tasks required. • The export code included transforms generated with Transformation Manager. Using the software‟s TM Designer application, the client‟s developers are now able to specify the rules by which the PPDM source data is mapped to the target data.
  • 7. Phase 3: Export function development • As mentioned, the project focused on three file formats: LAS, DLIS and WITSML. For each format, a set of tests were defined. These tests consisted of a sample set of PPDM data and the export file to be produced, which were then used for final acceptance testing. • Our consultants tested the deployment code and mapping implementation, and also conducted performance testing. Integration testing was a joint activity between our consultants and the client‟s developers. The client carried out acceptance and final performance testing, with support from our team. • The transforms created in this phase conformed to the mapping rules defined in Phase 1. The adapter for each file format was designed to be scalable to meet the requirements defined during the design phase.
  • 8. The result • We used our expertise, tools and commercial flexibility to meet a challenging client requirement. Our team delivered a component which can efficiently deploy PPDM data to a range of the most popular file formats. • The client is able to benefit from reduced risk and cost, alongside increased control and transparency of their own clients‟ E&P data.
  • 9. Why Transformation Manager? For the user:  Everything under one roof  Greater control and transparency  Identify and test against errors iteratively  Greater understanding of the transformation requirement  Automatically document  Re-use and change management  Uses domain specific terminology in the mapping
  • 10. Why Transformation Manager? For the business:  Reduces cost and effort  Reduces risk in the project  Delivers higher quality and reduces error  Increases control and transparency in the development  Single product  Reduces time to market
  • 11. Why ETL Solutions? ““We‟ve cut a six-month project • 10-year track record in data down to three months…a management, working with global blue sophisticated product that is easy to work with and maintain AND chip clients gives us great performance. • Unparalleled knowledge from our team of We‟re very confident with the solution." data integration experts, many of whom Arnaud Daeschner, have been with us since inception BNP Paribas • Our Transformation Manager and DataHub software have been proven in even the most complex data movements “Honda has been seeking to achieve Dealer Network • Expert support: first line of contact is with Integration for the last ten years. With the help of ETL Solutions, a developer or consultant this has finally been achieved. • Data integration focus – it‟s all that we do Considering the success, Honda is now planning to extend this approach to the European dealers.” Michael Doyle, Honda UK ©2009 ETL Solutions
  • 12. Contact us for more information: Karl Glenn, Business Development Director kg@etlsolutions.com +44 (0) 1912 894040 Read more on our website: www.etlsolutions.com Raising data management standards www.etlsolutions.com www.etlsolutions.com Images from Free Digital Photos freedigitalphotos.net