SlideShare uma empresa Scribd logo
1 de 4
Elastic Cloud: Is Your Data Management Solution Ready?


Ganesan Rathinam
Chain-Sys Corporation

Austin Davis
Chain-Sys Corporation


Introduction
With Elastic Cloud a reality for E business Suite, there is a need for a flexible approach to data management which
works along with Oracle’s open interfaces for integration as well as traditional bulk data loading needs. This
presentation will propose a flexible approach which can work across a corporate network or on the elastic cloud
framework.

The objectives are to give an overview of architectural approaches for traditional bulk data loading, present usage
of web services to achieve integration and share strategies for data maintenance and cleansing.


Flexible Computing
Economics and Convenience demand flexible computing environment/resources. Before the advent of
virtualization, IT departments had to buy the best and powerful (expensive) hardware that would meet the peak
demand of the Business. Multi-tier computing and load balancing helps a lot to meet such peak loads. Much of the
computing power that is in the enterprise stays idle and with minimal usage for long periods of time. (under
utilization). Years ago in the batch job oriented mainframes era, that machine was worked to its full capacity round
the clock. When you had spare capacity on that mainframe, you’d rent it to run batch jobs from other
organizations.


Virtualization
Here multiple server machines are pooled together and the combined CPU power, RAM and disk capacities are
made available for use by the Virtualization software. In Oracle virtualizations, you’d install Oracle VM Server on
the raw machines and a single console control is made available by installing Oracle VM Manager. Server pool or
pools can be created. The big pool can be used to create a one big massive virtual computing machine or you can
create multiple guest machines with their own guest operating systems and networking capabilities. Virtualization
is different from hosting servers in a data center.


Cloud (Private and Public)
Computing in such virtualized environments has another name: Cloud Computing. When all the nitty gritty details
of virtualization and network management are done by in house IT staff, it is called a Private Cloud. When such
management is done by a third party vendor, it is a Public Cloud. Amazon’s EC2 is an example of a public cloud.
Oracle Public Cloud is another example. (cloud.oracle.com). I can host an application and make it available over the


COLLABORATE 12                                                                                         Page | 1
web to customers. I can claim that the application is on the cloud, whether there is cloud computing going on
behind the scenes or not. Anyways the end users are not given the task of managing servers and operating systems
and they can think that they are working off the cloud (virtually speaking). Cloud is buzzword today. People love to
ride it. Oracle E-Business Suite on Demand would not be strictly falling under cloud computing. Oracle provides
hosting and other Application Management Services.


Traditional EBS Data Load Process
Input data has to be brought into an Oracle Staging table using PL/SQL or SQL*Loader Programs. Custom PLSQL
programs have to be written to get the data from the Staging table to hit the Oracle E-Business Suite API’s and/or
Interface tables. The custom program has to be registered as a concurrent program and the actual executables
need to be migrated from Development to other instances manually. The program has to be invoked manually and
maintained. Errors are sometimes returned in the return parameter, sometimes in a table. The error handling need
to be handled in the programs and error correction is done offline on the Error Tables using SQL update scripts.


Traditional EBS Data Interface Process
Data Interfacing can be offline batch oriented, asynchronous near to real time oriented or online real time
transaction oriented. Batch data extraction and/or loading can be accomplished traditionally with
extraction/conversion programs as described in previous section. Writing/developing programs has always been
time consuming, costly and resource intensive. Real time transaction handling is the domain of technologies,
architectures and languages such as Oracle Service Oriented Architecture (SOA), Oracle Business Process Extension
Language (BPEL), Oracle Process Integration Pack (PIPs), Oracle Application Integration Architecture (AIA), Oracle
Enterprise Service Bus. Oracle iRepository has all the list of public API’s supported by Oracle in their EBS R12
applications ( http://irep.oracle.com or EBS Responsibility: Integration Repository). In house
experts/architects/programmers or external consultants are called in to execute such interface solutions. Please
refer http://www.oracle.com/fr/products/consulting/018856.pdf for information on PIP.


Impact of EBS in Cloud Environment on Data Management
Oracle E-Business suite Application Management Services are provided by Oracle Corporation or other third party
companies that provide Oracle EBS on the cloud. Companies started implementing ERPs in the nineties, moving
away from their custom operational softwares. They wanted to take advantage of BUY vs BUILD, industry best
practices that come built into the ERP solutions, and to reduce the cost of maintaining applications. The next step
has been to give away the responsibilities of maintaining ERP, server hardware and networking equipment. All the
while companies have been keen on concentrating on their core businesses rather than big budget IT projects.

Now Data Loading and Data Interfacing for Oracle E-Business Suite: Do companies want to architect, develop and
maintain such programs or get them as a product or rent them off the cloud? When a product can be bought,
building it would not make much sense, unless specific needs of business prevent such a move.

Customers running enterprise applications off the cloud, want enterprise quality data load and data interface tools
to work with their enterprise operational applications. They are acutely aware of the dynamics and challenges of
developing such programs/tools and wisely choose best of class tools, preferably running in the cloud.

The same applies to customers running enterprise applications in house.



COLLABORATE 12                                                                                         Page | 2
Data Load, Interface Tools for EBS Data Management
There are two kinds of data loading tools: The first kind more or less mimics keystrokes into an Oracle E-Business
Suite form and thereby is like a fast secretary typing into the EBS forms. Many vendors offer loading through the
front end GUI of Oracle EBS. The excel macros pump data into the various fields and hit SUBMIT for each record.
The second acts not on the front end, but interacts more like a well written conversion program.

People used to book conference hall for 3 or 4 days each month and a bank of 20 to 25 pc machines to run
dataloader to load master or transactional data into the EBS instance. That used to be time and labor intensive
even with the EBS instance sitting in the local LAN. The issue is, “Enterprise Applications need Enterprise quality
data load tools”.


EBS Data Load Tools in the Cloud Environment
How about a hub and spoke model? A “NOT FRONT END” loading engine with templates (adapters) for the various
API’s and Interface tables, kept at the hub. And pointing spokes (connectivity) to various Oracle EBS instances, on
the cloud or otherwise. With a powerful server at the hub and with multithreading capabilities, all data loading
should happen in minutes and hours instead of days together.

Another attribute required of an enterprise quality load solution: “No babysitting”. The very idea of Computer was
to take away work from us, humans. The computer is the one that is supposed to slog. We’d intervene. Well at the
right time with right inputs based on classy reports. The boss can be productive only if the secretary does her job
well, gives a good report and highlights areas needing attention and feedback.


Characteristics of right data management tool for EBS in Cloud or otherwise
The data load tool should have connect and load capability. It should be deployed in a server and be accessible
from anywhere and should be able to load date into any one of many Oracle E-Business Suite instances. This is the
“Hub and Spoke” model. Data load should be available and used as a Service. Having multiple EBS instances should
not lead to maintenance effort multiplied. The software should scale to loading of million+ records without having
the need of manual intervention. Error handling should be robust and handled in a uniform and structured fashion.
While doing data load or data interface the tool should not violate any of Oracle EBS’ security measures.
Capabilities should exist for an administrator to trace who loaded this transaction and at what time (Audit Trail).
The centralized data loading tool should be self documenting the processes and provide control across the
organization with respect to data loading or interfacing. The system should have Data Extraction as an In-Built
Solution. Easy capabilities for Data Cleansing, Transformation, Pre-validations should be provided. Templates for
loading/interfacing have to be available.

The data load/interfacing solution has to be a thin client solution. The enterprise job cannot be entrusted to the
desktop machine. Moreover when the tasks are accomplished at a centralized server, the organization has more
control and accountability for the operations performed. Keyboard emulation and screen filling solutions are so
fraught with the limitations on throughput and the vagaries of the desktop machine. E-Business Suite screens are
designed for data or transaction capture from users. If that method is stretched for automating data load, it cannot
prevent EBS dialog box error or warning messages from appearing. Once such a message occurs the automation
comes to a grinding halt until someone remedies/corrects the situation. Similar is the case with excel macro driven
tools. The tool should provide easy drag and drop data mapping.




COLLABORATE 12                                                                                           Page | 3
When people deploy applications on the private or public cloud, they expect the tools that go along also to follow
suit. That is for the ease of maintenance or zero maintenance from the end users point of view. Commercial
reasons such as renting the software tool as against purchasing also favors the tools to be cloud based or cloud
compatible. Especially suited are data migration into R12 projects which typically run for three to twelve months
for renting a data migration tool.

The tool should be future proof in ways such as support for Oracle Fusion Applications. The cost advantage of using
such tools as against in house written conversion programs is that when you upgrade to newer Oracle versions, the
vendor would keep pace and provide the software upgrade and there is no need for rewriting or modifying
conversion programs.


Conclusion
We have identified the direction in which data loading and data interfacing should be moving for best ROI, less
pain and more productivity. The qualities expected in the solutions have been enumerated.




COLLABORATE 12                                                                                        Page | 4

Mais conteúdo relacionado

Último

STORY OF SUSAN & JUDY - CEREBRAL PALSY.pptx
STORY OF SUSAN & JUDY - CEREBRAL PALSY.pptxSTORY OF SUSAN & JUDY - CEREBRAL PALSY.pptx
STORY OF SUSAN & JUDY - CEREBRAL PALSY.pptxsheenam bansal
 
Fireman Resume Strikuingly Text............................
Fireman Resume Strikuingly Text............................Fireman Resume Strikuingly Text............................
Fireman Resume Strikuingly Text............................calvinjamesmappala
 
10 Things That Will Shape the Future of Education.pdf
10 Things That Will Shape the Future of Education.pdf10 Things That Will Shape the Future of Education.pdf
10 Things That Will Shape the Future of Education.pdfEducationView
 
Moaaz Hassan El-Shayeb - Projects Portfolio
Moaaz Hassan El-Shayeb - Projects PortfolioMoaaz Hassan El-Shayeb - Projects Portfolio
Moaaz Hassan El-Shayeb - Projects Portfoliomoaaz el-shayeb
 
Audhina Nur Afifah Resume & Portofolio_2024.pdf
Audhina Nur Afifah Resume & Portofolio_2024.pdfAudhina Nur Afifah Resume & Portofolio_2024.pdf
Audhina Nur Afifah Resume & Portofolio_2024.pdfaudhinafh1
 
Blockchain_TezosDeveloperCommunitySNSCE.pdf
Blockchain_TezosDeveloperCommunitySNSCE.pdfBlockchain_TezosDeveloperCommunitySNSCE.pdf
Blockchain_TezosDeveloperCommunitySNSCE.pdfVISHNURAJSSNSCEAD
 
Chapter-4 Introduction to Global Distributions System and Computerized Reserv...
Chapter-4 Introduction to Global Distributions System and Computerized Reserv...Chapter-4 Introduction to Global Distributions System and Computerized Reserv...
Chapter-4 Introduction to Global Distributions System and Computerized Reserv...Md Shaifullar Rabbi
 
wealth_spend_bharatpeVerse_Analysis .pptx
wealth_spend_bharatpeVerse_Analysis .pptxwealth_spend_bharatpeVerse_Analysis .pptx
wealth_spend_bharatpeVerse_Analysis .pptxAnuragBhakuni4
 
ASDFSDFASDFASDFASDFOUIASHDFOIASUD FOIJSADO;IFJOISADJF
ASDFSDFASDFASDFASDFOUIASHDFOIASUD FOIJSADO;IFJOISADJFASDFSDFASDFASDFASDFOUIASHDFOIASUD FOIJSADO;IFJOISADJF
ASDFSDFASDFASDFASDFOUIASHDFOIASUD FOIJSADO;IFJOISADJFJulia Kaye
 
kids gpaddfghtggvgghhhuuuuuhhhgggggy.pptx
kids gpaddfghtggvgghhhuuuuuhhhgggggy.pptxkids gpaddfghtggvgghhhuuuuuhhhgggggy.pptx
kids gpaddfghtggvgghhhuuuuuhhhgggggy.pptxJagrutiSononee
 
reStartEvents March 28th TS/SCI & Above Employer Directory.pdf
reStartEvents March 28th TS/SCI & Above Employer Directory.pdfreStartEvents March 28th TS/SCI & Above Employer Directory.pdf
reStartEvents March 28th TS/SCI & Above Employer Directory.pdfKen Fuller
 
Chapter-1 IATA, UFTAA, ICAO, FAA, CAA, ATAB, Conventions
Chapter-1 IATA, UFTAA, ICAO, FAA, CAA, ATAB, ConventionsChapter-1 IATA, UFTAA, ICAO, FAA, CAA, ATAB, Conventions
Chapter-1 IATA, UFTAA, ICAO, FAA, CAA, ATAB, ConventionsMd Shaifullar Rabbi
 
How to Host a Successful Webinar for Success?
How to Host a Successful Webinar for Success?How to Host a Successful Webinar for Success?
How to Host a Successful Webinar for Success?StrengthsTheatre
 
Nashon Holloway - Media/Press Kit - Priv
Nashon Holloway - Media/Press Kit - PrivNashon Holloway - Media/Press Kit - Priv
Nashon Holloway - Media/Press Kit - PrivNashonHolloway
 
FAHAD HASSAN NOOR || UCP Business School Data Analytics Head Recommended | MB...
FAHAD HASSAN NOOR || UCP Business School Data Analytics Head Recommended | MB...FAHAD HASSAN NOOR || UCP Business School Data Analytics Head Recommended | MB...
FAHAD HASSAN NOOR || UCP Business School Data Analytics Head Recommended | MB...FaHaD .H. NooR
 
127. Reviewer Certificate in BP International
127. Reviewer Certificate in BP International127. Reviewer Certificate in BP International
127. Reviewer Certificate in BP InternationalManu Mitra
 
asdfasdiofujasloidfoia nslkflsdkaf jljffs
asdfasdiofujasloidfoia nslkflsdkaf jljffsasdfasdiofujasloidfoia nslkflsdkaf jljffs
asdfasdiofujasloidfoia nslkflsdkaf jljffsJulia Kaye
 

Último (17)

STORY OF SUSAN & JUDY - CEREBRAL PALSY.pptx
STORY OF SUSAN & JUDY - CEREBRAL PALSY.pptxSTORY OF SUSAN & JUDY - CEREBRAL PALSY.pptx
STORY OF SUSAN & JUDY - CEREBRAL PALSY.pptx
 
Fireman Resume Strikuingly Text............................
Fireman Resume Strikuingly Text............................Fireman Resume Strikuingly Text............................
Fireman Resume Strikuingly Text............................
 
10 Things That Will Shape the Future of Education.pdf
10 Things That Will Shape the Future of Education.pdf10 Things That Will Shape the Future of Education.pdf
10 Things That Will Shape the Future of Education.pdf
 
Moaaz Hassan El-Shayeb - Projects Portfolio
Moaaz Hassan El-Shayeb - Projects PortfolioMoaaz Hassan El-Shayeb - Projects Portfolio
Moaaz Hassan El-Shayeb - Projects Portfolio
 
Audhina Nur Afifah Resume & Portofolio_2024.pdf
Audhina Nur Afifah Resume & Portofolio_2024.pdfAudhina Nur Afifah Resume & Portofolio_2024.pdf
Audhina Nur Afifah Resume & Portofolio_2024.pdf
 
Blockchain_TezosDeveloperCommunitySNSCE.pdf
Blockchain_TezosDeveloperCommunitySNSCE.pdfBlockchain_TezosDeveloperCommunitySNSCE.pdf
Blockchain_TezosDeveloperCommunitySNSCE.pdf
 
Chapter-4 Introduction to Global Distributions System and Computerized Reserv...
Chapter-4 Introduction to Global Distributions System and Computerized Reserv...Chapter-4 Introduction to Global Distributions System and Computerized Reserv...
Chapter-4 Introduction to Global Distributions System and Computerized Reserv...
 
wealth_spend_bharatpeVerse_Analysis .pptx
wealth_spend_bharatpeVerse_Analysis .pptxwealth_spend_bharatpeVerse_Analysis .pptx
wealth_spend_bharatpeVerse_Analysis .pptx
 
ASDFSDFASDFASDFASDFOUIASHDFOIASUD FOIJSADO;IFJOISADJF
ASDFSDFASDFASDFASDFOUIASHDFOIASUD FOIJSADO;IFJOISADJFASDFSDFASDFASDFASDFOUIASHDFOIASUD FOIJSADO;IFJOISADJF
ASDFSDFASDFASDFASDFOUIASHDFOIASUD FOIJSADO;IFJOISADJF
 
kids gpaddfghtggvgghhhuuuuuhhhgggggy.pptx
kids gpaddfghtggvgghhhuuuuuhhhgggggy.pptxkids gpaddfghtggvgghhhuuuuuhhhgggggy.pptx
kids gpaddfghtggvgghhhuuuuuhhhgggggy.pptx
 
reStartEvents March 28th TS/SCI & Above Employer Directory.pdf
reStartEvents March 28th TS/SCI & Above Employer Directory.pdfreStartEvents March 28th TS/SCI & Above Employer Directory.pdf
reStartEvents March 28th TS/SCI & Above Employer Directory.pdf
 
Chapter-1 IATA, UFTAA, ICAO, FAA, CAA, ATAB, Conventions
Chapter-1 IATA, UFTAA, ICAO, FAA, CAA, ATAB, ConventionsChapter-1 IATA, UFTAA, ICAO, FAA, CAA, ATAB, Conventions
Chapter-1 IATA, UFTAA, ICAO, FAA, CAA, ATAB, Conventions
 
How to Host a Successful Webinar for Success?
How to Host a Successful Webinar for Success?How to Host a Successful Webinar for Success?
How to Host a Successful Webinar for Success?
 
Nashon Holloway - Media/Press Kit - Priv
Nashon Holloway - Media/Press Kit - PrivNashon Holloway - Media/Press Kit - Priv
Nashon Holloway - Media/Press Kit - Priv
 
FAHAD HASSAN NOOR || UCP Business School Data Analytics Head Recommended | MB...
FAHAD HASSAN NOOR || UCP Business School Data Analytics Head Recommended | MB...FAHAD HASSAN NOOR || UCP Business School Data Analytics Head Recommended | MB...
FAHAD HASSAN NOOR || UCP Business School Data Analytics Head Recommended | MB...
 
127. Reviewer Certificate in BP International
127. Reviewer Certificate in BP International127. Reviewer Certificate in BP International
127. Reviewer Certificate in BP International
 
asdfasdiofujasloidfoia nslkflsdkaf jljffs
asdfasdiofujasloidfoia nslkflsdkaf jljffsasdfasdiofujasloidfoia nslkflsdkaf jljffs
asdfasdiofujasloidfoia nslkflsdkaf jljffs
 

Destaque

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 

Destaque (20)

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 

Collaborate 2012 - Elastic cloud is your data management solution ready

  • 1. Elastic Cloud: Is Your Data Management Solution Ready? Ganesan Rathinam Chain-Sys Corporation Austin Davis Chain-Sys Corporation Introduction With Elastic Cloud a reality for E business Suite, there is a need for a flexible approach to data management which works along with Oracle’s open interfaces for integration as well as traditional bulk data loading needs. This presentation will propose a flexible approach which can work across a corporate network or on the elastic cloud framework. The objectives are to give an overview of architectural approaches for traditional bulk data loading, present usage of web services to achieve integration and share strategies for data maintenance and cleansing. Flexible Computing Economics and Convenience demand flexible computing environment/resources. Before the advent of virtualization, IT departments had to buy the best and powerful (expensive) hardware that would meet the peak demand of the Business. Multi-tier computing and load balancing helps a lot to meet such peak loads. Much of the computing power that is in the enterprise stays idle and with minimal usage for long periods of time. (under utilization). Years ago in the batch job oriented mainframes era, that machine was worked to its full capacity round the clock. When you had spare capacity on that mainframe, you’d rent it to run batch jobs from other organizations. Virtualization Here multiple server machines are pooled together and the combined CPU power, RAM and disk capacities are made available for use by the Virtualization software. In Oracle virtualizations, you’d install Oracle VM Server on the raw machines and a single console control is made available by installing Oracle VM Manager. Server pool or pools can be created. The big pool can be used to create a one big massive virtual computing machine or you can create multiple guest machines with their own guest operating systems and networking capabilities. Virtualization is different from hosting servers in a data center. Cloud (Private and Public) Computing in such virtualized environments has another name: Cloud Computing. When all the nitty gritty details of virtualization and network management are done by in house IT staff, it is called a Private Cloud. When such management is done by a third party vendor, it is a Public Cloud. Amazon’s EC2 is an example of a public cloud. Oracle Public Cloud is another example. (cloud.oracle.com). I can host an application and make it available over the COLLABORATE 12 Page | 1
  • 2. web to customers. I can claim that the application is on the cloud, whether there is cloud computing going on behind the scenes or not. Anyways the end users are not given the task of managing servers and operating systems and they can think that they are working off the cloud (virtually speaking). Cloud is buzzword today. People love to ride it. Oracle E-Business Suite on Demand would not be strictly falling under cloud computing. Oracle provides hosting and other Application Management Services. Traditional EBS Data Load Process Input data has to be brought into an Oracle Staging table using PL/SQL or SQL*Loader Programs. Custom PLSQL programs have to be written to get the data from the Staging table to hit the Oracle E-Business Suite API’s and/or Interface tables. The custom program has to be registered as a concurrent program and the actual executables need to be migrated from Development to other instances manually. The program has to be invoked manually and maintained. Errors are sometimes returned in the return parameter, sometimes in a table. The error handling need to be handled in the programs and error correction is done offline on the Error Tables using SQL update scripts. Traditional EBS Data Interface Process Data Interfacing can be offline batch oriented, asynchronous near to real time oriented or online real time transaction oriented. Batch data extraction and/or loading can be accomplished traditionally with extraction/conversion programs as described in previous section. Writing/developing programs has always been time consuming, costly and resource intensive. Real time transaction handling is the domain of technologies, architectures and languages such as Oracle Service Oriented Architecture (SOA), Oracle Business Process Extension Language (BPEL), Oracle Process Integration Pack (PIPs), Oracle Application Integration Architecture (AIA), Oracle Enterprise Service Bus. Oracle iRepository has all the list of public API’s supported by Oracle in their EBS R12 applications ( http://irep.oracle.com or EBS Responsibility: Integration Repository). In house experts/architects/programmers or external consultants are called in to execute such interface solutions. Please refer http://www.oracle.com/fr/products/consulting/018856.pdf for information on PIP. Impact of EBS in Cloud Environment on Data Management Oracle E-Business suite Application Management Services are provided by Oracle Corporation or other third party companies that provide Oracle EBS on the cloud. Companies started implementing ERPs in the nineties, moving away from their custom operational softwares. They wanted to take advantage of BUY vs BUILD, industry best practices that come built into the ERP solutions, and to reduce the cost of maintaining applications. The next step has been to give away the responsibilities of maintaining ERP, server hardware and networking equipment. All the while companies have been keen on concentrating on their core businesses rather than big budget IT projects. Now Data Loading and Data Interfacing for Oracle E-Business Suite: Do companies want to architect, develop and maintain such programs or get them as a product or rent them off the cloud? When a product can be bought, building it would not make much sense, unless specific needs of business prevent such a move. Customers running enterprise applications off the cloud, want enterprise quality data load and data interface tools to work with their enterprise operational applications. They are acutely aware of the dynamics and challenges of developing such programs/tools and wisely choose best of class tools, preferably running in the cloud. The same applies to customers running enterprise applications in house. COLLABORATE 12 Page | 2
  • 3. Data Load, Interface Tools for EBS Data Management There are two kinds of data loading tools: The first kind more or less mimics keystrokes into an Oracle E-Business Suite form and thereby is like a fast secretary typing into the EBS forms. Many vendors offer loading through the front end GUI of Oracle EBS. The excel macros pump data into the various fields and hit SUBMIT for each record. The second acts not on the front end, but interacts more like a well written conversion program. People used to book conference hall for 3 or 4 days each month and a bank of 20 to 25 pc machines to run dataloader to load master or transactional data into the EBS instance. That used to be time and labor intensive even with the EBS instance sitting in the local LAN. The issue is, “Enterprise Applications need Enterprise quality data load tools”. EBS Data Load Tools in the Cloud Environment How about a hub and spoke model? A “NOT FRONT END” loading engine with templates (adapters) for the various API’s and Interface tables, kept at the hub. And pointing spokes (connectivity) to various Oracle EBS instances, on the cloud or otherwise. With a powerful server at the hub and with multithreading capabilities, all data loading should happen in minutes and hours instead of days together. Another attribute required of an enterprise quality load solution: “No babysitting”. The very idea of Computer was to take away work from us, humans. The computer is the one that is supposed to slog. We’d intervene. Well at the right time with right inputs based on classy reports. The boss can be productive only if the secretary does her job well, gives a good report and highlights areas needing attention and feedback. Characteristics of right data management tool for EBS in Cloud or otherwise The data load tool should have connect and load capability. It should be deployed in a server and be accessible from anywhere and should be able to load date into any one of many Oracle E-Business Suite instances. This is the “Hub and Spoke” model. Data load should be available and used as a Service. Having multiple EBS instances should not lead to maintenance effort multiplied. The software should scale to loading of million+ records without having the need of manual intervention. Error handling should be robust and handled in a uniform and structured fashion. While doing data load or data interface the tool should not violate any of Oracle EBS’ security measures. Capabilities should exist for an administrator to trace who loaded this transaction and at what time (Audit Trail). The centralized data loading tool should be self documenting the processes and provide control across the organization with respect to data loading or interfacing. The system should have Data Extraction as an In-Built Solution. Easy capabilities for Data Cleansing, Transformation, Pre-validations should be provided. Templates for loading/interfacing have to be available. The data load/interfacing solution has to be a thin client solution. The enterprise job cannot be entrusted to the desktop machine. Moreover when the tasks are accomplished at a centralized server, the organization has more control and accountability for the operations performed. Keyboard emulation and screen filling solutions are so fraught with the limitations on throughput and the vagaries of the desktop machine. E-Business Suite screens are designed for data or transaction capture from users. If that method is stretched for automating data load, it cannot prevent EBS dialog box error or warning messages from appearing. Once such a message occurs the automation comes to a grinding halt until someone remedies/corrects the situation. Similar is the case with excel macro driven tools. The tool should provide easy drag and drop data mapping. COLLABORATE 12 Page | 3
  • 4. When people deploy applications on the private or public cloud, they expect the tools that go along also to follow suit. That is for the ease of maintenance or zero maintenance from the end users point of view. Commercial reasons such as renting the software tool as against purchasing also favors the tools to be cloud based or cloud compatible. Especially suited are data migration into R12 projects which typically run for three to twelve months for renting a data migration tool. The tool should be future proof in ways such as support for Oracle Fusion Applications. The cost advantage of using such tools as against in house written conversion programs is that when you upgrade to newer Oracle versions, the vendor would keep pace and provide the software upgrade and there is no need for rewriting or modifying conversion programs. Conclusion We have identified the direction in which data loading and data interfacing should be moving for best ROI, less pain and more productivity. The qualities expected in the solutions have been enumerated. COLLABORATE 12 Page | 4