- Mark Rittman presented on deploying full OBIEE systems to Oracle Cloud. This involves migrating the data warehouse to Oracle Database Cloud Service, updating the RPD to connect to the cloud database, and uploading the RPD to Oracle BI Cloud Service. Using the wider Oracle PaaS ecosystem allows hosting a full BI platform in the cloud.
2. info@rittmanmead.com www.rittmanmead.com @rittmanmead
About the Speaker
• Mark Rittman, Co-Founder of Rittman Mead
- Oracle ACE Director, specialising in Oracle BI&DW
- 14 Years Experience with Oracle Technology
- Regular columnist for Oracle Magazine
• Author of two Oracle Press Oracle BI books
- Oracle Business Intelligence Developers Guide
- Oracle Exalytics Revealed
- Writer for Rittman Mead Blog :
http://www.rittmanmead.com/blog
• Email : mark.rittman@rittmanmead.com
• Twitter : @markrittman
2
3. info@rittmanmead.com www.rittmanmead.com @rittmanmead
About Rittman Mead
3
• World’s leading specialist partner for technical
excellence, solutions delivery and innovation in
Oracle Data Integration, Business Intelligence,
Analytics and Big Data
• Providing our customers targeted expertise; we are a
company that doesn’t try to do everything… only
what we excel at
• 70+ consultants worldwide including 1 Oracle ACE
Director and 3 Oracle ACEs
• Founded on the values of collaboration, learning,
integrity and getting things done
Optimizing your investment in Oracle Business Analytics
• Comprehensive service portfolio designed to
support the full lifecycle of any analytics solution
4. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Rittman Mead Sessions
4
No Big Data Hacking—Time for a Complete ETL
Solution with Oracle Data Integrator 12c
[UGF5827]
Jérôme Françoisse | Sunday, Oct 25, 8:00am |
Moscone South 301
Empowering Users: Oracle Business Intelligence
Enterprise Edition 12c Visual Analyzer [UGF5481]
Edelweiss Kammermann | Sunday, Oct 25, 10:00am
| Moscone West 3011
A Walk Through the Kimball ETL Subsystems
with Oracle Data Integration Solutions [UGF6311]
Michael Rainey | Sunday, Oct 25, 12:00pm |
Moscone South 301
Oracle Business Intelligence Cloud Service—
Moving Your Complete BI Platform to the Cloud
[UGF4906]
Mark Rittman | Sunday, Oct 25, 2:30pm | Moscone
South 301
Oracle Data Integration Product Family: a
Cornerstone for Big Data [CON9609]
Mark Rittman | Wednesday, Oct 28, 12:15pm |
Moscone West 2022
Developer Best Practices for Oracle Data
Integrator Lifecycle Management [CON9611]
Jérôme Françoisse | Thursday, Oct 29, 2:30 pm |
Moscone West 2022
5. info@rittmanmead.com www.rittmanmead.com @rittmanmead
User Engagement
5
Visual Redesign Business User Training
Ongoing SupportEngagement Toolkit
Average user adoption for BI
platforms is below 25%
Rittman Mead’s User Engagement Service can help
6. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Oracle BI Cloud Service - What Is It?
• Oracle Business Intelligence, re-imagined for the cloud
• Runs as part of Oracle Public Cloud, part of wider Oracle Platform-as-a-Service
• Pay monthly, min 10 users, rolling upgrades and new features
• Entirely thin-client, simplified administration
• Aimed at departmental use-cases
- Sharing data from a spreadsheet
- Team reporting
- Development sandboxes
6
8. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Regular Updates & Previews of On-Premise Functionality
• BICS has had multiple updates since v1 launch, automatically added by Oracle
- Significant real-world benefit for customers - no-more big-bang upgrades
• Adding on-premise functionality missing in v1 (mapping for example)
• Filling out functionality e.g. Data Sync tool
• Early access to on-premise features
- Visual Analyzer
- Data Mashups
8
9. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Early Access to Oracle Visual Analyzer
• Tableau-style data analysis tool aimed at
data analysts and self-service users
• Point-and-click exploration and
visualisation of datasets
• Uses BI Repository as data source,
ensuring “single-version-of-the-truth”
- Users can also add their own data, “for data
mashups”
• Coming in next 12 mths with OBIEE12c,
but available now in BICS
9
10. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Early Access to Data Mashups in Answers
• Allows users to upload their own
datasets to join to existing analysis
• Aimed at users who would otherwise
export to Excel
• User-supplied attributes and metrics
clearly marked in catalog
• Enables more self-service, users
doing “last mile” in reporting
• Coming in OBIEE12c,
but previewed in BICS now
10
11. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Thin-Client Data Modeller for Simple RPD Modelling
• New thin-client data modeller, works with RPD online
• Single repository per tenant
• Regular RPD, but modeller only supports
subset of BI Administration features
- Single LTS per logical table
- No Alias, have to create DB views
- Single business model
- Only logical calculations
- But otherwise - an RPD
11
12. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Oracle Database Schema Provided with BICS
•Each instance of BICS comes with Oracle Schema Cloud Service
•ApEx environment with 10GB storage attached
•Able to run PL/SQL packages (with 5m timeout)
•Either create tables, views etc from ApEX,
or use data uploader in BICS
12
Click to launch
ApEX Home Page
13. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Oracle BICS Initial Use-Case : Departmental Reporting
• Oracle BI Cloud Service in initial, standalone form aimed at departmental
reporting
- 50GB storage in single schema, limited ETL access
- Single subject area and limited RPD features
• Other common use-cases include
- Development environments
- Spin-off data discovery sandboxes
- Dedicated SaaS reporting applications
• But … part of wider Oracle Cloud platform
- Can we use that to host a whole BI system?
13
14. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Wider Oracle Public Cloud PaaS Ecosystem
• Similar to other public cloud services (AWS, Azure etc) at IaaS layer
• But with platform (PaaS) and software (SaaS) layers as differentiator
• Can we use Database, Storage and other layers to host full OBIEE platform?
- And what about ETL, identity management, file storage and so on?
14
15. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Hosting Full OBIEE Platforms in Oracle Public Cloud
• Leverages BICS’s new “Upload RPD Data
Models to the Cloud” feature
- Migrate supporting DW to full Oracle DBaaS
- Update on-prem RPD to connect to DBaaS
- Upload RPD to BICS
• Create new Oracle Cloud users for BICS
• ETL can connect via SQL*Net, JDBC etc
• Use for wider use-cases than BICS incl.
- Host full production platform (or test, dev)
- Create development branches, etc
15
Oracle BICS
Oracle DBaaS
RPD
Upload
ETL ToolsBI Administration On-Premise Source DB
Data Uploads
via SQL*Net
16. info@rittmanmead.com www.rittmanmead.com @rittmanmead
BICS Upload RPD to Cloud Key Steps
1. Make sure on-premise data model is consistent, no errors etc
2. Create DBaas Instance, Upload on-premise database to cloud
3. Update RPD Connection Pool settings to point to DBaaS instance
4. Recreate any user accounts, application roles etc
5. Create new dashboards and reports
16
17. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Example Migration : Full OBIEE11g SampleApp v406
• OBIEE11g SampleApp v506 - based on 11.1.1.9 release and delivered on VM
• Comes with Oracle 12c Database with multiple schemas, MVs, partitioning etc
- Also uses Essbase, Hadoop etc but out of scope for this exercise
• Objective is to migrate OBIEE, DW database and security elements
- Verify that ODI can still connect and load DW in Oracle Cloud
- Look at options for additional DB sources,
Essbase, Hadoop sources etc
17
18. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Creating a Full Database Instance in Oracle DBaaS
• Initial step is to create an Oracle Database Cloud Service Instance
• Options for 11g or 12c Release Database, High / Extreme Performance Options
- Determines scope of DB features available (OLAP, partitioning etc)
2
1
2
19. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Oracle Database Cloud Service Connectivity / Configuration
• Database runs in a VM, has Listener and other processes running
• Database parameters can be altered, but DB Options set by DBaaS version
- OLAP, Partitioning Options not present may affect DB uploads
• Ports blocked by default, need to be opened for SQL*Net etc access
19
20. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Managing and Monitoring Database Cloud Service
• Oracle Enterprise Manager Database Express 12c for DBA tasks
- Features determined by DBaaS edition
(regular, High or Extreme Performance)
• Virtualised Cloud Hosting monitored by
Oracle DBaaS Monitor
- RDBMS storage, alerts, processes etc
- OS-level monitoring
- Listener
- Backups etc
20
23. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Configuring On-Premise RPD to Connect to DBaaS
• Update Connection Pool settings in on-prem RPD before upload to BICS
- Note : DBaaS instance must be in same datacenter as BICS
• Note - No need to change overall DB connection setting in BICS Console
23
24. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Steps to Upload RPD to BI Cloud Service
• Backup (snapshot) current BICS environment if required
• Select Snapshots > Replace Data Model
• Use Browse button to select RPD from desktop, then upload to BICS
24
25. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Additional BICS Capabilities when using Uploaded RPD
• Allows multiple subject areas vs. single one in standard BICS
• Multiple DBaaS instances can be mapped into RPD for federated queries
• Full access to RPD features - vertical/horizontal federation etc
• Data Mashups also available (but not VA)
25
26. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Additional Post Upload Configuration : Mapping
• Mapping is now available in BICS, requires further Administrator configuration
• Single map provider (OracleMaps) with set of associated layers
• As with on-premise, map layers then need to be linked to subject area columns
26
1
2
3
27. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Configuring Security and Recreating Users, Roles
• On-premise users need to have corresponding new account created in BICS
- Also creates an Oracle Cloud login for BICS identity domain - separate to OTN login
• BICS licensed per user, min is 10 per pod with test and prod instances
• Application roles also need to be recreated and users added
27
1
2
3
28. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Row-level Security Within RPD
• Row-level security works properly within BICS and uploaded RPDs
• Best practice is to base on application roles, recreate matching ones to proceed
• Regular and row-wise session variables then work as expected
28
29. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Limitations on BICS with RPD Upload vs On-Premise
• Can only access other DBaaS sources at present
- Presume integration with PBCS, Oracle Big Data Cloud Service, SaaS apps to come
- No ability at present to access Essbase, TT or other acceleration layers
• No further editing of the uploaded RPD - one-way only
• No way to upload the catalog to go with RPD - must recreate in cloud
• Further limitations that may possibly be lifted in the future
- Adding of HTML or Javascript to Analyses is disabled
- Some limitations around alternate sorts and other small issues
- Visual Analyser not available yet (multiple subject area issue?)
- No usage tracking (but see MOS Doc.ID 1965207.1)
29
30. info@rittmanmead.com www.rittmanmead.com @rittmanmead
What About ETL and Data Integration?
• How do we continue to keep loading new data into BI platform DBaaS DW?
- BICS can currently only access Oracle DB or schemas running in Oracle Cloud
- Some datasources for BI platform likely to still be on-premise
- Others might migrate from on-prem to Oracle Cloud, or be SaaS apps in cloud
• BICS by default comes with options for loading its DB schema via REST API
- Data Sync for on-prem/cloud table sync
- SFTP and other techniques
• What other options
does DBaaS give us?
31. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Running ODI On-Premise for On-Prem/Cloud
• ODI12c can continue to load into DW through Oracle DBaaS SQL*Net support
- Connect normally to DBaaS via JDBC, or through SSH tunnel
- Extract from on-premise sources,
load into DBaaS as normal DB target
- Additional KMs for BICS integration,
Oracle Storage Cloud Service
- Adapters for Oracle SaaS apps,
Salesforce etc
- Zero impact on daily ETL tasks, but
need to consider upload speeds etc
31
32. info@rittmanmead.com www.rittmanmead.com @rittmanmead
New Option : Oracle Big Data Preparation Cloud Service
• Oracle Cloud-based Data Preparation Service, aimed at da
• Takes files and other datasets from Oracle Cloud and prepares for analysis
• Split, transform and obfuscate data before loading into Hadoop data platform
32
33. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Uses Machine-Learning to Automate Data Recommendations
• Uses Spark MLlib machine learning to
profile data and recognise patterns
• Automates many of the routine data
preparation and profiling work
- Spot credit card, SSN + other sensitive
data, recommends masking
- Suggest appropriate names, datatypes
for columns based on
format and data patterns
• Allows analyst to focus on key tasks
- Example of cloud app consumerization
33
34. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Cloud Datasource Integration & File Upload/Download
• Primary datasource and target is Oracle Storage Cloud Service (like Amazon S3)
- Oracle Big Data Cloud Service, Oracle DBaaS and others
• User can also upload / download files directly into Big Data Prep Service
34
36. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Orchestrate BDP > BICS Data Loading via ODI12c
• Possible now : Use of ODI to prepare individual files through BDP
• ODI on-premise used to automate file extracts and upload into Storage CS using its
REST APIs
• BDP picks up files available in
Storage CS and prepares them
• Prepared files are written back
into Storage CS
• Prepped files downloaded by ODI
from Storage CS, loaded into BICS
- On roadmap: BDP will be able to
load prepared data directly into BICS
36
37. info@rittmanmead.com www.rittmanmead.com @rittmanmead
So … Why Would I Want to Migrate My BI Platform to Cloud?
• Cost - although Oracle Cloud has costs, TCO can be cheaper than on-prem
- Factor in service management, upgrades, staff costs, managed service contracts etc
- Operational issues taken care of by Oracle, along with security compliance
• Pay for software + hosting monthly/user, out of OpEx
• Gives more agility around creating test, dev branch environments
37
38. info@rittmanmead.com www.rittmanmead.com @rittmanmead
Summary and Next Steps
• It’s now possible (mostly…) possible to migrate full OBIEE systems to cloud
• On-premise RPDs uploaded into BI Cloud Service + linked to DBaaS for DW
• ODI can still upload data from on-premise sources into DBaaS, or consider BDP
• Contact us at info@rittmanmead.com for more info, test drives, proof of
concepts - now!
38