GoldenGate and Stream Processing with Special Guest Rakuten

1
Oracle GoldenGate Roadmap
Session: PRO4840
Speakers
Jeff Pollock, Vice President, Products, Oracle
Yusuke Yoshinaga, Rakuten Senior Manager, Travel & Leisure Platform
Haekyung Won, Database Management, Rakuten
Copyright © 2019 Oracle and/or its affiliates.
Featured Customer:

The following is intended to outline our general product direction. It is intended for information purposes
only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code,
or functionality, and should not be relied upon in making purchasing decisions. The development,
release, timing, and pricing of any features or functionality described for Oracle’s products may change
and remains at the sole discretion of Oracle Corporation.
Statements in this presentation relating to Oracle’s future plans, expectations, beliefs, intentions and
prospects are “forward-looking statements” and are subject to material risks and uncertainties. A detailed
discussion of these factors and other risks that affect our business is contained in Oracle’s Securities and
Exchange Commission (SEC) filings, including our most recent reports on Form 10-K and Form 10-Q
under the heading “Risk Factors.” These filings are available on the SEC’s website or on Oracle’s website
at http://www.oracle.com/investor. All information in this presentation is current as of September 2019
and Oracle undertakes no duty to update any statement in light of new information or future events.
Safe Harbor

GoldenGate Introduction and Background
Innovation and Market Drivers for GoldenGate Roadmap
Case Study: Rakuten Travel Big Data Solution with GoldenGate
GoldenGate Roadmap for the Future
For More Information…

More than 20 Years of Innovation
1000’S OF CUSTOMERS GLOBALLY
1990’s – Database HA/DR
2000’s – OLTP Replication
2010 – Data Warehouse
2015 – Data Lake
& Cloud
KEY USE CASES
& GROWTH PHASES:
http://www.oracle.com/us/products/middleware/data-
integration/oracle-goldengate-innovations-wp-5093027.pdf

Why Does GoldenGate Still Grow?
Faster Data Access, Not Slower
More Data Availability, Not Less
Less Centralized, Not More
Low Impact on Apps, Not High
What Data-Driven Enterprises Want: Key Constraint w/IT Orgs: Solution:
For 30+ years the
dominant form of
data movement in
the enterprise has
been batch
processing of
databases (ETL)
and files (FTP)
Not, “more batch
processing…”
High Fidelity Events, Not Low

GoldenGate Platform Capabilities
Data Replication Data Lake Pipelines Stream Analytics
Data High Availability
• Oracle/Non-Oracle DB
• Low Downtime Migrations
Transaction Replication
• OLTP/Reference Data
Data Warehouse Loading
• Non-invasive Capture
• Realtime Staging
Data Lake Ingest
• High Fidelity Change Stream
• Event-driven Realtime
Pre-Processing
• Filter, Correlate, Enrich
Data Transformations
• Streaming ETL Ops: Query,
Aggregate, Lookup, etc.
Data Operations (DataOps)
• Low code development, iterate
and work with production data
Advanced Analytics
• Time Series Analysis, Machine
Learning, Geo-Spatial
Dashboards
• Active graphs and charts

For Oracle Cloud Databases
Real-time Data
Transactions & Events
Virtual Machine
Database Cloud Service
Bare Metal
Database Cloud Service
Exadata Cloud Service
Autonomous DB Cloud Service

For the Whole Enterprise
Real-time Data
Transactions & Events
Streaming and DataOps
ETL
&ML
DBMS
Cloud
Big Data
NoSQL
Streams
Object
Storage

Industry Forces Influencing GoldenGate Roadmap
5G Networks
Edge
Computing
Service
Mesh
IoT &
Stream
Processing
CloudOracle
Database
HA &
DR
Data
Operations
(DataOps)
Data Lake
Analytics &
Data Science

Oracle Corporate Key Drivers and Priorities for GoldenGate Roadmap
Cloud: leverage
GG to bring data
to OCI and also
move GG to the
cloud as a cloud
native service
Oracle DB:
continued
investment to
keep GG best for
Oracle
HA & DR: keep
GG best-in-class
for low downtime
operations and
data migrations
1 2 3

Trillion $ Market Forces on GoldenGate Roadmap
Streaming
DATA
Service
MESH
K8S
5G
Networks

Business Relevance
“Service Mesh: Get Ready -- It's
Coming [..] it’s about to explode in
popularity as a way to tame the
wild west of microservices”
- Forbes -
“By 2025, 25 Billion connected devices
and more than $1.1 Trillion in IoT
revenue opportunity”
- GSMA IoT Report -
“Low-latency streaming platforms
[…] are becoming as fundamental
to enterprise data infrastructures
as relational data architectures
have been since the 1970s.”
- Wikibon Big Data -
“By 2025, 25 Billion connected
devices and more than $1.1
Trillion in IoT revenue
opportunity”
- GSMA IoT Report -
“By 2021, 5G’s broad enablement
of IoT use cases will drive 70% of
G2000 companies to spend $1.2
billion on connectivity
management solutions”
- IDC FutureScape
“By 2025, 20% of us could be using
10 times as much data as we
currently do”
- Ericsson –
(survey across 22 countries)

Where does GoldenGate fit?
Stream
Analytics
Data
Replication
Data Lake
Pipelines
Source: https://www.idg.com/blog/living-on-the-edge-how-edge-computing-is-redefining-the-network-landscape/

MPP Data ProcessingRaw Data
The Future, Right Now
GG Database
Replication
Open
Source
Stream
Analytics
GG for Big
Data Lakes
Oracle Streaming
Service (OSS)
ETL
Filter
Aggregate
Transform
Correlate/Enrich
Geo-fence
Thresholds
Business Rules
Data Policies
Queries
Time Series
Spatial Analytics
Data Patterns
Anomalies
Classification
Clustering
Statistical Inference
Regression Models
Messages,
Events & Alerts
Analytics
Data
{rest}
Data
Lake
LOW CODE HIGH SPEED LOW LATENCY DATAOPS

Rakuten Travel New Search Platform with GoldenGate for
Bigdata
September 16, 2019
Yusuke Yoshinaga (Sr. Mgr) / Haekyung Won (DBA)
Travel & Leisure Platform Department
Commerce Company
Rakuten, Inc.

20
About Rakuten
https://global.rakuten.com/corp/about/
Rakuten (2019.09.02)

21
About Rakuten Travel
Rakuten Travel (2019.09.02) https://travel.raku

22
✓ High Availability
✓ Reasonable Cost
✓ Scalability
Challenges for Database Management

23
Search operation by users 50%
Read Access from providers 30%
Transactions 20%
Almost search operation (SELECT query) more than 80%
Master DB
(Exadata)
Problem we faced..

24
Kafka Cluster
NoSQL (OSS)
New Search Datastore
User SearchTo divide the Search operation
Visualize and Monitoring
Real time
Replication
GoldenGate for Bigdata
Master DB
(Exadata)
Solution
Visualize and Monitoring

25
As a result
✓ DB load reduction (50%)
✓ Cost reduction
✓ High maintainability
Benefits we achieved..

26
For Analytic Data Platform
Golden Gate
Hadoop
Kafka & Nifi
Unified
Data
Architecture
DWH
Data Analytics
To support of real time data replication for Analytics platform.
GoldenGate for BigdataMaster DB
(Exadata)
Future Plan

Continued Investment
12.2
12.3
18c
19c
11g
Microservices
Architecture
Cloud
Marketplace
Deployments
OGG for
Big Data
GoldenGate 12.2
• Big Data Delivery
• Meta Data in Trail
• Automated Heartbeat Table
• Parameter File Validation
• Oracle Data Pump
Integration
GoldenGate 12.3
• Oracle Database 12.2
• Microservices Architecture
• Parallel Replicat
• Auto CDR
• Sharding Support
• Procedural Replication
GoldenGate 18.1
• Oracle Database 18c
• Delivery to ADW and ATP
• Identity Column Support
• In-Row Database Archival
support
GoldenGate 19.1
• Oracle Database 19c
• Microservices Security
Enhancements
• Cross Endian Remote
Capture for Oracle
• Easier Upgrades
Stream
Analytics

Rock Solid Microservices Architecture
30
Trail Files
Administration
Service
Metrics
Service
Service
Manager
>REST
Parallel
Replicat
Integrated Remote
Capture
network
DBA/Ops Proxy/Reverse Proxy API Automation
Micro-services Mid-Tier
* Oracle recommends to use Integrated Remote Capture, Micro-Services and Parallel Replicat
Distribution
Service
Receiver
Service
Shared
Storage

31
Performance and Scalability Improvements
Improved performance and scalability for Parallel Replicat.
Remote integrated capture performance tolerates high latency networks.
Security and Manageability Enhancements for Microservices
Integration with Key Management Systems, Support for DMZ environments.
Defaults changed to TLS1.2, Digest Auth, Strong Password Verifier
Managed profiles for AutoStart, AutoRestart, and Key Management.
Ease of use
Simplified software upgrade procedures. Enhanced heartbeats to simplify system recovery. Simplify mid-
tier & cloud deployments with remote cross-endian Integrated Extract. Better smart defaults that
eliminate need to set parameters for common use cases
Support for Oracle Database 19.1
Long term support release. Final patchset update for Oracle GoldenGate 12.3 release.
Agent Free Migration to Cloud – OCI Marketplace Solution
Cross endian remote Integrated Extract allow remote capture of on-premise databases for easier
migration to the cloud
GoldenGate 19.1 New Feature Summary

GoldenGate Marketplace – 3 Steps to Productivity
Step 1: Search OCI Marketplace Step 3: Run GG Web AppsStep 2: Provision GoldenGate on OCI
Navigate to
https://cloudmarketplace.oracle.
com/marketplace/en_US/listing/
58489224 Choose “Launch App” and click
through ~4 pages of forms
(existing OCI account is
required)
Access GoldenGate
Microservices (Web Apps) from
public IP Address given via OCI
confirmation page
FREE Promo Now!

Stream Analytics Marketplace
OCI Marketplace
GG Database
Replication
Open
Source
Stream
Analytics
GG for
Big Data
OCI Compute (any shape)
OCI Block Store
Trail
File
Kafka
Topics
MySQL
Store
Messages,
Events & Alerts
Analytics
Data
{rest}
Data
Lake
LOW LATENCY HIGH SPEED LOW CODE DATAOPS

34
GoldenGate 20c and 21c Roadmap
Ooops!
Had be there at the session ☺

Managed GoldenGate Service
GoldenGate for OCI Marketplace GoldenGate Service (GGS)
• Automated provisioning (via Terraform)
• Customer managed software, runs on customer
managed OCI Compute & Storage
• Choose from 5 listings: GG Microservices, GG
Classic, GG for Big Data, GG for Non-Oracle, or
GG for Mainframe
• Bring your own license
(Processor, Term, Named User,
Promotional…)
• OCI native service
(console-based, admin, monitoring, lifecycle, patching etc)
• Oracle managed software
(multi-tenant control plane, secure encryption keys and Trail
Files deployed in customer tenancy)
• Single, integrated customer experience for all
aspects of GoldenGate functionality
• Universal Cloud Credits

GoldenGate Service Key Use Cases
GoldenGate Service GoldenGate Service GoldenGate Service
sync
Database
Use Cases
Data Lake
Use Cases
HA/DR, Active-Active, Multi-Master,
Zero-Downtime, DB Migrations
Replicate transactions, data and
DB events across OLTP DBs
Trickle feed, load and stage data
into Data Warehouse tables
Streaming data ingestion to Object
Storage, Hadoop, Kafka etc.
Transform and process any data
as it in arrives in the Stream
Apply machine learning, geo-
spatial and advanced rules
GoldenGate Service GoldenGate Service GoldenGate Service
ETL
Pipeline AI/MLIoT Time Series
push
down

38
What’s Ahead
Tuesday
11:15 – 12:00
3:15 – 4:00
Oracle GoldenGate: Heterogeneous
Product Suite: New Features and Best
Practices Moscone South Room 213
Oracle GoldenGate: Auto Conflict
Detection and Resolution for Active-
Active Replication Moscone South
Room 213
Wednesday
9:00 – 9:45
3:45 – 4:30
Oracle GoldenGate: Best Practices for
Highly Available Off-Box and Hub
Configurations Moscone South Room 212
Oracle GoldenGate for Big Data: Create
Streaming Pipelines for Business Insight
Moscone South Room 212

39
What’s Ahead
Thursday
12:15 – 1:00 Oracle GoldenGate: Securing
Microservices and Configuration Using
Rest APIs Moscone South Room 212
GoldenGate Hands On Labs
Monday
2:30 - 3:30
Tuesday
12:45 – 1:45
Wednesday
12:00 – 1:00
Thursday
10:30 – 11:30
Faster Deployments Using Oracle
GoldenGate Microservices
Daily Sessions in Moscone West Room
3023
Arrive early as space is limited

The preceding is intended to outline our general product direction. It is intended for information purposes
only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code,
or functionality, and should not be relied upon in making purchasing decisions. The development,
release, timing, and pricing of any features or functionality described for Oracle’s products may change
and remains at the sole discretion of Oracle Corporation.
Statements in this presentation relating to Oracle’s future plans, expectations, beliefs, intentions and
prospects are “forward-looking statements” and are subject to material risks and uncertainties. A detailed
discussion of these factors and other risks that affect our business is contained in Oracle’s Securities and
Exchange Commission (SEC) filings, including our most recent reports on Form 10-K and Form 10-Q
under the heading “Risk Factors.” These filings are available on the SEC’s website or on Oracle’s website
at http://www.oracle.com/investor. All information in this presentation is current as of September
2019 and Oracle undertakes no duty to update any statement in light of new information or future events.
Safe Harbor

GoldenGate and Stream Processing with Special Guest Rakuten

GoldenGate and Stream Processing with Special Guest Rakuten

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to GoldenGate and Stream Processing with Special Guest Rakuten

Similar to GoldenGate and Stream Processing with Special Guest Rakuten (20)

More from Jeffrey T. Pollock

More from Jeffrey T. Pollock (20)

Recently uploaded

Recently uploaded (20)

GoldenGate and Stream Processing with Special Guest Rakuten