3. Oracle High Availability Architecture
1. Scale-Out & Low-Cost
– High-volume hardware
– All components active
2. Application Oriented
– Protect and recover application objects
– Enable online application changes
3. Integrated & Simple
– Availability integrated into all components
– Automated
4. Complete & Open
– Handles all planned and unplanned downtime
– Pluggable components
3
4. Oracle’s Database HA
Server
Failures
Unplanned
Downtime Data
Failures
System
Changes
Planned Data
Downtime Changes
App
Changes
4
5. Best-of-Breed Server Protection
At Lowest Cost
Server Real Application
Failures
Unplanned Clusters (RAC)
Downtime Data
Failures
System
Changes
Planned Data
Downtime Changes
App
Changes
5
6. Real Application Clusters
HR SALES ERP
• Scale workloads across multiple low cost servers
• Consolidate into fewer servers and databases
• Runs all Oracle database applications
• Built-in HA
6
7. New in 11.2
RAC One Node
Virtualization Benefits for Oracle Databases
• A virtualized single instance database
– Omotion - live migration of instances
across servers
• Move services, then shutdown
transactional
– Built-in cluster failover for high availability
• Better than OS level virtualization
– Rolling database patches
– Manage fewer Operating Systems
• 10 DBs on a node does not mean 10
Operating Systems to manage
– Rolling OS upgrades
7
8. Best-of-Breed Data Failure Protection
At Lowest Cost
Human
Server Errors
Failures
Unplanned Flashback
Data
Downtime Data Corruptions RMAN
Failures Oracle Secure
Storage Backup
Failures
System ASM
Changes Site Data Guard
Planned Failures Streams
Data
Downtime Changes
App
Changes
8
9. Traditional
Flashback Technologies Recovery
80
Error Detection & Correction
60
Recovery Time
• Flashback revolutionizes error recovery 40
– View ‘good’ data as of a past point-in-time
– Simply rewind data changes
20
Flashback
– Time to correct error equals time to make error 0
Correction Time = Error Time + f(DB_SIZE)
• Low impact, easy – simple commands, no complex procedure
• Flashback Query, Table, Transaction, Database, Drop
• SQL> flashback database to <timestamp>;
• Enhancements in 11.2: New in 11.2
• Flashback database performance & monitoring optimizations
• Flashback archive support for schema evolution
9
11. New in 11.2
Multiple RMAN Compression Levels
More Cost Savings
• Backup compression: popular way to save
on storage
• Multiple RMAN backup compression levels
– Choose between compression levels & backup
throughput
• [BASIC] | HIGH | MEDIUM | LOW
11
12. Oracle Secure Backup
Enterprise Tape Backup Management
Oracle Enterprise
Manager
Tape Backup for
Oracle Secure Backup Oracle Environment
File System Data
Oracle Database • Built-in Oracle Integration
RMAN Integration • 25 – 40% faster than
leading competition
• 4X less expensive
Tape Virtual than comparable products
Library Tape
• Supports Oracle Database
Library
(VTL) 11g through Oracle9i
12
13. Oracle Secure Backup Cloud Module
Offsite Database Backups in the Cloud
Database Files /
Fast Recovery Area
RMAN
RMAN
Oracle Secure
Backup Cloud
Compression /
Module Amazon S3
Encryption
• Oracle Secure Backup Cloud module: Backup databases to Amazon
Cloud
– Complements local disk and/or tape backup
– Eliminates IT management overhead of a disaster recovery site
13
14. Automatic Storage Management (ASM)
Stores & Manages All Data
Database Application 3rd Party FS
ASM
Disk
Group
• ASM dynamic volume manager supports file systems
• ASM directly supports Clusterware files – Cluster Repository, Voting Disk
• Built-in mirroring protects from disk failures
• Enables auto-repair from corrupt blocks using a valid mirror copy
14
15. New in 11.2
ASM Cluster File System
Oracle Management of File System Data
• Manage both database & file system data
– E.g.: Oracle & Application binaries, trace
files, alert logs, BFILEs, image files, etc.
• Clustered or local file system
– Data stored in ASM
– Inherits all ASM manageability benefits
• Online disk add/drop/rebalance
• Integrated mirroring
• Cross-platform Shared File System
• Read-Only Snapshots
– Up to 63 point-in-time space efficient
copies of file system
• Linux and Windows only in first release
15
16. Active-Active Availability
Minimizing Downtime During Site Failures
Human
Server Errors
Failures
Unplanned
Data
Downtime Data Corruptions
Failures
Storage
Failures
Site Data Guard
Failures GoldenGate
Streams
16
17. Oracle Data Guard
Best Disaster Recovery Open R/O with
Dallas Physical
Standby Active Data Guard
Sync or Async
Redo Shipping
Production Redo
Database Apply
Network
Backup
DIGITAL DATA STORAGE
DIGITAL DATA STORAGE
Broker
Open R/W for
Logical peripheral writes
Transform Standby
Chicago Redo to SQL
SQL
Apply
Boston
17
18. New in 11.1
Active Data Guard
Offload Queries to Standby
Real-time
Queries
Concurrent
Real-Time
Continuous Redo Query
Shipment and Apply
Primary Physical
Database Standby
Database
• Queries on standby database concurrent with apply
• Available with Physical Standby in 11.1
– Handles all data types, very fast, operationally simple
• Eliminates cost of DR
– All hardware used for production load
18
19. New in 11.2
Oracle Active Data Guard
Read Scalability, with DR
Queries Scalable Reader • Up to 30 active
Farm standby databases
Queries
• Flexible options to
Updates
Queries scale read
performance
• Add more active
Queries standby databases
• Scale active standby
databases using
Production
Database Oracle RAC
19
20. New in 11.2
Oracle Active Data Guard
Auto Block Protection
• Automatically repair block corruptions online
• Primary repaired from standby and vice-versa
Read/Write Real-time
Workload Reporting
Primary Continuous redo shipping validation & apply Active Standby
Database Database
20
21. New in 11.1
Snapshot Standby
Test with Production Data Before Deployment
Physical Standby • Use Standby Database for testing
Apply Logs and development
– Eliminates cost of DR
– Justify full scale test and DR
Open Back out
environments by combining into one
Database Changes
• Preserves zero data loss while in
test/dev mode
Snapshot Standby – But no real time query or fast failover
Perform Testing • Similar to storage snapshots, but:
– Provides DR at the same time
Continuous Redo Shipping – Single copy of storage
21
22. New in 11.2
Oracle Data Guard
Better Application Availability
• Automate client failover with role-based services and FAN
Auto-start of
FAN
primary
enabled
database
JDBC
and OCI services
clients
Wide Area Network (ASYNC) Fast notification
of application
Primary clients
Database
Standby
New Primary
Database
22
23. New in 11.2
Oracle Active Data Guard
Ensure Service Levels for Query Latency
• Automatically enforce service levels for standby queries
• Query receives error if data delay exceeds SLA
• Applications can redirect query to primary
Read/Write Real-time
Workload Reporting
Primary Continuous redo shipping validation & apply Active Standby
Database Database
23
24. New in 11.2
Additional Data Type Support
Both Data Guard SQL Apply & Streams
• Additional Data Type support:
– Basic Table Compression
– OLTP Table Compression
– SecureFiles
• Without deduplication
– Online Table Redefinition
– Extended data type support for SDO_GEOMETRY (SQL Apply)
24
25. Comprehensive Data Guard Monitoring
Using Enterprise Manager 10g Release 5
• Critical Data Guard metrics reported on HA console
25
26. Oracle Streams
Built-in Oracle Database Replication Solution
Source Target
Database Database
Propagate
Redo Capture Apply1
Logs
Apply2
Transparent
• Active-active databases with automatic Gateway
conflict detection & optional resolution
Non-Oracle
• Provides HA for custom apps where update Database
conflicts can be avoided or managed
26
27. New in 11.2
XStream
Fast Real-Time Programmatic Access to Data Changes
• Extended Streams - XStream
– API for fast real-time access to changes in Oracle database
– Client attaches directly to Streams apply process using OCI/Java
– Outbound server (XStream Out)
• Stream changes out of the Oracle database
– Inbound server (XStream In)
XStream
• Stream changes from external
sources into an Oracle database
27
28. New in 11.2
Better Streams Performance
• Performance optimizations of uni-directional Streams extended
to one-to-many
• Faster transformations
– Statement DML Handlers
• Up to 4x faster than procedural DML handlers
– New Declarative Transformation - Keep Columns
• Extensive tuning throughout Streams
• Improved JMS integration and faster Streams Advanced
Queuing
– AQ dequeue is 30%-100% faster than previous releases
28
29. GoldenGate
• Best-in-class leader in real-time data solutions
• Continuous Availability for heterogeneous
systems
• Real-time data access for Reporting
• Real-time data for BI, EPM, Exadata
• Zero-downtime migrations / upgrades to Oracle
Database and Applications
Real-time
information • Over 400 customers with 4,000+ implementations
across Fortune 500 companies: Financial Services,
Communications, Healthcare, Public Sector, Retail &
Utilities industries
Real-time Access • Top 3 of 5 largest commercial banks
• Top 3 of 3 busiest ATM networks
• Top 7 of 10 financial data services companies
• Top 4 of 5 telecommunications providers
• Top 3 of 5 largest food & drug stores
29
30. GoldenGate for Heterogeneous Platforms
Databases O/S and Platforms
Capture: • Windows 2000, 2003, XP
Oracle • Linux
DB2 • Sun Solaris
Microsoft SQL Server • HP NonStop
Sybase ASE • HP-UX
Teradata • HP TRU64
Enscribe • HP OpenVMS
SQL/MP • IBM AIX
SQL/MX
• IBM z/OS
Delivery - all listed above, plus:
HP Neoview, Netezza, Greenplum, and
any ODBC compatible databases
ETL products
JMS message queues
MySQL
TimesTen
30
31. GoldenGate and Streams
Oracle GoldenGate Oracle Streams
• GoldenGate is Oracle’s strategic replication solution
• Streams continues to be a supported Oracle Database feature
• Best Streams technology will be integrated into GoldenGate
31
32. GoldenGate and Data Guard
Heterogeneous Oracle
Distributed Oracle Active Data
Fully-active GoldenGate Guard
Subset
Replicas
Oracle DB Primary Oracle DB Standby
• Information Distribution & Consolidation, Application Upgrades & Changes
– Use GoldenGate - heterogeneous, active-active, transformations, subsetting
• Disaster Recovery / Data Protection / HA
– Simple Full Oracle Database Protection
• Use Active Data Guard
• High-performance, simple, drop-in solution for HA and DR, readable at standby
• Works for all apps and data types, including packaged apps that can’t be changed
– Application desiring flexible HA, active-active, schema changes, platform changes
• Use GoldenGate
• Avoid or manage active-active conflicts at application level
• Combine the two for full database protection and information distribution
32
33. Best Online Planned Maintenance
At Lowest Cost
Server
Failures
Unplanned
Downtime Data
Failures
System Online Reconfiguration
Changes Rolling Upgrades
Planned Data Online Redefinition
Downtime Changes
App Edition-based
Changes Redefinition
33
34. Online Reconfiguration
Scaling on Demand
• Servers
– Add/Remove RAC nodes online
– No data movement needed
Database • Storage
– Add/Remove ASM disks or arrays online
– Automatically rebalance after storage change
Storage • Clusterware, ASM
– Upgrade Oracle Clusterware and ASM (11g)
in an online manner
34
35. Online Patching and Upgrades
• Most one-off patches can be applied to a running Oracle instance
– Linux-x86, Solaris 10, HP-UX 11i
– [New in 11.2] Windows 32-bit and Windows 64-bit, AIX v6.1 [TL2 SP1]
• More complex one-off patches can be deployed online using RAC
rolling patches (available 10g onwards)
• Database release/patchset upgrades, operating system upgrades,
platform migrations can be applied in rolling fashion using Data
Guard / GoldenGate / Streams
• Data Center moves / SAN migration / Technology Refresh etc.
can be done with minimal downtime using Data Guard /
GoldenGate / Streams
35
36. Online Index & Table Redefinition
• All index changes can be done online
– 11gR1 – table is never locked during online index creation
• Tables can be Reorganized & Redefined online
– Allows changing location, table type, partitioning, columns, column types
– Contents can be transformed as they are copied
Copy Transform
Source Table
Table Result
Table
Store
Continuous Update Updates
Queries & Tracking Transform
Updates Updates
36
37. New in 11.2
Edition-based Redefinition
Overview
• Enables online application patches and upgrades
• Allows old and new version of application to co-exist
even though schema is changed by new version
• Capabilities primarily used by application developers
37
38. New in 11.2
Edition-based Redefinition
How Does it Work?
Post-upgrade Edition
• Maintains logical versions of changed database
objects, through:
– Edition
– Editioning View
– Crossedition Trigger
Crossedition
• PL/SQL code changes and view changes installed Triggers
in the privacy of a new edition
• New data changes made to new Pre-upgrade Edition
columns/tables not seen by old edition
• Editioning view exposes a private
projection of a table into each edition
• Crossedition trigger propagates changes made by
old edition into new edition’s columns, or vice-versa
38
41. Database Technology Drives Availability
Real Active
Application Data Guard
Clusters
ASM
WAN
Oracle Secure
Fast
Backup
Recovery Area
• Real-time remote standby open for
• Protection from queries
– Server Failures
• Human error correction
– Storage Failures
– Database, table, row, transaction level
– Network Failures
– Site Failures
• Online indexing and table redefinition
• Online patching and upgrades
41
42. Database Machine HA Metrics
• Backup & Recovery
– Backup shows extreme performance and scalability using Exadata
– Full Database Backup to tape demonstrated at 7.8 TB/hr
Limited by tape performance of 14 tape drives used in test
– Incremental backup to tape at 10% change rate: 70TB/hr
– Single RMAN backup channel runs full backup to disk at 2.5 TB/hr
• Data Guard
– Full DR demonstrated with uncompressed loads over 2TB/hour
– Compressed tables reduce redo & net traffic enhancing Data Guard
• 5 TB/hour load rates with Data Guard into compressed tables
– 5 customers have implemented Data Guard on a Database Machine in
first year
42
43. Oracle High Availability Architecture
1. Scale-Out & Low-Cost
– High-volume hardware
– All components active
2. Application Oriented
– Protect and recover application objects
– Enable online application changes
3. Integrated & Simple
– Availability integrated into all components
– Automated
4. Complete & Open
– Handles all planned and unplanned downtime
– Pluggable components
43
44. HA Sessions, Labs, & Demos by Oracle Development
Sunday, 11 October – Hilton Hotel Imperial Ballroom B Tuesday, 13 October – Marriott Hotel Golden Gate B1
3:45p Online Application Upgrade 11:30a GoldenGate Zero-Downtime Application Upgrades
Monday, 12 October – Marriott Hotel Golden Gate B1 1:00p GoldenGate Deep Dive: Architecture for Real-Time
11:30a Introducing Oracle GoldenGate Products
Wednesday, 14 October – Moscone South
Monday, 12 October – Moscone South 10:15a Announcing OSB 10.3, Room 300
1:00p Oracle’s HA Vision: What’s New in 11.2, Room 103
11:45a Active Data Guard, Room 103
2:30p Oracle Streams: What's New in 11.2, Room 301
5:00p Exadata Storage & Database Machine, Room 104
4:00p Database 11g: Performance Innovations, Room 103
5:30p Comparing Data Protection Solutions, Room 102 Thursday, 15 October – Moscone South
Tuesday, 13 October – Moscone South 9:00a Empowering Availability for Apps, Room 300
11:30a Oracle Streams: Replication Made Easy, Room 308 12:00p Exadata Technical Deep Dive, Room 307
11:30a Backup & Recovery on the Database Machine, Room 307 1:30p Zero-Downtime DB Maintenance, Room 103
11:30a Next-Generation Database Grid Overview, Room 103
1:00p Oracle Data Guard: What’s New in 11.2, Room 104
Demos Moscone West DEMOGrounds
2:30p GoldenGate and Streams - The Future, Room 270
Mon & Tue 10:30a - 6:30p; Wed 9:15a - 5:15p
2:30p Backup & Recovery Best Practices, Room 104
2:30p Single-Instance RAC, Room 300 Maximum Availability Architecture (MAA), W-045
4:00p Enterprise Manager HA Best Practices, Room 303 Oracle Streams: Replication & Advanced Queuing, W-043
Oracle Active Data Guard, W-048
Hands-on Labs Marriott Hotel Golden Gate B2 Oracle Secure Backup, W-044
Monday 11:30a-2:00p Oracle Active Data Guard, Parts I & II Oracle Recovery Manager & Flashback, W-046
Thursday 9:00a-11:30a Oracle Active Data Guard, Parts I & II Oracle GoldenGate, 3709
44
45. Complete List of New HA Features
Oracle Database 11g Release 2
Oracle Database 11g Release 1
45
46. Complete List of New HA Features
Oracle Database 11g Release 2
Data Guard Data Guard (contd.) RAC
• Active Data Guard: • SQL Apply support of OLTP • Server pools
• Online block repair Compression, SecureFiles, XA • RAC One Node
• Query SLA in RAC, Online Redefinition & • Omotion
• Primary with 30 standbys Edition-based Redefinition,
• Parallel local & remote SYNC SDO_GEOMETRY (EDS)
ASM
transport • Use logical standby as
Streams source • Cluster File System
• Retrieve remaining redo from
primary before failover • OCR & Voting Disk in ASM
• Improved client failover Streams
• Role-based services Flashback
• XStream IN & OUT
• Broker support for ONS • Statement DML Handlers • Flashback Database: better
• Support auto-client failover • Better infrastructure to track performance for direct loads
for logical standby for JDBC, changes to table data • Flashback Database: enable
OCI, ODP.Net • New Declarative while database is open
• No shutdown of RAC instances Transformation: keep_columns • Flashback Database: better
in old standby for switchover • Optimized one-to-many monitoring of progress
• No shutdown moving from Max propagation • Flashback Transaction: track
Availability to Max Protection • AQ: Improved JMS integration foreign key dependency
• Comprehensive support for & performance improvements
compressed redo transport • Support of OLTP
Compression, SecureFiles,
Online Redefinition
46
47. Complete List of New HA Features
Oracle Database 11g Release 2
Online Patching & Upgrades OSB 10.3 Grid Control 10.2.0.5
• Edition-based Redefinition • Server-less tape duplication • HA Console
using Edition, Editioning View for VTL using NDMP tape • MAA Advisor
and Crossedition Trigger copy • Minimal downtime ASM
• Online Patching for Windows • Better automation for tape migration & RAC conversion
& AIX vaulting • Streams dashboard and
• Support for IPv6 as well as improved monitoring of Streams
RMAN IPv4 configurations.
• Multiple compression levels • Supports LTO-4 tape drive • Database Clone from existing
encryption database backups
• Target-less DUPLICATE
• Manages encryption key • Comprehensive OSB
• Optimized checks for seamlessly between native or
DUPLICATE management
LTO-4 encryption • OSB File System
• Expanded DUPLICATE • More comprehensive backup /
options Backup/Restore and reports
restore monitoring • Task based workflow for mining
• Enhanced tablespace point-in- • Verification of tape device
time recovery using redo and archived logs
configurations
transportable tablespace and
Data Pump
• Improved flexibility of SET
NEWNAME
• Faster transportable database
47
48. Complete List of New HA Features
Oracle Database 11g Release 1
Clusters Data Guard - Generic Data Guard SQL Apply
• Better performance, failover, Snapshot standby Support XMLType data type
management Fast-Start Failover in secs (CLOB)
• Seamless integration with XA Fast-Start Failover for Support Transparent Data
and Microsoft Transaction asynchronous mode Encryption (TDE)
Server Apply performance improved
Fast Redo Transport
• Optimized Cache Fusion significantly
Redo Transport Compression for
protocols Support Fine Grained Auditing
gaps
SYS user no longer required for Support Virtual Private
redo shipping Database
ASM Standby across Linux/Windows
• Temporarily freeze I/O to on x86 Data Guard Redo Apply
unresponsive storage and Active Data Guard
replay writes when it returns
Flashback New parallel media recovery
• Rolling Upgrade for ASM doubles redo apply
Flashback Transaction
instances performance
Flashback Data Archive
Fast Incremental Backup
Better RMAN integration
48
49. Complete List of New HA Features
Oracle Database 11g Release 1
Backup & Recovery Upgrades Streams
Data Recovery Advisor • Online patching Support XMLType data type
Intra-file parallel backup and • Transient logical standby (CLOB)
restore Support Transparent Data
Faster backup compression Online Redefinition Encryption (TDE)
Duplicate database over the • Fast add column with default Apply performance improved
network value significantly
Integration with Windows • Invisible Indexes prevent Support AWR, ADDM, ASH
Volume Shadow Copy premature use of newly created Streams Performance Advisor
Services (VSS) API indexes Synchronous capture
Integrated protection through • Online index build with NO Table Data Comparison
ultra safe mode pause to DML JMS/AQ performance
• No recompilation of dependent improvements
objects
• Easier to execute table DDL
operations online
49
50. Oracle GoldenGate
Key Features in v10
• General – Across the Platforms
– Event Marker Infrastructure
– Start Delivery as of CSN (Commit Sequence Number) for efficient instantiation
– Enhanced Memory Management
– Deferred Apply
– Array Fetching to increase initial load performance
• Oracle
– Additional data type support – Spatial, IOTs, Sequences, clustered table, object table
– Support of Append hints (Apply only)
– Increased Oracle DDL text maximum size to 2MB
– Filtering by User for more efficient loop detection and capture task type separation (e.g. batch vs OLTP)
– Expanded Support of ALO (Archive Log Only) mode for RAC environments
• SQL Server
– SQL Server 2008 Delivery
– Capture of tables without primary keys (SQL Server 2005)
• DB2 LUW
– Support for Multi Dimensional Clustered Tables (MDC)
– Support for Materialized Query Tables (MQT)
• NSK
– Support of HP Blades
– Support Primary Key Updates from Open Systems (e.g. Oracle to NSK)
• Teradata
– Integration of Oracle GoldenGate Director with TMSM (Teradata Multi-System Manager)
– Support of Teradata v13 – DDL replication
– Support for additional platforms: Solaris 10, SUSE 9/10
– Full Unicode Support for Linux ODBC
50
51. Resources
• Oracle.com:
http://www.oracle.com/ha
• Oracle HA Customer Success Stories on OTN:
http://www.oracle.com/technology/deploy/availability/htdocs/HA_CaseStudies.html
• Maximum Availability Architecture (MAA):
http://otn.oracle.com/goto/maa
• MAA Assessment:
http://www.oracle.com/goto/hasurvey
51