Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funciones del DBA

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Oracle Database 18c
DBA’s new roles: Advisor, Analyst and Architect
Guillermo Best
Cloud Platform Presales Manager
guillermo.best@oracle.com
Stephane Duprat
Cloud Platform Solution Architect
stephane.duprat@oracle.com
Rafael Prada
Consultor Senior
rafael.prada@avanttic.com

DBAs new roles:
Oracle Confidential – Internal 2
ARCHITECT
ADVISOR
ANALYST
AUTOMATION
ARTIFICIAL
INTELLIGENCE

Autonomous Database and Oracle Database 18c
3
Autonomous
Database
Oracle
Cloud
Policy-driven
Automation
& Machine
Learning
today’s
presentation

Oracle Database 18c
• First yearly release of the Oracle Database
– Previously referred to as Oracle Database 12c Release 2
12.2.0.2
• Oracle Database 18c is aimed at providing
incremental changes and a focus on stability
• Now Available on Oracle Cloud and Engineered
Systems with on-premises following some time
after
• “Release Schedule of Current Database Releases”
MOS Doc 742060.1
Oracle Confidential – Internal 4

Machine Learning and Advanced Analytics in 18c
• Machine Learning Algorithms available since 9i Release 2
(2002)
• New algorithms in 18
– Random Forests for Classification
– Neural Networks for both classification and regression
– Explicit Semantic Analysis ML algorithm extended to support
classification
– Time Series via Exponential Smoothing
– CUR decomposition-based algorithm for attribute and row
importance
• New ability to export ML models to C and Java for
applications deployment
Oracle Confidential – Internal

Oracle Database 12c Release 2
6
Marquee Features
Massive Cost Savings
and Cloud Agility with
Multitenant
Plus more features for better Performance, Availability, Security, Analytics, and Application Development
Massive Web Applications
with Sharding
Massive Performance
with Database In-
Memory

Oracle Database 12c “Under the Radar” Features
7
OnlineTableMove
JSON
Real Time Materialized Views
IndexCompression
Auto Generated Sequences
Long Identifiers
Online Tablespace Encryption
Property Graph
SQL Plan Management Enhancements
TopNQueries
Invisible Columns
Longer Varchars
Security Assessment Tool
LiveSQL
IndexUsageStats
Application Continuity
Auto List Partitioning
Oracle REST Data Services

Multitenant
8Oracle Confidential – Internal

Multitenant
• Container managed database virtualization
• Manage Many as one
• Patching, Backup, Security, Online Cloning, Online
Relocation
• Software as Service
• Shared metadata, Data location transparency
9
Today Oracle Database 18c
• Refreshable PDB Switchover
• Transportable Backups
• Snapshot Carousel
• Faster Upgrades

• Virtualize databases into Container Database
– Applications run unchanged
• Lower Operational Expenses
– Manage many Pluggable Databases (PDBs)
as one
• Lower Capital Expenses
– More PDBs per server
• More Agile
– Fast provisioning, movement and cloning
10
Oracle Database 12c Multitenant Architecture
ERP CRM
DW
Container Database

Database as a Service Patching & Upgrades
Apply changes once, all pluggable databases updated
11
GL OE AP
Upgrade
in-place
12.X 12.X 12.X12.1 12.1 12.1

Database as a Service Patching & Upgrades
Flexible choice when patching & upgrading databases
12
Original Container Database 12.1
GL OE AP GL OE
Upgraded Container Database 12.x

PDB Hot Clone
• PDB Hot Clone
– Online test master instantiation
CRM
Oracle Cloud
Pricing Retail
On-Premises
13
Hot Clone
Snap Clone
Snap Clone
CRM CRM Dev1 CRM Dev2
Developers
Public

Refreshable PDB
• PDB Refresh
– Incremental refresh of clone with latest
data
CRM
Dev / Test
Pricing Retail
Production
CRM
Snap Clone
Snap Clone
CRM Dev1 CRM Dev2
Developers
TIME
Changes made to database
Master Dev/Test version no longer in sync
Only changes copied and applied

Point-in-Time Recovery with Snapshot Carousel
• ”Flashback” to Thursday 10:17am:
1. Restore Thursday midnight’s snapshot
2. Roll forward to 10:17am from archivelog
– PDB will be “transactionally consistent” as of this time
Carousel stores archive logs along with corresponding snapshot clones
ThursdaySunday Monday Tuesday Wednesday Friday Saturday
Archive Logs

Point-in-Time Cloning with Snapshot Carousel
• “Hot Clone” introduced with 12.2
• Basic hot clone is transactionally consistent with source PDB
as of SCN at completion of statement
alter pluggable database Hot_Clone open;
• Snapshot Carousel enables hot clone to a specific point in time (or SCN)
– Restore most recent snapshot from carousel
– Roll forward to required point in time by performing recovery from corresponding
archive log

Central CDB
Database Cloud Provisioning Framework
Central CDB contains a catalog and PDB templates
1. Request to provision a BI PDB
2. Framework consults catalog to
identify appropriate pod based
on available capacity
3. Request forwarded to Pod 2 to
provision PDB as clone of BI
template
Catalog
of Pods BI
RMAN
Catalog Docs TBE
PDB Templates
Pod 1 Pod 3Pod 2
Pod # vs Max Load
Pod 1 125/250 60%
Pod 2 75 / 125 40%
Pod 3 200 / 250 80% REST
API

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 18
Mini Demo

In-Memory
Column Store

Cost of memory continues to
decrease
20
Demand for real-time analytics
continues to increase
Non-volatile memory in
development
Evolution of In-Memory

Breakthrough: Dual Format In-Memory Database
• BOTH row and column in-
memory formats for same
table
• Simultaneously active and
transactionally consistent
• Analytics & reporting use new
in-memory Column format
• OLTP uses proven row format
21
Memory Memory
SALES SALES
Row
Format
Column
Format

In-Memory 18c Key Features
• Automatic In-Memory Management
• In-Memory For External Tables
• In-Memory for Extreme Capacity NVRAM Memory
• Many performance improvements:
– In-Memory Dynamic Scans
– In-Memory Optimized Arithmetic
– Mixed workload performance improvements

• In-Memory tables and partitions
automatically ranked using access
Heat Map (introduced in 12c)
• Hot data automatically chosen for In-
Memory population
• Colder In-Memory data
automatically evicted
• Useful for managed cloud services
since no user intervention required
23
Automatic In-Memory Management
Greater Automation and Reduced Administration for Cloud Services
Sales_Q3
Sales_Q2
Sales_Q4
In-Memory Column Store
Sales _Q1

eXtended Memory (XMEM) Support
Use Non-Volatile Memory to Massively Extend Memory Capacity
• In-Memory algorithms extended to use
NVRAM as higher capacity but slower
memory
• Performance-critical tables placed in DRAM,
capacity-critical tables stored in NVRAM.
• XMEM allows a 3X bigger column store
24
DRAM
Column Store
XMEM
Column Store

Database In-Memory Performance Improvements
Multiple Areas of Performance Improvements
25
• Enhanced Mixed Workload performance
– Up to 2X Performance Improvement
• Improved aggregation performance
– Aggregation push-down to Exadata
• Improved JSON Processing
• Faster expression evaluation
• Improved Join Processing
• Improved Compression at Query High
• TPCH Performance – 2X Faster

Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 26
• External Tables allow transparent
access to data outside the DB
• In-Memory For External Tables
builds in-memory column cache of
data outside the DB for ultra-fast
analytics on external data
• All In-Memory Optimizations apply
– Vector processing, JSON expressions
extend transparently to external data
• Up to 100X faster
In-memory
External
Tables
RDBMS
In-memory
Database
Tables
External Data
DB TABLES
In-Memory For External Tables
Fast Analytics on External Data
Object Storage
Files
Hadoop

Mini Demo

Development
JSON & REST

• Application Express 5.1
• SQL Developer & SQLCl
• Comprehensive Language support
• PL/SQL, SQL , Python, Node.js, PHP, Java, C, .NET, REST
• JSON
• SODA API, SODA REST API
• SQL Support
• Improved JSON Support
• Rolling patches for OJVM
• Private Temporary Tables
29
Development

Oracle Database as a Document Store
Flexible Schema development
JSON
JSON
Via RESTful service
Via Native APIs
Data persisted in database
In JSON
SQL
Data analyzed via SQL
30

JSON Enhancements
• Generate large JSON documents from relational data
– JSON generation extended to supports LOB’s
• New SODA (Simple Oracle Document Access) drivers
– OCI and PL/SQL now added, in additional to JSON and REST
– Simple, non-relational (‘nosql-like’) API for accessing JSON data
• New TREAT (<expression> AS JSON) operator
– Dynamically declare operands to be handled as JSON data, enabling more seamless JSON
optimizations
• Extended key length for JSON search indexes
– Raise the key length from 64 bytes to 255 bytes; enables faster search queries for JSON
objects containing long key names.
31
Simpler development of JSON-centric applications using Oracle Database

Mini Demo

Oracle Database Cloud Service
 Available Standalone, Weblogic, Tomcat & Glassfish
 Turns Database Service into an RESTFul API service
 Fully provisioned and functional in all cloud editions
 Available in 11g, 12c and 18c, no extra cost
 Allows publishing of URI based access to Oracle
database over REST
 Results in JSON or CSV
 Mapping of URI to SQL or PL/SQL
 All HTML methods GET, PUT, POST, DELETE, PATCH
 Oauth2 integration
 Highly scalable, can use all feature of database
33

ORDS powers the Schema Service, A Quick Detour
• Provides data access consistent with modern App Dev frameworks
• Mid tier application
• Can map standard http(s) RESTful gets and posts to SQL
• Can declaratively returns results in JSON format
• JavaScript friendly
• Can support high numbers of end users
• Services
• HTTP(s) relational data access
• Oracle JSON collection based schema-less access
• Oracle NoSQL access over HTTP
• Oracle APEX mid-tier, web toolkit applications, mod_plsql replacement
• Formally known as Oracle APEX Listener
• Supported feature of the Oracle Database since 2010
• Ships with Oracle Database 12.1.0.2

Serving JSON results from relational data
Oracle Database
URI
HTTP(S) client
Map and Bind SQL
Transform SQL Result SetTransform to JSONJSON
 Data stored in standard relational tables and columns
 Oracle REST Data Services (ORDS) Developer defines URI<>SQL mapping
 App Developer calls named URI over HTTP(S) gets and posts

HTTP(s) API App-Dev with Relational Tables in Oracle Database
{ “custno”: 1001,
“name”: “Scott King”,
“address”: “500 Main street, Innovation CA”,
“orders”: [ { “orderno”: 404,
“orderdate”: “Feb 27, 2016”,
“status”: “in process”} } }
{ “orderno”: 303,
“orderdate”: “Feb 26, 2016”,
“status”: “in process”} ] }
JSON
HTTP(s)
https://myhost/myapp/hr/customerorders/1001
Oracle REST
Data Services
SQL
ORDS maps standard URI requests to corresponding relational SQL (not schemaless): e.g. SQL SELECT from customers and orders table.
ORDS also transforms the SQL results into JavaScript Object Notation (JSON), other formats include HTML, binary and CSV.
Fully committed to supporting any and all standards required by Fusion / SaaS / FMW; we are actively engaged in the ongoing dialog.
SQL result to
JSON
transformation
URI Request or HTTP(s) post
mapped to SQL request
JDBC
Connection
Pool
Oracle Database
URI
Module
Template
Context Root

Mini Demo

Availability

Availability
• Comprehensive HA and disaster recovery
functionality
• Real Application Clusters, Active Data Guard, Recovery
Appliance,
• Application Continuity
• Oracle Golden Gate for heterogeneous
replication
• Scale out and fault isolation with Oracle Database
Sharding
39
• Zero Impact Grid Infrastructure Patching
• Sharded RAC
• Logically partition data across instances in RAC
• Sharded access for shard-aware applications and
transparency for non-sharded applications
• Sharding improvements
• User Defined Sharding
• Improved Cross Shard Query support

Sharded RAC
• Affinitizes shards to RAC instances
– Requests that specify sharding key will be routed to
the RAC instance that logically holds the shard
– Affinity gives better cache utilization and reduced
block pings across instances
• Requests that don’t specify sharding key still
work transparently
• Gives Sharded Database performance with
minimal application changes
– Just add sharding key to the most performance
intensive operations
40
Higher performance for shard-aware RAC applications
Oracle RAC Database
Instance 1
Partition P1
Instance 2
Partition P2
Instance 3
Partition P3

Application
Continuity

Unknown Transaction State
• Database and infrastructure outages can cause in-flight work to be lost,
leaving users and applications in-doubt
• Often leads to
 User pains
 Duplicate submissions
 Rebooting mid-tiers
 Developer pains
Leads to poor customer experiences

Application Servers
Database Servers
End User
Current Situation
Network Switches
User selects product from
application and purchases it from
the web checkout
User transaction arrives at
application infrastructure. It makes
it’s way through the application
tiers and results in a database
transaction being created

Application Servers
Database Servers
End User
Current Situation
Network Switches
application infrastructure and
makes it’s way through application
The transaction commits inside of
the database and an
acknowledgement begins it return
journey
A failure in the infrastructure on its
return journey means the
application server never receives an
acknowledgment

Application Servers
Database Servers
End User
Current Situation
Network Switches
The application is left in an
unknown state. It returns an error
to the user who may order the
product for a second time resulting
in them potentially being charged
twice.

A Solution to the Problem
• Transaction Guard: a reliable protocol and API that returns the outcome of
the last transaction
• Application Continuity: safely attempts to replay in-flight work following
outages and planned operations.
Two New Features

Application Servers
Database Servers
End User
A reliable replay of in flight work
Network Switches
User selects product from
application and purchases it from
the web checkout
application infrastructure. It makes
it’s way through the application

Application Servers
Database Servers
End User
Network Switches The infrastructure hosting the
database fails just before the
transaction is committed to the
database.

Application Servers
Database Servers
End User
Network Switches
The jdbc driver detects the failure
and checks with an available node
in the cluster, using “Transaction
Guard”, whether the transaction
committed or needs to be replayed
If the transaction needs to be
replayed, “Application Continuity”
will submit all of the inflight work to
a surviving node in the cluster and
perform a commit. This all happens
transparently to the application

Application Servers
Database Servers
End User
Network Switches
The user receives confirmation that
his order has been successfully
completed.

Application Continuity for Java and OCI transparent
• If the Application
–Uses J2EE or JPA that uses the standard JDBC API
–Uses UCP or WebLogic Server and return connections to pool
–Does not have external actions that cannot be replayed
• Or use OCI client
–Nothing to do

Mini Demo

Thanks!

Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funciones del DBA

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funciones del DBA

Semelhante a Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funciones del DBA (20)

Mais de avanttic Consultoría Tecnológica

Mais de avanttic Consultoría Tecnológica (20)

Último

Último (20)

Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funciones del DBA