Java Performance Optimization with JDBC

Java Performance
artdb@ex-em.com | performeister.tistory.com | twitter @novathinker

Oracle as Datasource

Java Performance
2


JDBC
1) JDBC Overview
2) JDBC
3) JDBC Architecture

Oracle JDBC Driver
1) Oracle JDBC Driver
2) JDBC Driver Performance Test

Cursor & JDBC
1) Oracle SQL Execution
2) Java SQL Execution
3) JDBC Performance

Java Performance

JDBC

Java Performance
4
Java Performance Fundamental | twitter @novathinker
artdb@ex-em.com | performeister.tistory.com
JDBC Overview

• JDBC
– RDBMS API
• RDBMS table spreadsheet ﬂat
ﬁle
– Java Database Connectivity
• Trademark name

parameter SQL
Application
JDBC
JDBC Driver
Interface RDBMS
SQL Result
return

Java Performance
5
JDBC Overview

• JDBC History

Version JSR Speciﬁcation JDK Implementation

2006 JDBC 4.0 JSR 221 Java SE 6

2001 JDBC 3.0 JSR 54 JDK 1.4

1999 JDBC 2.1 JDK 1.2

1997 JDBC 1.2 JDK 1.1

Java Performance
6
JDBC

• JDBC API
– Database Java Program

– Write once Run Anywhere
– DB Table Datasource

– J2SE, J2EE
– java.sql, javax.sql package

Java Performance
7
JDBC

• JDBC API
javax.sql.DataSource
DriverManager Driver javax.sql.RowSet

SavePoint Connection Statement ResultSet Types

PrepearedStatemen ResultSetMetetaData

CallableStatement DatabaseMetaData

SQLData SQLInput SQLOutput Struct Ref Array

Blob Clob

Java Performance
8
JDBC

• JDBC API
– Package java.sql
• DB Core JDBC API
– Package javax.sql
• JDBC client Server Datasource
API
– JDK Interface
– JDBC Driver

Java Performance
9
JDBC

• JDBC Drive Manager
– JDBC Driver Java App.
Class

– JDBC Architecture

– Java Application DB
Driver load

Java Performance
10
JDBC

• JDBC Test Suit
– Driver Vendor

– J2EE Driver

– JDBC Version

– JDBC Test Suit 1.2.1  JDBC 2.0 API
– JDBC Test Suit 1.3.1  JDBC 3.0 API

Java Performance
11
JDBC

• JDBC-ODBC Bridge
– ODBC JDBC Type 1 Driver

– JDBC Method Call ODBC Function Call

– sun.jdbc.odbc java package

– ODBC native library

Java Performance
12
JDBC Architecture

• Layer of the JDBC Architecture

Java JDBC Driver
JDBC API
Application Manager
n
la tio
s
T ran
JDBC Driver JDBC Driver JDBC Driver

ODBC
RDBMS Oracle
Data Source

Java Performance
13
JDBC Architecture

• Type 1 JDBC Architecture
Java
Application

Type 1 JDBC
Driver (Java)

JDBC-ODBC
Library
(Native code)

ODBC Driver
(Native code) Database

Java Performance
14
JDBC Architecture

– JDBC-ODBC Bridge Driver

– JDBC Method Call ODBC Function Call

– JDBC Driver

– sun.jdbc.odbc.JdbcOdbcDriver class

– Platform

Java Performance
15
JDBC Architecture


Java
Application

Type 2 JDBC
Driver (Java)

Database
Library
(Native code)

Database

Java Performance
16
JDBC Architecture

– Native API Driver

– JDBC Method Call DB API Native Call

– DB API

– Native binary code client

– Oracle Client

Java Performance
17
JDBC Architecture


Java
Application

Type 3 JDBC
Driver (Java)
Network Protocol

JDBC
Middleware Database

Java Performance
18
JDBC Architecture

– Network Protocol Driver

– Calling Program DB Middle-tier

– Driver DB

– Platform

– , Load Balancing, Logging

Java Performance
19
JDBC Architecture

Java Type 4 JDBC
Application Driver (Java) Database

– JDBC Call DB Protocol
– Java  Platform
– Conversion
– DBMS
– install

Java Performance

Oracle JDBC Driver

Java Performance
21
Oracle JDBC Driver

• Oracle JDBC Architecture
Java Virtual Machine
Oracle Database
Java Application (Local)
Type 4
JDBC Thin Driver
Java Engine
Java Sockets Type4
SQL Engine Server-side Thin Driver
Type2
Java Application
PL/SQL Engine Server-side Internal
Type 2 Driver
JDBC OCI Driver KPRB C Library
OCI C Library

Remote Oracle Database

Java Performance
22
Oracle JDBC Driver

• Oracle JDBC Architecture
–4 JDBC Driver
• Client Side
– Type 4, JDBC Thin Driver

– Type 2, JDBC OCI Driver

• Server Side
– Type 4, Server-side Thin Driver
– Type 2, Server-side Internal Driver

Java Performance
23
Oracle JDBC Driver

• Oracle JDBC Driver
– Client JDBC Thin Driver
• TTC(Two-Task Common) Oracle Net Emulate
Java Net
• TCP/IP

Java Application, applet

JDBC Thin Driver

Presentation-Java TTC

Communication

Java Net Addressing

Java NS

Java Sockets
TCP/IP Network Protocol
TCP/IP Protocol

Java Performance
24
Oracle JDBC Driver

– Client JDBC OCI Driver
• OCI (Oracle Call Interface)
•C OCI Library Native API
•

Java Application

JDBC OCI Driver

Presentation-TTC

Oracle Net Foundation Layer

Oracle Protocol Support

Network Protocol TCP/IP, TCP/IP with SSL and Named

Java Performance
25
Oracle JDBC Driver

– Server-side Internal Driver
• Oracle DB Java Code
• Internal driver SQL, PL/SQL
• Java Engine Oracle DB DB

• Oracle SQL Engine KPRB
Library
• Network Oracle DB, JVM, KPRB C
library, SQL Engine

Java Performance
26
Oracle JDBC Driver

– Server-side Thin Driver
• PL/SQL DB

• Oracle Instance Application Server

• DB Link Remote DB
, SQL
Overhead

Java Performance
27
Oracle JDBC Driver

– Driver

• Middle Tier Oracle DB Java code
Server-side Thin Driver
• Oracle DB Local Server-side
Internal Driver
• JDBC Applet Client Thin Driver
• Application Platform Client Thin
Driver

Java Performance
28
Oracle JDBC Driver

– Driver

• TCP/IP

• OCI connection Pooling

• RAC TAF

• DB XA

• Kerberos

• Client OCI Driver

Java Performance
29
JDBC Driver Performance

– Test

• Oracle Driver

– Test Driver
• Client Oracle Thin Driver (Type 4)

• Client Oracle OCI Driver (Type 2)
• Server-side Internal Driver (Type 2)

Java Performance
30

– Test
• Connection Test

• Unique Key Query

• Index Range Scan Fetch

• Unique Key Update

Java Performance
31

– Test (Server)
• OS
– Cent OS 5 (64bit)
– CPU : 4 (Intel(R) Core(TM)2 Quad CPU Q6600 @
2.40GHz)
– Memory : 2 GB
• Oracle Database
– Oracle Database 10g Enterprise Edition Release
10.2.0.4.0 - 64bit
– sga_target : 536 MB

Java Performance
32

– Test (Client)
• OS
– Windows XP Service pack 3 (32bit)
– CPU : 2 (Intel(R) Core(TM)2 Duo CPU P9500 @ 2.53GHz)
– Memory : 4 GB
• Java Version
– Sun Hotspot JVM (1.5.0_17-b04)
– 32 bit , client VM
• JDBC Version - ojdbc14.jar
– Oracle JDBC driver classes for use with JDK14
– Created-By: 1.4.2_08 (Sun Microsystems Inc.)
– Oracle JDBC Driver version - "10.2.0.1.0"

Java Performance
33

• Test

OCI Driver THIN Driver Internal Driver

Connection 4.808 3.352 0.025

Query 9.203 9.75 1.997

Fetch 8.093 8.047 0.604

Update 9.469 9.156 1.965

Java Performance
34

• Test - Connection
OCI THIN Local OCI Local Thin KPRB
Connection 4.808 3.352 2.672 2.504 0.025

– Remote vs Local ?
– Connection Pool ?
– Internal Driver (kprb) ?

Java Performance
35

• Test - Query

OCI THIN KPRB
Query 9.203 9.75 1.997

OCI THIN KPRB

Parse 0 0 0

Execute 1.63 / 1.55 1.65 / 1.57 1.30 / 1.11

Fetch 0.24 / 0.27 0.30 / 0.28 0.09 / 0.11

Wait 6.49 6.87 0

Java Performance
36

• Test - Fetch

OCI THIN KPRB
Fetch 8.093 8.047 0.604

OCI THIN KPRB

Parse 0 0 0

Execute 0 0 0

Fetch 0.68 / 0.62 0.67 / 0.64 0.34 / 0.35

Wait 6.78 6.72 0

Java Performance
37

• Test - Update
OCI THIN KPRB
Update 8.093 8.047 0.604

OCI THIN KPRB

Parse 0 0 0

Execute 1.96 / 1.90 1.90 / 1.85 1.40 / 1.39

Fetch 0 0 0

Wait 6.67 6.31 0

Java Performance
38

•
– OCI Thin Driver

– Internal Driver client Driver
Network

Java Performance

Cursor & JDBC

39

Java Performance
40
Oracle SQL Execution

• Oracle Memory Architecture

Java Performance
40

• Oracle Memory Architecture

SQL Cache Area

Java Performance
41

• Oracle SQL Execution Flow

Parse

Execute

Fetch

Java Performance
41


Parse

Execute ?

Fetch

Java Performance
42

– Parse
• SQL
• SQL Syntax check , semantic Check, Execution
Plan
• Cache (soft Parse)
• (Hard Parse)
• Cache  Library Cache
• Cache
– Hash Table, Library cache Chain
– Library Cache Handle
– Library Cache Object

Java Performance
43

– Execute
• Execution Plan SQL
• Bind
– Fetch
• SQL
• DML Fetch

Java Performance
44

• Library Cache

Hash Chain
Hash bucket 1
SQL

Hash Hash bucket 2
Function
library cache lock
Parent
Hash bucket3
latch: library cache
library cache pin
child child

Library Cache
Object

Java Performance
45

• Cursor
– Cursor

– Oracle Cursor
: SQL Memory

Java Performance
46

• Cursor
– V$OPEN_CURSOR
SELECT inst_id ,
kgllkuse saddr ,
kgllksnm sid ,
user_name ,
kglhdpar address ,
kglnahsh hash_value ,
kgllksqlid sql_id ,
kglnaobj sql_text
FROM x$kgllk
WHERE kglhdnsp = 0
AND kglhdpar != kgllkhdl

Java Performance
46

• Cursor
– V$OPEN_CURSOR
SELECT inst_id ,
kgllkuse saddr ,
kgllksnm sid ,
user_name ,
kglhdpar address ,
kgllksqlid sql_id ,
kglnaobj sql_text
FROM x$kgllk  Library Cache Lock dynamic view
WHERE kglhdnsp = 0

Java Performance
46

• Cursor
– V$OPEN_CURSOR
SELECT inst_id ,
kgllkuse saddr ,
kgllksnm sid ,
user_name ,
kglhdpar address ,
kgllksqlid sql_id ,
kglnaobj sql_text
WHERE kglhdnsp = 0  Namespace SQL Area

Java Performance
46

• Cursor
– V$OPEN_CURSOR
SELECT inst_id ,
kgllkuse saddr ,
kgllksnm sid ,
user_name ,
kglhdpar address ,
kgllksqlid sql_id ,
kglnaobj sql_text
AND kglhdpar != kgllkhdl  Library Cache handle Child

Java Performance
46

• Cursor
– V$OPEN_CURSOR
SELECT inst_id ,
kgllkuse saddr ,
kgllksnm sid ,
user_name ,
kglhdpar address ,
kgllksqlid sql_id ,
kglnaobj sql_text
AND kglhdpar != kgllkhdl  Library Cache handle Child

Cursor library cache lock sql area
library cache child Handle

Java Performance
47

• Oracle SQL Execution Test – Soft Parse

Java Performance
48


Java Performance
49

Cursor Open

library cache lock library cache pin
Parse (mode 1 null) (mode 2 share)

Execute (mode 1 null) (mode 2 share)

Fetch (mode 1 null) (mode 2 share)

library cache lock
Cursor Close (mode 1 null)

Java Performance
50

• Oracle SQL Execution Test – Hard Parse

Java Performance
51

Session 2

Session 1

Blocking!!!

Java Performance
52


Java Performance
53


Cursor Open Lock mode conversion

Hard Parse : mode 3 Hard Parse : mode 3
Parse Soft Parse : mode 1 Soft Parse : mode 2

Execute (mode 1 null) (mode 2 share)

Fetch (mode 1 null) (mode 2 share)

library cache lock
Cursor Close (mode 1 null)

Java Performance
54
Java SQL Execution

• Java SQL Execution Flow
Connection Open

Statement

Execute

ResultSet

Fetch

ResultSet Close

Statement close

Connection close

Java Performance
55
Java SQL Execution

• Java SQL Execution Test
Connection Open

Statement
select s.sid, s.serial#, p.spid from v
Execute $session s, v$process p where
s.PROGRAM='EXEM JDBC TEST' and s.paddr =
p.addr(+)
ResultSet
exec sys.dbms_system.set_ev(156,1475,
10046, 12, '');
Fetch

ResultSet Close
select * from sys.exem$liblock where sid
= 156 and name like '%JDBC%';
Statement close

Connection close

Java Performance
56
Java SQL Execution

• Java SQL Execution Test 1

Java Performance
57
Java SQL Execution


Java Performance
58
Java SQL Execution

Connection Open

Statement Cursor Open parse execute Fetch

Rs = Execute (mode 1 null) (mode 2 share)
Fetch Fetch (mode 1 null) (mode 2 share)

ResultSet Close
(mode 1 null)
Statement close

Connection close Cursor close library cache lock

Java Performance
59
Java SQL Execution

SQL 1 SQL 2
Connection Open Statement

Statement Execute

Execute ResultSet

ResultSet Fetch

Fetch ResultSet Close

ResultSet Close Statement close

Statement close Connection close

Java Performance
60
Java SQL Execution


SQL 1 Statement

SQL 1 Execute

SQL 1 Fetch

Java Performance
61
Java SQL Execution

SQL 2 Statement

SQL 2 Execute

SQL 2 Fetch

Connection Closed

Java Performance
62
Java SQL Execution


– Cursor 2
• JDBC ? or Oracle ?

Java Performance
63
Java SQL Execution

– Connection

alter session set session_cached_cursors=0

SQL 2 Statement

SQL 2 Execute

Java Performance
64
Java SQL Execution

– session_cached_cursors
• session cache cursor

• SQL Parse Call cache
• Cache cursor reopen
– Library cache Latch & Lock

• Softer soft Parse
• JDBC Parse Call
Cursor Cache

Java Performance
65
JDBC Performance

• Strategy Point
– SQL

Java Performance
66
JDBC Performance

• Strategy Point
– SQL

Java Performance
67
JDBC Performance

• Parse Performance
–
• Statement
• PreparedStatement
Session_cached_cursor = 0
• PreparedStatement
Session_cached_cursor = 20
• JDBC Statement caching
• PrepareStatement Loop 1
– Test
• SQL 10000

Java Performance
68
JDBC Performance

– Statement

Java Performance
69
JDBC Performance

– PreparedStatement

Java Performance
70
JDBC Performance


Java Performance
71
JDBC Performance


Java Performance
71
JDBC Performance


 Session Cached Cursor = 0

Java Performance
71
JDBC Performance


 Statement Cache = 0

Java Performance
71
JDBC Performance




Java Performance
72
JDBC Performance

– PreparedStatement Loop

Java Performance
73
JDBC Performance

PreparedState Session JDBC
Statement Cached Statement Out Loop
ment NoCache
Cursor Cache
Total Elapsed 22.172 17.14 17.14 9.156 9.766
DB Wait_time 12.485 12.299 12.44 6.318 6.873
DB Time 0.855 0.395 0.373 0.23 0.254
App Time 8.832 4.446 4.327 2.608 2.639
parse count 10027 10008 10008 9 9
hard parse 10001 1 0 0 0
parse time 0.624 0.018 0.012 0 0
librarycache latch 271037 100159 60089 30087 30493
library cache lock latch 60415 40047 40048 20038 100
library cache pin latch 90624 40047 20018 10016 20162
RoundTrip 20002 20002 20002 10003 10006
opened cursors 10027 10008 10008 9 9

Java Performance
74
JDBC Performance


ment NoCache
Cursor Cache
Total Elapsed 22.172 17.14 17.14 9.156 9.766

Java Performance
75
JDBC Performance


ment NoCache
Cursor Cache
DB Wait_time 12.485 12.299 12.44 6.318 6.873
DB Time 0.855 0.395 0.373 0.23 0.254
App Time 8.832 4.446 4.327 2.608 2.639
RoundTrip 20002 20002 20002 10003 10006

Java Performance
76
JDBC Performance


ment NoCache
Cursor Cache
librarycache latch 271037 100159 60089 30087 30493
library cache lock latch 60415 40047 40048 20038 100
library cache pin latch 90624 40047 20018 10016 20162
opened cursors 10027 10008 10008 9 9

Java Performance
77
JDBC Performance

– Statement
• Hard Parsing DB overhead
• Application
– PreparedStatement with NoCache
• Parse Round Trip
– PreparedStatement with Session Cached
Cursor
• Parse Round Trip, Open Cursor

• Library Cache Latch Lock, Pin
Overhead

Java Performance
78
JDBC Performance

–1 PreparedStatement and Loop
• Parse Library Cache Lock
Library Cache Pin
•1 Parse Loop

• Parse Call Round Trip
• Oracle Overhead
• SQL SQL

Java Performance
79
JDBC Performance

– Statement Cache
• JDBC 3.0
• JDBC Cursor Open Cache
• Soft Parse Round Trip
• Library cache Latch, lock, pin Overhead
• Connection SQL Cache

( : http://performeister.tistory.com/20 )

Java Performance
80
JDBC Performance

• Execute Performance
–
• Update
• 1000 Update Batch
• One SQL Update
– Test
• 10000 Update

Java Performance
81
JDBC Performance


Java Performance
81
JDBC Performance


 Batch 0 Execute

Java Performance
81
JDBC Performance


 Batch 0 Execute

 Batch
Execute batch

Java Performance
82
JDBC Performance

– One Sql Update

Java Performance
83
JDBC Performance


Each Batch One Sql
Total Elapsed 9.437 1.532 2.25
DB Wait_time 6.51 0.55 0.55
DB Time 0.225 0.154 0.227
App Time 2.702 0.828 1.473
Execute count 10006 18 10
Logical read 40364 30378 46713
Round Trip 10003 13 4

Java Performance
84
JDBC Performance


Each Batch One Sql
DB Wait_time 6.51 0.55 0.55
DB Time 0.225 0.154 0.227
App Time 2.702 0.828 1.473

Java Performance
85
JDBC Performance


Each Batch One Sql
Execute count 10006 18 10
Logical read 40364 30378 46713

Java Performance
86
JDBC Performance

– One SQL
• Update Batch

• Storage IO

• DML One SQL

Java Performance
87
JDBC Performance

– Update Batch
• JDBC 3.0
• Loop batch size Binding

• Execute Count Round Trip

• Array Processing


Java Performance
88
JDBC Performance

• Fetch Performance
–
• Fetch
• Prefetch Fetch (fetch size = 100)
– Test
• 100,000 Query

Java Performance
89
JDBC Performance


Java Performance
89
JDBC Performance


 Fetch Size Prefetch

Java Performance
90
JDBC Performance


Normal Prefetch
Total Elapsed 8.25 1.672
DB Wait_time 6.924 1.29
DB Time 0.11 0.046
App Time 1.216 0.336
Execute count 7 7
Logical read 30808 13794
Round Trip 10004 1004
Client Network (MB) 4.132952 3.795275
Server Network (KB) 68.81348 7.291992

Java Performance
91
JDBC Performance

– Fetch
• Query

• Fetch Size
• Default Fetch Size 10
– Prefetch
• JDBC 2.0
• Fetch Size Round Trip
• Network

Java Performance
92

Java Performance Optimization with JDBC

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Java Performance Optimization with JDBC

Semelhante a Java Performance Optimization with JDBC (20)

Último

Último (20)

Java Performance Optimization with JDBC