SlideShare uma empresa Scribd logo

OTN tour 2015 benchmarking oracle io performance with Orion by Alex Gorbachev

•
•
Andrejs Vorobjovs
Andrejs Vorobjovs

Every time Alex demonstrates charts he produces during IO benchmarks with ORION tool (Oracle I/O Numbers), he hears "Wow! How do you build these?" In this session Alex will teach how to benchmark your storage subsystem and capacity and how to stress test it to the limits. You will learn how easy it is to setup ORION benchmark and collect I/O performance characteristics of your platform and assess scalability of small random I/Os, impact of writes on I/Operformance, impact of different RAID levels, how backups can affect your OTLP traffic, performance of outer areas of disks vs inner areas, and compare SSD with HDD performance. ORION tests are very repeatable so it's a great measuring tool in your Measure, Analyze, Change, Measure cycle.

Educação
1 de 74
Baixar para ler offline
Benchmarking Oracle I/O Performance with ORION Alex Gorbachev November 2015
Alex Gorbachev • Chief Technology Officer at Pythian • Blogger • Cloudera Champion of Big Data • OakTable Network member • Oracle ACE Director • Founder of BattleAgainstAnyGuess.com • Founder of Sydney Oracle Meetup • EVP, IOUG • EVP, Ottawa Oracle User Group
© 2014 Pythian 3
ABOUT PYTHIAN Pythian is a global data outsourcing and consulting company that specializes in optimizing and managing mission-critical data systems. Pythian blends the world’s leading data experts with advanced, secure service delivery processes to create the industry’s best standard of care for its clients. Since its inception, Pythian has managed some of the world’s largest, most business-critical data infrastructures. 4 11,500Pythian currently manages over 11,500 systems. 385Pythian currently employs more than 385 people in 30 countries worldwide. 1997Pythian was founded in 1997 New Q2 2015
© 2011-2012 Pythian5
© 2011-2012 Pythian6 ORION - ORacle I/O Numbers Generate I/O workload similar to database patterns & measure I/O performance
© 2011-2012 Pythian7 Orion is designed to stress test the I/O subsystem
© 2011-2012 Pythian8 Orion is not perfect for simulation but good enough
© 2011-2012 Pythian9 Use Orion before moving/ deploying databases to the new platform
© 2011-2012 Pythian10 Orion is used in two scenarios
© 2011-2012 Pythian11 You have no idea what you need and want to ensure you get You know what you need and want to ensure you have it or
© 2011-2012 Pythian Infrastructure tuning - what’s the goal? • When you don’t know how much you need you try at least to ensure you take all you can • Assess what’s your possible bottlenecks • 1 Gbit Ethernet => 100+ MBPS or 10,000+ IOPS (8K) • 15K RPM disk • will easily serve 100-150 IOPS with average resp. time <10ms • can get to 200-250 IOPS but response time increase to 20 ms • SSD - see vendors specs • reads: random vs sequential... small vs large... no matter • writes: pattern matters 12
© 2011-2012 Pythian Orion • Uses code-base similar to Oracle database kernel • Standalone binary or part of Oracle home since 11.2.0.1 • Standalone Orion downloadable version is only 11.1 • Tests only I/O subsystem • Minimal CPU consumption • Async I/O is used to submit concurrent I/O requests • Each run includes multiple data points / tests • Scaling concurrency of small and large I/Os 13
© 2011-2012 Pythian Controlling Orion • Workload patterns • Small random I/O size and scale • Large I/O size, scale and pattern (random vs sequential) • Write percentage • Cache warming • Duration of each test (data point) • Data layout (concatenation vs striping) 14
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... .............................. .............................. .............................. 15
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 16 -run advanced -matrix detailed # of tests = (Xlarge + 1) * (Xsmall + 1)
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 17 -run advanced -matrix row -num_large 2 # of tests = Xsmall + 1
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 18 -run advanced -matrix col -num_small 3 # of tests = Xlarge + 1
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 19 -run advanced -matrix basic # of tests = Xlarge + Xsmall + 1
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 0, x, x, x, x, x, x, x, x, x x 1, x, x, x, x, x, x, x, x, x x 2, x, x, x, x, x, x, x, x, x x 3, x, x, x, x, x, x, x, x, x x 4, x, x, x, x, x, x, x, x, x x 5, x, x, x, x, x, x, x, x, x x 6, x, x, x, x, x, x, x, x, x x 7, x, x, x, x, x, x, x, x, x x 8, x, x, x, x, x, x, x, x, x x 9, x, x, x, x, x, x, x, x, x x 10, x, x, x, x, x, x, x, x, x x 11, x, x, x, x, x, x, x, x, x, x 20 -run advanced -matrix max # of tests = Xlarge + Xsmall + 1
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 21 -run advanced -matrix point -num_large 2 -num_small 3 # of tests = 1
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 22 -run simple
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 23 -run normal
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 24 -run oltp
© 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 25 -run dss
© 2011-2012 Pythian Orion I/O Performance Metrics • Small IOs • iops - average number of IOs per second • {test name}_{date}_{time}_iops.csv • lat - average IO response time • {test name}_{date}_{time}_lat.csv • Large IOs • mbps - throughput MB per second • {test name}_{date}_{time}_mbps.csv 26
© 2011-2012 Pythian Sample for -matrix detailed 27 Large/Small, 1, 2, 3, 4, 5 0, 58, 114, 117, 127, 84 1, 11, 29, 49, 63, 81 2, 12, 23, 30, 24, 31 iops Large/Small, 1, 2, 3, 4, 5 0, 17184.84, 17487.14, 25594.11, 31505.73, 59205.26 1, 88272.75, 66781.92, 60642.59, 62514.76, 61699.40 2, 80854.55, 83085.06, 99019.72, 155528.65, 156500.44 lat (us) Large/Small, 0, 1, 2, 3, 4, 5 1, 18.35, 12.14, 15.99, 16.99, 16.48, 16.37 2, 29.74, 27.07, 25.19, 21.18, 13.04, 13.33 mbps
© 2011-2012 Pythian Sample for -matrix basic 28 Large/Small, 1, 2, 3, 4, 5 0, 80, 153, 165, 163, 197 1 2 iops Large/Small, 1, 2, 3, 4, 5 0, 12370.09, 13060.23, 18112.16, 24448.27, 25250.33 1 2 lat (us) Large/Small, 0, 1, 2, 3, 4, 5 1, 31.84 2, 29.87 mbps
© 2011-2012 Pythian Trace file content ran (small): VLun = 0 Size = 10737418240 ran (small): Index = 0 Avg Lat = 22996.61 us Count = 431 ran (small): Index = 1 Avg Lat = 23825.39 us Count = 417 ran (small): nio=848 nior=652 niow=196 req w%=25 act w%=23 ran (small): my 2 oth 1 iops 65 lat 26081 us, bw = 0.51 MBps dur 9.96 s size 8 K, min lat 932 us, max lat 227524 us READ ran (small): my 2 oth 1 iops 19 lat 14499 us, bw = 0.15 MBps dur 9.96 s size 8 K, min lat 1422 us, max lat 120529 us WRITE ran (small): my 2 oth 1 iops 85 lat 23404 us, bw = 0.66 MBps dur 9.96 s size 8 K, min lat 932 us, max lat 227524 us TOTAL seq (large): VLun = 0 Size = 10737418240 seq (large): Index = 0 Avg Lat = 22038.99 us Count = 450 seq (large): Stream = 0 VLun = 0 Start = 2675965952 End = 3152019456 seq (large): Stream = 0 Avg Lat = 22038.99 us CIO = 1 NIO Count = 450 seq (large): nio=450 nior=450 niow=0 req w%=25 act w%=0 seq (large): my 1 oth 2 iops 45 lat 22039 us, bw = 45.22 MBps dur 9.95 s size 1024 K, min lat 9976 us, max lat 223534 us READ seq (large): my 1 oth 2 iops 0 lat 0 us, bw = 0.00 MBps dur 9.95 s size 1024 K, min lat 18446744073709551614 us, max lat 0 us WRITE seq (large): my 1 oth 2 iops 45 lat 22039 us, bw = 45.22 MBps dur 9.95 s size 1024 K, min lat 9976 us, max lat 223534 us TOTAL 29
© 2011-2012 Pythian Concurrent I/O requests = number of outstanding I/ 30 Separate process for large and small
© 2011-2012 Pythian Setting Scale of Concurrent I/Os • Range of concurrency is {0..max} • unless specified with -num_small or -num_large or fixed by run type • max for small IOs • num_disks * 5 for advanced, simple and normal runs • num_disks * 20 for OLTP run • max for large IOs • num_disks * 2 for advanced, simple and normal runs • num_disks * 15 for DSS run 31
© 2011-2012 Pythian OLTP and DSS runs are impractical* • Range of concurrency is {0..max} • unless specified with -num_small or -num_large or fixed by run type • max for small IOs • num_disks * 5 for advanced, simple and normal runs • num_disks * 20 for oltp run • max for large IOs • num_disks * 2 for advanced, simple and normal runs • num_disks * 15 for dss run 32 20 steps with interval num_disks {num_disks..num_disks*20) To much concurrency 15 steps with interval num_disks {num_disks..num_disks*15) * 11.2.0.3 behavior
© 2011-2012 Pythian Orion command-line syntax required arguments: -testname & -run orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -num_streamIO {num} -size_large {Kb} -type rand|seq -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 33 Defines input file with the list of disks {testname}.lun in the current directory # cat mytest.lun /dev/sdc /dev/sdd /dev/sde
© 2011-2012 Pythian Orion command-line syntax -run normal orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration 60 -num_disks {disks} -num_large {num} -type rand -num_streamIO {num} -size_large 1024 -num_small {num} -size_small 8 -simulate concat -stripe 1 -write 0 -cache_size {MB} -verbose 34 this is preset this can’t be this can be set
© 2011-2012 Pythian Orion command-line syntax -run simple orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration 60 -num_disks {disks} -num_large {num} -type rand -num_streamIO {num} -size_large 1024 -num_small {num} -size_small 8 -simulate concat -stripe 1 -write 0 -cache_size {MB} -verbose 35 this is preset this can’t be this can be set
© 2011-2012 Pythian Orion command-line syntax -run oltp orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large 0 -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 36 this is preset this can’t be this can be set
© 2011-2012 Pythian Orion command-line syntax -run dss orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small 0 -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 37 this is preset this can’t be this can be set
© 2011-2012 Pythian Orion command-line syntax -run advanced -matrix detailed | basic | max orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 38 this can’t be this can be set
© 2011-2012 Pythian Orion command-line syntax -run advanced -matrix col orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 39 this must be set this can’t be this can be set
© 2011-2012 Pythian Orion command-line syntax -run advanced -matrix row orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 40 this must be set this can’t be this can be set
© 2011-2012 Pythian Orion command-line syntax -run advanced -matrix point orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 41 this must be set this can’t be this can be set
© 2011-2012 Pythian Orion command-line syntax -simulate raid0 orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 42 Great way to simulate ASM striping
© 2011-2012 Pythian Orion command-line syntax -type seq orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num default 4} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 43
© 2011-2012 Pythian Orion Sequential I/O 44 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 1 1 1 1 2 2 2 2 3 3 3 3 4 4 4 4 5 5 5 -num_streamIO 1 -num_streamIO 4 Schedule one IO request and wait Schedule one IO request and wait Schedule one IO request and wait Schedule four IO requests and wait Schedule four IO requests and wait Schedule four IO requests and wait
© 2011-2012 Pythian What I/O in Oracle behaves like - num_streamIO 4? • Some examples: • serial direct parallel read • ARCH reads of redo logs • some operations with temporary segments • How do you verify/know? • Enable 10046 trace and OS trace (strace/truss/tusc) 45 * needs verification *
© 2011-2012 Pythian Orion Flexibility (Inflexibility?) 46 • Single Orion run is enough to assess scalability at defined settings • Need several separate Orion runs to vary • write % • large IO pattern • IO size • striping • Need multiple concurrent runs to • simulate more complex IO patterns • simulate RAC
© 2011-2012 Pythian Scenarios: OLTP traffic • -run advanced -matrix row -large_num 0 • Shadow processes’ “db file sequential reads” • DBWR’s “db file parallel write” • Optionally several runs with different settings like -write % • Analyze IOPS & response time 47
© 2011-2012 Pythian Scenarios: OLTP traffic visualization Oracle Database Appliance example 48 ODA: Small IOPS scalability / HDDs IOResponseTime,ms 0 5 10 15 20 25 Throughput,IOPS 0 1 000 2 000 3 000 4 000 5 000 1 2 3 4 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 IOPS Response Time
© 2011-2012 Pythian Scenarios: OLTP traffic variation analysis Varying write percentage in ODA 49 Small IOPS by writes percentage Oracle Database Appliance / OLPT / whole HDDs IOResponseTime,ms 0 10 20 30 40 50 60 70 80 Throughput,IOPS 0 1 000 2 000 3 000 4 000 5 000 6 000 7 000 Concurrent IO requests 20 40 60 80 100 120 140 160 180 200 220 240 260 280 300 320 340 360 380 400 IOPS wrt 0% IOPS wrt 10% IOPS wrt 20% IOPS wrt 40% IOPS wrt 60% Latency wrt 0% Latency wrt 10% Latency wrt 20% Latency wrt 40% Latency wrt 60%
© 2011-2012 Pythian Scenarios: OLTP traffic variation analysis Write percentage adjusted for ASM mirroring 50 Small IOPS by writes percentage Oracle Database Appliance / OLPT / whole HDDs IOResponseTime,ms 0 10 20 30 40 50 60 70 80 Throughput,IOPS 0 1 000 2 000 3 000 4 000 5 000 6 000 7 000 Concurrent IO requests 20 40 60 80 100 120 140 160 180 200 220 240 260 280 300 320 340 360 380 400 IOPS wrt 0% IOPS wrt 4% IOPS wrt 8% IOPS wrt 18% IOPS wrt 33% Latency wrt 0% Latency wrt 4% Latency wrt 8% Latency wrt 18% Latency wrt 33%
© 2011-2012 Pythian Impact of writes on RAID5 is huge 40% writes => 4 times lower IOPS 51
© 2011-2012 Pythian Same disks reconfigured as RAID1+0 40% writes => less than 50% hit 52
© 2011-2012 Pythian Scenarios: Data Warehouse queries • -run advanced -matrix col -small_num 0 • Keep read only (-write 0) • Concurrent users environment • -type rand • Single dedicated user performance • -type seq • -num_streamIO 1 • Most reads in the DB are synchronous • Analyze MBPS 53
© 2011-2012 Pythian Scenarios: Data Warehouse IO visualization 54 Large IOs throughput Throughput,MBPS 0 75 150 225 300 Concurrent threads 1 2 4 6 8 10 12 14 18 20 22 24 26 28 30 32
© 2011-2012 Pythian Scenarios: RMAN backup • -run advanced -matrix col -small_num 0 -type seq -num_streamIO 1 • Backup source only => -write 0 • Backup destination only => -write 100 • Database and backup destination combined => -write 50 • Watch for actual write percentage • 1 thread => 0% actual writes • 2 threads => 50% actual writes • 3 threads => 33% actual writes • 4 threads => 50% actual writes and etc... • Analyze MBPS 55
© 2011-2012 Pythian Scenarios: LGWR writes • -run advanced -matrix point -small_num 0 -type seq -num_streamIO 1 -write 100 -num_large 1 -size_large 5 • -size_large should be set to average LGWR write size which is often about 5-20k for OLTP systems • -num_large n • multiple instances • multiple LGWR threads in RAC • redo logs multiplexing • Analyze IOPS and response time • Gather from Orion run’s trace file 56
© 2011-2012 Pythian Scenarios: LGWR writes visualization 57 ODA SSD sequential 32K IO streams (tripple mirroring) AverageResponsetime,ms 0,00 0,20 0,40 0,60 0,80 1,00 Writespersecond 0 1600 3200 4800 6400 8000 Concurrent Threads 2 4 6 8 10 12 14 16 IOPS Response Time, ms
© 2011-2012 Pythian Combining different workloads • Start multiple parallel Orion runs • OLTP -matrix point -num_large 0 -num_small X • LGWR -matrix point -num_large 1 -num_small 0 -write 100 • ARCH -matrix point -num_small 0 -write {0 | 50} • RMAN - matrix point -num_small 0 -write {0 | 50} • Add batch data load with large parallel writes • Add batch reporting (DW-like) with large reads 58 Cannot throttle IO other than controlling number of outstanding IOs Cannot schedule a run with repetitive data points - must schedule multiple consecutive runs
© 2011-2012 Pythian EC2 large 5 EBS disks: first run to test scalability 59 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 IOPS 156 326 178 411 532 729 928 1 103 1 023 1 070 964 1 202 1 285 1 232 1 204 1 245 1 352 1 338 1 360 1 149 1 379 1 327 1 334 1 362 1 363 Response time, ms 6,4 6,1 10,2 9,7 9,3 8,2 7,5 7,2 8,8 9,3 11,4 10 10,1 11,3 12,4 12,8 12,6 13,4 14 17,3 15,2 16,5 17,2 17,6 18,2 Initial OTLP test with 5 disks and 20% writes Averageresponsetime,ms 0 5 10 15 20 IOPS 0 350 700 1 050 1 400 Number of concurrent IOs 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 IOPS Response time, ms
© 2011-2012 Pythian Let’s mix in additional I/O workloads DUR=60 # OLTP test of scalability - original first run # /root/orion11203/orion -testname baseoltp -run advanced -duration $DUR -matrix row -num_large 0 -write 20 # OLTP point /root/orion11203/orion -testname oltp -run advanced -duration $DUR -matrix point -num_large 0 -num_small 10 -write 20 & # Adding LGWR /root/orion11203/orion -testname lgwr -run advanced -duration $DUR -matrix point -num_large 1 -num_small 0 -type seq -num_streamIO 1 -size_large 5 -write 100 & # Adding ARCH /root/orion11203/orion -testname arch -run advanced -duration $DUR -matrix point -num_large 2 -num_small 0 -type seq -num_streamIO 1 -size_large 1024 -write 50 & # Backup in 1 channel # /root/orion11203/orion -testname backup -run advanced -duration $DUR -matrix point -num_large 1 -num_small 0 -type seq -num_streamIO 1 -size_large 1024 -write 0 & # Backup in 4 channels # /root/orion11203/orion -testname backup -run advanced -duration $DUR -matrix point -num_large 4 -num_small 0 -type seq -num_streamIO 1 -size_large 1024 -write 0 & wait 60
© 2011-2012 Pythian61 OLTP IOPS Response time, ms LGWR writes LGWR write, ms OLTP only 1306 7,7 OLTP +LGWR 1239 8,1 139 7,1 OLTP+LGWR+ARCH 576 17,4 17 56 OLTP+LGWR+RMAN1 778 12,8 38 26,1 OLTP+LGWR+RMAN4 571 17,5 49 20,3 Responsetime,ms 0 4 8 12 16 20 IOPS 0 300 600 900 1200 1500 OLTP only OLTP +LGWR OLTP+LGWR+ARCH OLTP+LGWR+RMAN1 OLTP+LGWR+RMAN4 OLTP IOPS Response time, ms LGWRwrite,ms 0 15 30 45 60 75 LGWRwritespersecond 0 30 60 90 120 150 LGWR writes LGWR write, ms EC2... visualizing combined workload impact
© 2011-2012 Pythian The best Orion 11.2 new feature 62 Bucket LGWR no ARCH LGWR with ARCH 0 - 128 0 0 128 - 256 0 0 256 - 512 0 0 512 - 1024 1085 1 1024 - 2048 3376 8 2048 - 4096 395 1 4096 - 8192 845 0 8192 - 16384 1406 2 16384 - 32768 1115 161 32768 - 65536 161 699 65536 - 131072 4 169 131072 - 262144 0 17 262144 - 524288 1 10 524288 - 1048576 0 2 1048576 - 2097152 0 1 no ARCH 0-128 128-256 256-512 512-1024 1024-2048 2048-4096 4096-8192 8192-16384 16384-32768 32768-65536 65536-131072 131072-262144 262144-524288 524288-1048576 1048576-2097152 with ARCH Histograms!
© 2011-2012 Pythian Got RAC? Schedule parallel runs on each node 63 HP blades HP Virtual Connect Flex10 Big NetApp box 100 disks
© 2011-2012 Pythian Example of Failed Expectations NetApp NAS, 1 Gbit Ethernet, 42 disks 64 Latency,ms 0,0 7,5 15,0 22,5 30,0 IOPS 0 1000 2000 3000 4000 5000 1 2 3 4 5 10 20 30 40 50 60 70 80 90 100 IOPS Latency Read only Latency,ms 0 10 20 30 40 50 IOPS 0 1000 2000 3000 4000 5000 1 2 3 4 5 10 20 30 40 50 60 70 80 90 100 Read write
© 2011-2012 Pythian Tune-Up Results Switched from Intel to Broadcom NICs and disabled 65 Latency,ms 0 2 4 6 8 10 12 IOPS 0 2000 4000 6000 8000 10000 1 2 3 4 5 10 20 30 40 50 60 70 80 90 100 IOPS Latency Latency,ms 0 2 4 6 8 IOPS 0 2500 5000 7500 10000 12500 15000 1 2 3 4 5 10 20 30 40 50 60 70 80 90 100
© 2011-2012 Pythian Possible “What-If” scenarios 66 • Impact of a failed disk in a RAID group • Different block size • Different ASM allocation unit size (-stripe) • Assess foreign workload impact (shared SAN with other servers) • Test impact of configuration / infrastructure changes • Impact of backup or a batch job • Impact of decreased MTTR target (higher -write %) • Platform stability test (repeating the same data point for many days) • Impact of CPU starvation
© 2011-2012 Pythian Concurrent IOs on axis X is not always the best... 67 ODA: Small IOPS scalability and data placement / HDDs IOResponseTime,ms 0 5 10 15 20 25 Throughput,IOPS 0 1 200 2 400 3 600 4 800 6 000 1 2 3 4 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 IOPS whole disk IOPS outside 40% IOPS inside 60% Latency whole disk Latency outside 40% Latency inside 60%
© 2011-2012 Pythian Smarter presentation 50% IOPS at the same response time 68 ODA: Improving IO throughput by data placement IOPS 0 1200 2400 3600 4800 6000 IO response time 0 5 10 15 20 25 whole disk outside 40% inside 60%
© 2011-2012 Pythian Storage types • Anything as long as ASYNC IO is supported • Local storage (LUNs or filesystem) • NAS via NFS • iSCSI / FC devices (any block or raw device) • Cluster filesystem should work just fine 69
© 2011-2012 Pythian Beware of thin provisioning and other NAS magic • Smart storage technologies play bad jokes • If in doubt - “initialize” disks with non-zeroes 70
© 2011-2012 Pythian Orion 11.2 71 11.2.0.1 11.2.0.2 11.2.0.3 libcell11.so x x x libclntsh.so.11.1 x x libskgxp11.so x x libnnz11.so x x Included in • Database • Grid home • Client (tested Administrative option) Dependencies
© 2011-2012 Pythian Orion with SLOB (Silly Little Oracle Benchmark) • Orion gives more control • Orion is easier to setup • Orion uses very little CPU - it doesn’t do anything with data • Easier to saturate IO subsystem without CPU starvation • Less realistic results if you want to account database CPU use for LIO and processing the data • Less realistic for multiprocess orchestration • SLOB - is more realistic but more difficult to control 72
© 2011-2012 Pythian73 Visualization is the Key
© 2011-2012 Pythian Thank you and Q&A 74 http://www.pythian.com/news/ http://www.facebook.com/pages/The-Pythian-Group/ http://twitter.com/pythian http://www.linkedin.com/company/pythian 1-866-PYTHIAN sales@pythian.com or hr@pythian.com To contact us… To follow us… gorbachev@pythian.com

Recomendados

Benchmarking Oracle I/O Performance with Orion by Alex Gorbachev
Benchmarking Oracle I/O Performance with Orion by Alex GorbachevBenchmarking Oracle I/O Performance with Orion by Alex Gorbachev
Benchmarking Oracle I/O Performance with Orion by Alex GorbachevAlex Gorbachev
 
Oracle 12c Application development
Oracle 12c Application developmentOracle 12c Application development
Oracle 12c Application developmentpasalapudi123
 
Introduction to Graph Databases @ SAI
Introduction to Graph Databases @ SAIIntroduction to Graph Databases @ SAI
Introduction to Graph Databases @ SAIdatablend
 
Optimizing Alert Monitoring with Oracle Enterprise Manager
Optimizing Alert Monitoring with Oracle Enterprise ManagerOptimizing Alert Monitoring with Oracle Enterprise Manager
Optimizing Alert Monitoring with Oracle Enterprise ManagerDatavail
 
Oracle Enterprise Manager 12c - OEM12c Presentation
Oracle Enterprise Manager 12c - OEM12c PresentationOracle Enterprise Manager 12c - OEM12c Presentation
Oracle Enterprise Manager 12c - OEM12c PresentationFrancisco Alvarez
 
Oracle - Enterprise Manager 12c Overview
Oracle - Enterprise Manager 12c OverviewOracle - Enterprise Manager 12c Overview
Oracle - Enterprise Manager 12c OverviewFred Sim
 
EM12c: Capacity Planning with OEM Metrics
EM12c: Capacity Planning with OEM MetricsEM12c: Capacity Planning with OEM Metrics
EM12c: Capacity Planning with OEM MetricsMaaz Anjum
 
Oracle Enterprise Manager Cloud Control 13c for DBAs
Oracle Enterprise Manager Cloud Control 13c for DBAsOracle Enterprise Manager Cloud Control 13c for DBAs
Oracle Enterprise Manager Cloud Control 13c for DBAsGokhan Atil
 

Recomendados

Benchmarking Oracle I/O Performance with Orion by Alex Gorbachev
Benchmarking Oracle I/O Performance with Orion by Alex GorbachevBenchmarking Oracle I/O Performance with Orion by Alex Gorbachev
Benchmarking Oracle I/O Performance with Orion by Alex GorbachevAlex Gorbachev
 
Oracle 12c Application development
Oracle 12c Application developmentOracle 12c Application development
Oracle 12c Application developmentpasalapudi123
 
Introduction to Graph Databases @ SAI
Introduction to Graph Databases @ SAIIntroduction to Graph Databases @ SAI
Introduction to Graph Databases @ SAIdatablend
 
Optimizing Alert Monitoring with Oracle Enterprise Manager
Optimizing Alert Monitoring with Oracle Enterprise ManagerOptimizing Alert Monitoring with Oracle Enterprise Manager
Optimizing Alert Monitoring with Oracle Enterprise ManagerDatavail
 
Oracle Enterprise Manager 12c - OEM12c Presentation
Oracle Enterprise Manager 12c - OEM12c PresentationOracle Enterprise Manager 12c - OEM12c Presentation
Oracle Enterprise Manager 12c - OEM12c PresentationFrancisco Alvarez
 
Oracle - Enterprise Manager 12c Overview
Oracle - Enterprise Manager 12c OverviewOracle - Enterprise Manager 12c Overview
Oracle - Enterprise Manager 12c OverviewFred Sim
 
EM12c: Capacity Planning with OEM Metrics
EM12c: Capacity Planning with OEM MetricsEM12c: Capacity Planning with OEM Metrics
EM12c: Capacity Planning with OEM MetricsMaaz Anjum
 
Oracle Enterprise Manager Cloud Control 13c for DBAs
Oracle Enterprise Manager Cloud Control 13c for DBAsOracle Enterprise Manager Cloud Control 13c for DBAs
Oracle Enterprise Manager Cloud Control 13c for DBAsGokhan Atil
 
Barga Data Science lecture 3
Barga Data Science lecture 3Barga Data Science lecture 3
Barga Data Science lecture 3Roger Barga
 
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics EngineLDBC council
 
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...Daniel Cukier
 
20180420 hk-the powerofmysql8
20180420 hk-the powerofmysql820180420 hk-the powerofmysql8
20180420 hk-the powerofmysql8Ivan Ma
 
Using Formal Methods to Create Instruction Set Architectures
Using Formal Methods to Create Instruction Set ArchitecturesUsing Formal Methods to Create Instruction Set Architectures
Using Formal Methods to Create Instruction Set ArchitecturesDVClub
 
Computer notes - data structures
Computer notes - data structuresComputer notes - data structures
Computer notes - data structuresecomputernotes
 
Got Big Data? Get OpenSplice!
Got Big Data? Get OpenSplice!Got Big Data? Get OpenSplice!
Got Big Data? Get OpenSplice!Angelo Corsaro
 
OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)Motonori Shindo
 
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)Jing-Doo Wang
 
PGQL: A Language for Graphs
PGQL: A Language for GraphsPGQL: A Language for Graphs
PGQL: A Language for GraphsJean Ihm
 
Autonomous Learning for Autonomous Systems, by Prof. Plamen Angelov
Autonomous Learning for Autonomous Systems, by Prof. Plamen AngelovAutonomous Learning for Autonomous Systems, by Prof. Plamen Angelov
Autonomous Learning for Autonomous Systems, by Prof. Plamen AngelovJenny Midwinter
 
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...Fabian Pedregosa
 
Recurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text AnalysisRecurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text Analysisodsc
 
Graphlab dunning-clustering
Graphlab dunning-clusteringGraphlab dunning-clustering
Graphlab dunning-clusteringTed Dunning
 
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J..."Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...Dataconomy Media
 
Hugaccumulo 121018192044-phpapp02
Hugaccumulo 121018192044-phpapp02Hugaccumulo 121018192044-phpapp02
Hugaccumulo 121018192044-phpapp02Sqrrl
 
Challenges in business analytics
Challenges in business analyticsChallenges in business analytics
Challenges in business analyticsMiklos Koren
 
USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)Ryousei Takano
 
Intel_Datagres_WhiitePaper_120315-1
Intel_Datagres_WhiitePaper_120315-1Intel_Datagres_WhiitePaper_120315-1
Intel_Datagres_WhiitePaper_120315-1Michele Hunter
 
computer notes - Data Structures - 1
computer notes - Data Structures - 1computer notes - Data Structures - 1
computer notes - Data Structures - 1ecomputernotes
 
Peteris Arajs - Where is my data
Peteris Arajs - Where is my dataPeteris Arajs - Where is my data
Peteris Arajs - Where is my dataAndrejs Vorobjovs
 
Maksims Greckis - Trace File Analyzer
Maksims Greckis - Trace File Analyzer Maksims Greckis - Trace File Analyzer
Maksims Greckis - Trace File Analyzer Andrejs Vorobjovs
 

Mais conteúdo relacionado

Semelhante a OTN tour 2015 benchmarking oracle io performance with Orion by Alex Gorbachev

Barga Data Science lecture 3
Barga Data Science lecture 3Barga Data Science lecture 3
Barga Data Science lecture 3Roger Barga
 
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics EngineLDBC council
 
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...Daniel Cukier
 
20180420 hk-the powerofmysql8
20180420 hk-the powerofmysql820180420 hk-the powerofmysql8
20180420 hk-the powerofmysql8Ivan Ma
 
Using Formal Methods to Create Instruction Set Architectures
Using Formal Methods to Create Instruction Set ArchitecturesUsing Formal Methods to Create Instruction Set Architectures
Using Formal Methods to Create Instruction Set ArchitecturesDVClub
 
Computer notes - data structures
Computer notes - data structuresComputer notes - data structures
Computer notes - data structuresecomputernotes
 
Got Big Data? Get OpenSplice!
Got Big Data? Get OpenSplice!Got Big Data? Get OpenSplice!
Got Big Data? Get OpenSplice!Angelo Corsaro
 
OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)Motonori Shindo
 
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)Jing-Doo Wang
 
PGQL: A Language for Graphs
PGQL: A Language for GraphsPGQL: A Language for Graphs
PGQL: A Language for GraphsJean Ihm
 
Autonomous Learning for Autonomous Systems, by Prof. Plamen Angelov
Autonomous Learning for Autonomous Systems, by Prof. Plamen AngelovAutonomous Learning for Autonomous Systems, by Prof. Plamen Angelov
Autonomous Learning for Autonomous Systems, by Prof. Plamen AngelovJenny Midwinter
 
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...Fabian Pedregosa
 
Recurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text AnalysisRecurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text Analysisodsc
 
Graphlab dunning-clustering
Graphlab dunning-clusteringGraphlab dunning-clustering
Graphlab dunning-clusteringTed Dunning
 
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J..."Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...Dataconomy Media
 
Hugaccumulo 121018192044-phpapp02
Hugaccumulo 121018192044-phpapp02Hugaccumulo 121018192044-phpapp02
Hugaccumulo 121018192044-phpapp02Sqrrl
 
Challenges in business analytics
Challenges in business analyticsChallenges in business analytics
Challenges in business analyticsMiklos Koren
 
USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)Ryousei Takano
 
Intel_Datagres_WhiitePaper_120315-1
Intel_Datagres_WhiitePaper_120315-1Intel_Datagres_WhiitePaper_120315-1
Intel_Datagres_WhiitePaper_120315-1Michele Hunter
 
computer notes - Data Structures - 1
computer notes - Data Structures - 1computer notes - Data Structures - 1
computer notes - Data Structures - 1ecomputernotes
 

Semelhante a OTN tour 2015 benchmarking oracle io performance with Orion by Alex Gorbachev (20)

Barga Data Science lecture 3
Barga Data Science lecture 3Barga Data Science lecture 3
Barga Data Science lecture 3
 
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine
8th TUC Meeting – Yinglong Xia (Huawei), Big Graph Analytics Engine
 
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...
Eficiency and Low Cost: Pro Tips for you to save 50% of your money with Googl...
 
20180420 hk-the powerofmysql8
20180420 hk-the powerofmysql820180420 hk-the powerofmysql8
20180420 hk-the powerofmysql8
 
Using Formal Methods to Create Instruction Set Architectures
Using Formal Methods to Create Instruction Set ArchitecturesUsing Formal Methods to Create Instruction Set Architectures
Using Formal Methods to Create Instruction Set Architectures
 
Computer notes - data structures
Computer notes - data structuresComputer notes - data structures
Computer notes - data structures
 
Got Big Data? Get OpenSplice!
Got Big Data? Get OpenSplice!Got Big Data? Get OpenSplice!
Got Big Data? Get OpenSplice!
 
OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)
 
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)
Hadoop con 2016_9_10_王經篤(Jing-Doo Wang)
 
PGQL: A Language for Graphs
PGQL: A Language for GraphsPGQL: A Language for Graphs
PGQL: A Language for Graphs
 
Autonomous Learning for Autonomous Systems, by Prof. Plamen Angelov
Autonomous Learning for Autonomous Systems, by Prof. Plamen AngelovAutonomous Learning for Autonomous Systems, by Prof. Plamen Angelov
Autonomous Learning for Autonomous Systems, by Prof. Plamen Angelov
 
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...
Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Opti...
 
Recurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text AnalysisRecurrent Neural Networks for Text Analysis
Recurrent Neural Networks for Text Analysis
 
Graphlab dunning-clustering
Graphlab dunning-clusteringGraphlab dunning-clustering
Graphlab dunning-clustering
 
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J..."Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...
"Einstürzenden Neudaten: Building an Analytics Engine from Scratch", Tobias J...
 
Hugaccumulo 121018192044-phpapp02
Hugaccumulo 121018192044-phpapp02Hugaccumulo 121018192044-phpapp02
Hugaccumulo 121018192044-phpapp02
 
Challenges in business analytics
Challenges in business analyticsChallenges in business analytics
Challenges in business analytics
 
USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)USENIX NSDI 2016 (Session: Resource Sharing)
USENIX NSDI 2016 (Session: Resource Sharing)
 
Intel_Datagres_WhiitePaper_120315-1
Intel_Datagres_WhiitePaper_120315-1Intel_Datagres_WhiitePaper_120315-1
Intel_Datagres_WhiitePaper_120315-1
 
computer notes - Data Structures - 1
computer notes - Data Structures - 1computer notes - Data Structures - 1
computer notes - Data Structures - 1
 

Mais de Andrejs Vorobjovs

Peteris Arajs - Where is my data
Peteris Arajs - Where is my dataPeteris Arajs - Where is my data
Peteris Arajs - Where is my dataAndrejs Vorobjovs
 
Maksims Greckis - Trace File Analyzer
Maksims Greckis - Trace File Analyzer Maksims Greckis - Trace File Analyzer
Maksims Greckis - Trace File Analyzer Andrejs Vorobjovs
 
Aleksejs Nemirovskis - Manage your data using oracle BDA
Aleksejs Nemirovskis - Manage your data using oracle BDAAleksejs Nemirovskis - Manage your data using oracle BDA
Aleksejs Nemirovskis - Manage your data using oracle BDAAndrejs Vorobjovs
 
My two cents about Mysql backup
My two cents about Mysql backupMy two cents about Mysql backup
My two cents about Mysql backupAndrejs Vorobjovs
 
Middleware upgrade to Oracle Fusion Middleware(FMW) 12c.Real Case stories.
Middleware upgrade to Oracle Fusion Middleware(FMW) 12c.Real Case stories. Middleware upgrade to Oracle Fusion Middleware(FMW) 12c.Real Case stories.
Middleware upgrade to Oracle Fusion Middleware(FMW) 12c.Real Case stories. Andrejs Vorobjovs
 
OTN tour 2015 press release in Russian
OTN tour 2015 press release in RussianOTN tour 2015 press release in Russian
OTN tour 2015 press release in RussianAndrejs Vorobjovs
 
OTN tour 2015 Oracle Enterprise Manager 12c – Proof of Concept
OTN tour 2015 Oracle Enterprise Manager 12c – Proof of ConceptOTN tour 2015 Oracle Enterprise Manager 12c – Proof of Concept
OTN tour 2015 Oracle Enterprise Manager 12c – Proof of ConceptAndrejs Vorobjovs
 
OTN tour Oracle db Cloud by Alex Gorbachev
OTN tour Oracle db Cloud by Alex GorbachevOTN tour Oracle db Cloud by Alex Gorbachev
OTN tour Oracle db Cloud by Alex GorbachevAndrejs Vorobjovs
 
OTN tour 2015 Experience in implementing SSL between oracle db and oracle cli...
OTN tour 2015 Experience in implementing SSL between oracle db and oracle cli...OTN tour 2015 Experience in implementing SSL between oracle db and oracle cli...
OTN tour 2015 Experience in implementing SSL between oracle db and oracle cli...Andrejs Vorobjovs
 
OTN tour 2015 AWR data mining
OTN tour 2015 AWR data miningOTN tour 2015 AWR data mining
OTN tour 2015 AWR data miningAndrejs Vorobjovs
 
OTN tour 2015 opening speech
OTN tour 2015 opening speechOTN tour 2015 opening speech
OTN tour 2015 opening speechAndrejs Vorobjovs
 

Mais de Andrejs Vorobjovs (20)

Peteris Arajs - Where is my data
Peteris Arajs - Where is my dataPeteris Arajs - Where is my data
Peteris Arajs - Where is my data
 
Maksims Greckis - Trace File Analyzer
Maksims Greckis - Trace File Analyzer Maksims Greckis - Trace File Analyzer
Maksims Greckis - Trace File Analyzer
 
Aleksejs Nemirovskis - Manage your data using oracle BDA
Aleksejs Nemirovskis - Manage your data using oracle BDAAleksejs Nemirovskis - Manage your data using oracle BDA
Aleksejs Nemirovskis - Manage your data using oracle BDA
 
LVOUG meetup #18
LVOUG meetup #18LVOUG meetup #18
LVOUG meetup #18
 
LVOUG meetup #17
LVOUG meetup #17LVOUG meetup #17
LVOUG meetup #17
 
My two cents about Mysql backup
My two cents about Mysql backupMy two cents about Mysql backup
My two cents about Mysql backup
 
LVOUG meetup #16
LVOUG meetup #16LVOUG meetup #16
LVOUG meetup #16
 
Middleware upgrade to Oracle Fusion Middleware(FMW) 12c.Real Case stories.
Middleware upgrade to Oracle Fusion Middleware(FMW) 12c.Real Case stories. Middleware upgrade to Oracle Fusion Middleware(FMW) 12c.Real Case stories.
Middleware upgrade to Oracle Fusion Middleware(FMW) 12c.Real Case stories.
 
Top 15 MySQL parameters
Top 15 MySQL parameters Top 15 MySQL parameters
Top 15 MySQL parameters
 
Riga Dev Day vestule
Riga Dev Day vestuleRiga Dev Day vestule
Riga Dev Day vestule
 
Rdd2016 featured talks
Rdd2016 featured talksRdd2016 featured talks
Rdd2016 featured talks
 
Rdd2016 flyer
Rdd2016 flyerRdd2016 flyer
Rdd2016 flyer
 
meetup #15
meetup #15meetup #15
meetup #15
 
OTN tour 2015 press release in Russian
OTN tour 2015 press release in RussianOTN tour 2015 press release in Russian
OTN tour 2015 press release in Russian
 
OTN tour 2015, 100miles
OTN tour 2015, 100milesOTN tour 2015, 100miles
OTN tour 2015, 100miles
 
OTN tour 2015 Oracle Enterprise Manager 12c – Proof of Concept
OTN tour 2015 Oracle Enterprise Manager 12c – Proof of ConceptOTN tour 2015 Oracle Enterprise Manager 12c – Proof of Concept
OTN tour 2015 Oracle Enterprise Manager 12c – Proof of Concept
 
OTN tour Oracle db Cloud by Alex Gorbachev
OTN tour Oracle db Cloud by Alex GorbachevOTN tour Oracle db Cloud by Alex Gorbachev
OTN tour Oracle db Cloud by Alex Gorbachev
 
OTN tour 2015 Experience in implementing SSL between oracle db and oracle cli...
OTN tour 2015 Experience in implementing SSL between oracle db and oracle cli...OTN tour 2015 Experience in implementing SSL between oracle db and oracle cli...
OTN tour 2015 Experience in implementing SSL between oracle db and oracle cli...
 
OTN tour 2015 AWR data mining
OTN tour 2015 AWR data miningOTN tour 2015 AWR data mining
OTN tour 2015 AWR data mining
 
OTN tour 2015 opening speech
OTN tour 2015 opening speechOTN tour 2015 opening speech
OTN tour 2015 opening speech
 

Último

mini mental status format.docx
mini mental status format.docxmini mental status format.docx
mini mental status format.docxPoojaSen20
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsKarinaGenton
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 

Último (20)

mini mental status format.docx
mini mental status format.docxmini mental status format.docx
mini mental status format.docx
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its Characteristics
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 

OTN tour 2015 benchmarking oracle io performance with Orion by Alex Gorbachev

  • 1. Benchmarking Oracle I/O Performance with ORION Alex Gorbachev November 2015
  • 2. Alex Gorbachev • Chief Technology Officer at Pythian • Blogger • Cloudera Champion of Big Data • OakTable Network member • Oracle ACE Director • Founder of BattleAgainstAnyGuess.com • Founder of Sydney Oracle Meetup • EVP, IOUG • EVP, Ottawa Oracle User Group
  • 4. ABOUT PYTHIAN Pythian is a global data outsourcing and consulting company that specializes in optimizing and managing mission-critical data systems. Pythian blends the world’s leading data experts with advanced, secure service delivery processes to create the industry’s best standard of care for its clients. Since its inception, Pythian has managed some of the world’s largest, most business-critical data infrastructures. 4 11,500Pythian currently manages over 11,500 systems. 385Pythian currently employs more than 385 people in 30 countries worldwide. 1997Pythian was founded in 1997 New Q2 2015
  • 6. © 2011-2012 Pythian6 ORION - ORacle I/O Numbers Generate I/O workload similar to database patterns & measure I/O performance
  • 7. © 2011-2012 Pythian7 Orion is designed to stress test the I/O subsystem
  • 8. © 2011-2012 Pythian8 Orion is not perfect for simulation but good enough
  • 9. © 2011-2012 Pythian9 Use Orion before moving/ deploying databases to the new platform
  • 10. © 2011-2012 Pythian10 Orion is used in two scenarios
  • 11. © 2011-2012 Pythian11 You have no idea what you need and want to ensure you get You know what you need and want to ensure you have it or
  • 12. © 2011-2012 Pythian Infrastructure tuning - what’s the goal? • When you don’t know how much you need you try at least to ensure you take all you can • Assess what’s your possible bottlenecks • 1 Gbit Ethernet => 100+ MBPS or 10,000+ IOPS (8K) • 15K RPM disk • will easily serve 100-150 IOPS with average resp. time <10ms • can get to 200-250 IOPS but response time increase to 20 ms • SSD - see vendors specs • reads: random vs sequential... small vs large... no matter • writes: pattern matters 12
  • 13. © 2011-2012 Pythian Orion • Uses code-base similar to Oracle database kernel • Standalone binary or part of Oracle home since 11.2.0.1 • Standalone Orion downloadable version is only 11.1 • Tests only I/O subsystem • Minimal CPU consumption • Async I/O is used to submit concurrent I/O requests • Each run includes multiple data points / tests • Scaling concurrency of small and large I/Os 13
  • 14. © 2011-2012 Pythian Controlling Orion • Workload patterns • Small random I/O size and scale • Large I/O size, scale and pattern (random vs sequential) • Write percentage • Cache warming • Duration of each test (data point) • Data layout (concatenation vs striping) 14
  • 15. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... .............................. .............................. .............................. 15
  • 16. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 16 -run advanced -matrix detailed # of tests = (Xlarge + 1) * (Xsmall + 1)
  • 17. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 17 -run advanced -matrix row -num_large 2 # of tests = Xsmall + 1
  • 18. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 18 -run advanced -matrix col -num_small 3 # of tests = Xlarge + 1
  • 19. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 19 -run advanced -matrix basic # of tests = Xlarge + Xsmall + 1
  • 20. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 0, x, x, x, x, x, x, x, x, x x 1, x, x, x, x, x, x, x, x, x x 2, x, x, x, x, x, x, x, x, x x 3, x, x, x, x, x, x, x, x, x x 4, x, x, x, x, x, x, x, x, x x 5, x, x, x, x, x, x, x, x, x x 6, x, x, x, x, x, x, x, x, x x 7, x, x, x, x, x, x, x, x, x x 8, x, x, x, x, x, x, x, x, x x 9, x, x, x, x, x, x, x, x, x x 10, x, x, x, x, x, x, x, x, x x 11, x, x, x, x, x, x, x, x, x, x 20 -run advanced -matrix max # of tests = Xlarge + Xsmall + 1
  • 21. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 21 -run advanced -matrix point -num_large 2 -num_small 3 # of tests = 1
  • 22. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 22 -run simple
  • 23. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 23 -run normal
  • 24. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 24 -run oltp
  • 25. © 2011-2012 Pythian Data Points Matrix Large/Small, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9... 0, x, x, x, x, x, x, x, x, x, x... 1, x, x, x, x, x, x, x, x, x, x... 2, x, x, x, x, x, x, x, x, x, x... 3, x, x, x, x, x, x, x, x, x, x... 4, x, x, x, x, x, x, x, x, x, x... 5, x, x, x, x, x, x, x, x, x, x... 6, x, x, x, x, x, x, x, x, x, x... 7, x, x, x, x, x, x, x, x, x, x... 8, x, x, x, x, x, x, x, x, x, x... 9, x, x, x, x, x, x, x, x, x, x... 10, x, x, x, x, x, x, x, x, x, x... 11, x, x, x, x, x, x, x, x, x, x... 25 -run dss
  • 26. © 2011-2012 Pythian Orion I/O Performance Metrics • Small IOs • iops - average number of IOs per second • {test name}_{date}_{time}_iops.csv • lat - average IO response time • {test name}_{date}_{time}_lat.csv • Large IOs • mbps - throughput MB per second • {test name}_{date}_{time}_mbps.csv 26
  • 27. © 2011-2012 Pythian Sample for -matrix detailed 27 Large/Small, 1, 2, 3, 4, 5 0, 58, 114, 117, 127, 84 1, 11, 29, 49, 63, 81 2, 12, 23, 30, 24, 31 iops Large/Small, 1, 2, 3, 4, 5 0, 17184.84, 17487.14, 25594.11, 31505.73, 59205.26 1, 88272.75, 66781.92, 60642.59, 62514.76, 61699.40 2, 80854.55, 83085.06, 99019.72, 155528.65, 156500.44 lat (us) Large/Small, 0, 1, 2, 3, 4, 5 1, 18.35, 12.14, 15.99, 16.99, 16.48, 16.37 2, 29.74, 27.07, 25.19, 21.18, 13.04, 13.33 mbps
  • 28. © 2011-2012 Pythian Sample for -matrix basic 28 Large/Small, 1, 2, 3, 4, 5 0, 80, 153, 165, 163, 197 1 2 iops Large/Small, 1, 2, 3, 4, 5 0, 12370.09, 13060.23, 18112.16, 24448.27, 25250.33 1 2 lat (us) Large/Small, 0, 1, 2, 3, 4, 5 1, 31.84 2, 29.87 mbps
  • 29. © 2011-2012 Pythian Trace file content ran (small): VLun = 0 Size = 10737418240 ran (small): Index = 0 Avg Lat = 22996.61 us Count = 431 ran (small): Index = 1 Avg Lat = 23825.39 us Count = 417 ran (small): nio=848 nior=652 niow=196 req w%=25 act w%=23 ran (small): my 2 oth 1 iops 65 lat 26081 us, bw = 0.51 MBps dur 9.96 s size 8 K, min lat 932 us, max lat 227524 us READ ran (small): my 2 oth 1 iops 19 lat 14499 us, bw = 0.15 MBps dur 9.96 s size 8 K, min lat 1422 us, max lat 120529 us WRITE ran (small): my 2 oth 1 iops 85 lat 23404 us, bw = 0.66 MBps dur 9.96 s size 8 K, min lat 932 us, max lat 227524 us TOTAL seq (large): VLun = 0 Size = 10737418240 seq (large): Index = 0 Avg Lat = 22038.99 us Count = 450 seq (large): Stream = 0 VLun = 0 Start = 2675965952 End = 3152019456 seq (large): Stream = 0 Avg Lat = 22038.99 us CIO = 1 NIO Count = 450 seq (large): nio=450 nior=450 niow=0 req w%=25 act w%=0 seq (large): my 1 oth 2 iops 45 lat 22039 us, bw = 45.22 MBps dur 9.95 s size 1024 K, min lat 9976 us, max lat 223534 us READ seq (large): my 1 oth 2 iops 0 lat 0 us, bw = 0.00 MBps dur 9.95 s size 1024 K, min lat 18446744073709551614 us, max lat 0 us WRITE seq (large): my 1 oth 2 iops 45 lat 22039 us, bw = 45.22 MBps dur 9.95 s size 1024 K, min lat 9976 us, max lat 223534 us TOTAL 29
  • 30. © 2011-2012 Pythian Concurrent I/O requests = number of outstanding I/ 30 Separate process for large and small
  • 31. © 2011-2012 Pythian Setting Scale of Concurrent I/Os • Range of concurrency is {0..max} • unless specified with -num_small or -num_large or fixed by run type • max for small IOs • num_disks * 5 for advanced, simple and normal runs • num_disks * 20 for OLTP run • max for large IOs • num_disks * 2 for advanced, simple and normal runs • num_disks * 15 for DSS run 31
  • 32. © 2011-2012 Pythian OLTP and DSS runs are impractical* • Range of concurrency is {0..max} • unless specified with -num_small or -num_large or fixed by run type • max for small IOs • num_disks * 5 for advanced, simple and normal runs • num_disks * 20 for oltp run • max for large IOs • num_disks * 2 for advanced, simple and normal runs • num_disks * 15 for dss run 32 20 steps with interval num_disks {num_disks..num_disks*20) To much concurrency 15 steps with interval num_disks {num_disks..num_disks*15) * 11.2.0.3 behavior
  • 33. © 2011-2012 Pythian Orion command-line syntax required arguments: -testname & -run orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -num_streamIO {num} -size_large {Kb} -type rand|seq -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 33 Defines input file with the list of disks {testname}.lun in the current directory # cat mytest.lun /dev/sdc /dev/sdd /dev/sde
  • 34. © 2011-2012 Pythian Orion command-line syntax -run normal orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration 60 -num_disks {disks} -num_large {num} -type rand -num_streamIO {num} -size_large 1024 -num_small {num} -size_small 8 -simulate concat -stripe 1 -write 0 -cache_size {MB} -verbose 34 this is preset this can’t be this can be set
  • 35. © 2011-2012 Pythian Orion command-line syntax -run simple orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration 60 -num_disks {disks} -num_large {num} -type rand -num_streamIO {num} -size_large 1024 -num_small {num} -size_small 8 -simulate concat -stripe 1 -write 0 -cache_size {MB} -verbose 35 this is preset this can’t be this can be set
  • 36. © 2011-2012 Pythian Orion command-line syntax -run oltp orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large 0 -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 36 this is preset this can’t be this can be set
  • 37. © 2011-2012 Pythian Orion command-line syntax -run dss orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small 0 -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 37 this is preset this can’t be this can be set
  • 38. © 2011-2012 Pythian Orion command-line syntax -run advanced -matrix detailed | basic | max orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 38 this can’t be this can be set
  • 39. © 2011-2012 Pythian Orion command-line syntax -run advanced -matrix col orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 39 this must be set this can’t be this can be set
  • 40. © 2011-2012 Pythian Orion command-line syntax -run advanced -matrix row orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 40 this must be set this can’t be this can be set
  • 41. © 2011-2012 Pythian Orion command-line syntax -run advanced -matrix point orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 41 this must be set this can’t be this can be set
  • 42. © 2011-2012 Pythian Orion command-line syntax -simulate raid0 orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 42 Great way to simulate ASM striping
  • 43. © 2011-2012 Pythian Orion command-line syntax -type seq orion -testname {testname} -run advanced | normal | simple | oltp | dss -matrix detailed | col | row | basic | max | point -duration {seconds} -num_disks {disks} -num_large {num} -type rand|seq -num_streamIO {num default 4} -size_large {Kb} -num_small {num} -size_small {Kb} -simulate concat|raid0 -stripe {Mb} -write {%} -cache_size {MB} -verbose 43
  • 44. © 2011-2012 Pythian Orion Sequential I/O 44 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 1 1 1 1 2 2 2 2 3 3 3 3 4 4 4 4 5 5 5 -num_streamIO 1 -num_streamIO 4 Schedule one IO request and wait Schedule one IO request and wait Schedule one IO request and wait Schedule four IO requests and wait Schedule four IO requests and wait Schedule four IO requests and wait
  • 45. © 2011-2012 Pythian What I/O in Oracle behaves like - num_streamIO 4? • Some examples: • serial direct parallel read • ARCH reads of redo logs • some operations with temporary segments • How do you verify/know? • Enable 10046 trace and OS trace (strace/truss/tusc) 45 * needs verification *
  • 46. © 2011-2012 Pythian Orion Flexibility (Inflexibility?) 46 • Single Orion run is enough to assess scalability at defined settings • Need several separate Orion runs to vary • write % • large IO pattern • IO size • striping • Need multiple concurrent runs to • simulate more complex IO patterns • simulate RAC
  • 47. © 2011-2012 Pythian Scenarios: OLTP traffic • -run advanced -matrix row -large_num 0 • Shadow processes’ “db file sequential reads” • DBWR’s “db file parallel write” • Optionally several runs with different settings like -write % • Analyze IOPS & response time 47
  • 48. © 2011-2012 Pythian Scenarios: OLTP traffic visualization Oracle Database Appliance example 48 ODA: Small IOPS scalability / HDDs IOResponseTime,ms 0 5 10 15 20 25 Throughput,IOPS 0 1 000 2 000 3 000 4 000 5 000 1 2 3 4 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 IOPS Response Time
  • 49. © 2011-2012 Pythian Scenarios: OLTP traffic variation analysis Varying write percentage in ODA 49 Small IOPS by writes percentage Oracle Database Appliance / OLPT / whole HDDs IOResponseTime,ms 0 10 20 30 40 50 60 70 80 Throughput,IOPS 0 1 000 2 000 3 000 4 000 5 000 6 000 7 000 Concurrent IO requests 20 40 60 80 100 120 140 160 180 200 220 240 260 280 300 320 340 360 380 400 IOPS wrt 0% IOPS wrt 10% IOPS wrt 20% IOPS wrt 40% IOPS wrt 60% Latency wrt 0% Latency wrt 10% Latency wrt 20% Latency wrt 40% Latency wrt 60%
  • 50. © 2011-2012 Pythian Scenarios: OLTP traffic variation analysis Write percentage adjusted for ASM mirroring 50 Small IOPS by writes percentage Oracle Database Appliance / OLPT / whole HDDs IOResponseTime,ms 0 10 20 30 40 50 60 70 80 Throughput,IOPS 0 1 000 2 000 3 000 4 000 5 000 6 000 7 000 Concurrent IO requests 20 40 60 80 100 120 140 160 180 200 220 240 260 280 300 320 340 360 380 400 IOPS wrt 0% IOPS wrt 4% IOPS wrt 8% IOPS wrt 18% IOPS wrt 33% Latency wrt 0% Latency wrt 4% Latency wrt 8% Latency wrt 18% Latency wrt 33%
  • 51. © 2011-2012 Pythian Impact of writes on RAID5 is huge 40% writes => 4 times lower IOPS 51
  • 52. © 2011-2012 Pythian Same disks reconfigured as RAID1+0 40% writes => less than 50% hit 52
  • 53. © 2011-2012 Pythian Scenarios: Data Warehouse queries • -run advanced -matrix col -small_num 0 • Keep read only (-write 0) • Concurrent users environment • -type rand • Single dedicated user performance • -type seq • -num_streamIO 1 • Most reads in the DB are synchronous • Analyze MBPS 53
  • 54. © 2011-2012 Pythian Scenarios: Data Warehouse IO visualization 54 Large IOs throughput Throughput,MBPS 0 75 150 225 300 Concurrent threads 1 2 4 6 8 10 12 14 18 20 22 24 26 28 30 32
  • 55. © 2011-2012 Pythian Scenarios: RMAN backup • -run advanced -matrix col -small_num 0 -type seq -num_streamIO 1 • Backup source only => -write 0 • Backup destination only => -write 100 • Database and backup destination combined => -write 50 • Watch for actual write percentage • 1 thread => 0% actual writes • 2 threads => 50% actual writes • 3 threads => 33% actual writes • 4 threads => 50% actual writes and etc... • Analyze MBPS 55
  • 56. © 2011-2012 Pythian Scenarios: LGWR writes • -run advanced -matrix point -small_num 0 -type seq -num_streamIO 1 -write 100 -num_large 1 -size_large 5 • -size_large should be set to average LGWR write size which is often about 5-20k for OLTP systems • -num_large n • multiple instances • multiple LGWR threads in RAC • redo logs multiplexing • Analyze IOPS and response time • Gather from Orion run’s trace file 56
  • 57. © 2011-2012 Pythian Scenarios: LGWR writes visualization 57 ODA SSD sequential 32K IO streams (tripple mirroring) AverageResponsetime,ms 0,00 0,20 0,40 0,60 0,80 1,00 Writespersecond 0 1600 3200 4800 6400 8000 Concurrent Threads 2 4 6 8 10 12 14 16 IOPS Response Time, ms
  • 58. © 2011-2012 Pythian Combining different workloads • Start multiple parallel Orion runs • OLTP -matrix point -num_large 0 -num_small X • LGWR -matrix point -num_large 1 -num_small 0 -write 100 • ARCH -matrix point -num_small 0 -write {0 | 50} • RMAN - matrix point -num_small 0 -write {0 | 50} • Add batch data load with large parallel writes • Add batch reporting (DW-like) with large reads 58 Cannot throttle IO other than controlling number of outstanding IOs Cannot schedule a run with repetitive data points - must schedule multiple consecutive runs
  • 59. © 2011-2012 Pythian EC2 large 5 EBS disks: first run to test scalability 59 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 IOPS 156 326 178 411 532 729 928 1 103 1 023 1 070 964 1 202 1 285 1 232 1 204 1 245 1 352 1 338 1 360 1 149 1 379 1 327 1 334 1 362 1 363 Response time, ms 6,4 6,1 10,2 9,7 9,3 8,2 7,5 7,2 8,8 9,3 11,4 10 10,1 11,3 12,4 12,8 12,6 13,4 14 17,3 15,2 16,5 17,2 17,6 18,2 Initial OTLP test with 5 disks and 20% writes Averageresponsetime,ms 0 5 10 15 20 IOPS 0 350 700 1 050 1 400 Number of concurrent IOs 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 IOPS Response time, ms
  • 60. © 2011-2012 Pythian Let’s mix in additional I/O workloads DUR=60 # OLTP test of scalability - original first run # /root/orion11203/orion -testname baseoltp -run advanced -duration $DUR -matrix row -num_large 0 -write 20 # OLTP point /root/orion11203/orion -testname oltp -run advanced -duration $DUR -matrix point -num_large 0 -num_small 10 -write 20 & # Adding LGWR /root/orion11203/orion -testname lgwr -run advanced -duration $DUR -matrix point -num_large 1 -num_small 0 -type seq -num_streamIO 1 -size_large 5 -write 100 & # Adding ARCH /root/orion11203/orion -testname arch -run advanced -duration $DUR -matrix point -num_large 2 -num_small 0 -type seq -num_streamIO 1 -size_large 1024 -write 50 & # Backup in 1 channel # /root/orion11203/orion -testname backup -run advanced -duration $DUR -matrix point -num_large 1 -num_small 0 -type seq -num_streamIO 1 -size_large 1024 -write 0 & # Backup in 4 channels # /root/orion11203/orion -testname backup -run advanced -duration $DUR -matrix point -num_large 4 -num_small 0 -type seq -num_streamIO 1 -size_large 1024 -write 0 & wait 60
  • 61. © 2011-2012 Pythian61 OLTP IOPS Response time, ms LGWR writes LGWR write, ms OLTP only 1306 7,7 OLTP +LGWR 1239 8,1 139 7,1 OLTP+LGWR+ARCH 576 17,4 17 56 OLTP+LGWR+RMAN1 778 12,8 38 26,1 OLTP+LGWR+RMAN4 571 17,5 49 20,3 Responsetime,ms 0 4 8 12 16 20 IOPS 0 300 600 900 1200 1500 OLTP only OLTP +LGWR OLTP+LGWR+ARCH OLTP+LGWR+RMAN1 OLTP+LGWR+RMAN4 OLTP IOPS Response time, ms LGWRwrite,ms 0 15 30 45 60 75 LGWRwritespersecond 0 30 60 90 120 150 LGWR writes LGWR write, ms EC2... visualizing combined workload impact
  • 62. © 2011-2012 Pythian The best Orion 11.2 new feature 62 Bucket LGWR no ARCH LGWR with ARCH 0 - 128 0 0 128 - 256 0 0 256 - 512 0 0 512 - 1024 1085 1 1024 - 2048 3376 8 2048 - 4096 395 1 4096 - 8192 845 0 8192 - 16384 1406 2 16384 - 32768 1115 161 32768 - 65536 161 699 65536 - 131072 4 169 131072 - 262144 0 17 262144 - 524288 1 10 524288 - 1048576 0 2 1048576 - 2097152 0 1 no ARCH 0-128 128-256 256-512 512-1024 1024-2048 2048-4096 4096-8192 8192-16384 16384-32768 32768-65536 65536-131072 131072-262144 262144-524288 524288-1048576 1048576-2097152 with ARCH Histograms!
  • 63. © 2011-2012 Pythian Got RAC? Schedule parallel runs on each node 63 HP blades HP Virtual Connect Flex10 Big NetApp box 100 disks
  • 64. © 2011-2012 Pythian Example of Failed Expectations NetApp NAS, 1 Gbit Ethernet, 42 disks 64 Latency,ms 0,0 7,5 15,0 22,5 30,0 IOPS 0 1000 2000 3000 4000 5000 1 2 3 4 5 10 20 30 40 50 60 70 80 90 100 IOPS Latency Read only Latency,ms 0 10 20 30 40 50 IOPS 0 1000 2000 3000 4000 5000 1 2 3 4 5 10 20 30 40 50 60 70 80 90 100 Read write
  • 65. © 2011-2012 Pythian Tune-Up Results Switched from Intel to Broadcom NICs and disabled 65 Latency,ms 0 2 4 6 8 10 12 IOPS 0 2000 4000 6000 8000 10000 1 2 3 4 5 10 20 30 40 50 60 70 80 90 100 IOPS Latency Latency,ms 0 2 4 6 8 IOPS 0 2500 5000 7500 10000 12500 15000 1 2 3 4 5 10 20 30 40 50 60 70 80 90 100
  • 66. © 2011-2012 Pythian Possible “What-If” scenarios 66 • Impact of a failed disk in a RAID group • Different block size • Different ASM allocation unit size (-stripe) • Assess foreign workload impact (shared SAN with other servers) • Test impact of configuration / infrastructure changes • Impact of backup or a batch job • Impact of decreased MTTR target (higher -write %) • Platform stability test (repeating the same data point for many days) • Impact of CPU starvation
  • 67. © 2011-2012 Pythian Concurrent IOs on axis X is not always the best... 67 ODA: Small IOPS scalability and data placement / HDDs IOResponseTime,ms 0 5 10 15 20 25 Throughput,IOPS 0 1 200 2 400 3 600 4 800 6 000 1 2 3 4 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 IOPS whole disk IOPS outside 40% IOPS inside 60% Latency whole disk Latency outside 40% Latency inside 60%
  • 68. © 2011-2012 Pythian Smarter presentation 50% IOPS at the same response time 68 ODA: Improving IO throughput by data placement IOPS 0 1200 2400 3600 4800 6000 IO response time 0 5 10 15 20 25 whole disk outside 40% inside 60%
  • 69. © 2011-2012 Pythian Storage types • Anything as long as ASYNC IO is supported • Local storage (LUNs or filesystem) • NAS via NFS • iSCSI / FC devices (any block or raw device) • Cluster filesystem should work just fine 69
  • 70. © 2011-2012 Pythian Beware of thin provisioning and other NAS magic • Smart storage technologies play bad jokes • If in doubt - “initialize” disks with non-zeroes 70
  • 71. © 2011-2012 Pythian Orion 11.2 71 11.2.0.1 11.2.0.2 11.2.0.3 libcell11.so x x x libclntsh.so.11.1 x x libskgxp11.so x x libnnz11.so x x Included in • Database • Grid home • Client (tested Administrative option) Dependencies
  • 72. © 2011-2012 Pythian Orion with SLOB (Silly Little Oracle Benchmark) • Orion gives more control • Orion is easier to setup • Orion uses very little CPU - it doesn’t do anything with data • Easier to saturate IO subsystem without CPU starvation • Less realistic results if you want to account database CPU use for LIO and processing the data • Less realistic for multiprocess orchestration • SLOB - is more realistic but more difficult to control 72
  • 74. © 2011-2012 Pythian Thank you and Q&A 74 http://www.pythian.com/news/ http://www.facebook.com/pages/The-Pythian-Group/ http://twitter.com/pythian http://www.linkedin.com/company/pythian 1-866-PYTHIAN sales@pythian.com or hr@pythian.com To contact us… To follow us… gorbachev@pythian.com