Stress testing using SQLIOSIM and SQLIO

Click to edit Master title style

LiveMeeting: Stress Testing
using SQLIOSIM and SQLIO

Steve Verschaeve

TechNet goes virtual
© Microsoft Corporation. All Rights Reserved.

Who am I?

Blog.steveverschaeve.be
steve@sqlug.be
@sql_lazywriter

Agenda

• SQLIOSIM & SQLIO
– What is it?
– What is it not?
– Where can I find it?
– What does it look like?
– Demos
– To remember



Part I

SQLIOSIM


SQLIOSIM – What is it?

• Developed by Bob Dorr (Microsoft)
• Generates/simulates a SQL Server workload
• To test reliability and integrity of disk systems
• Read
• Write
• Checkpoint
• Backup
• Sort
• Read-ahead
• Shrink

SQLIOSIM - What is it not?

• Is NOT an I/O performance tuning tool
• “Don't consider SQLIOSim for
performance benchmarking, instead
use SQLIO Disk Subsystem Benchmark
Tool” (Microsoft Customer Service and
Support (CSS) SQL Support blog)


Click to edit Master title styleI find it?
SQLIOSIM – Where can

• < SQL Server 2008: seperate download
• >= SQL Server 2008(R2): BINN folder
• SQLIOSIM Download


SQLIOSIM - Anatomy

• SQLIOSIM.exe (Application)
• SQLIOSIM.com (MS-DOS Application)
• SQLIOSIM.cfg
• SQLIOSIM.cfg.zip
• SQLIOSIM.log
• ErrorLog


SQLIOSIM.exe


SQLIOSIM.COM

All settings and parameters explained in KB231619


SQLIOSIM – Config


SQLIOSIM – What does it
Click to edit Master title style look like?

• Demo 1: SQLIOSIM.exe
• Demo 2: SQLIOSIM.com


SQLIOSIM – Parsing the results

SQLIOSim Parser
by Jens Suessmeyer &
Jimmy May
• Export to XML, CSV
• Display Report


Click to edit Master title style Templates
SQLIOSIM – Configuration

• Default.cfg.ini: common testing
• Hwcache.cfg.ini: hardware cache
behaviour
• Nothrottle.cfg.ini: pushing the system
and drivers at high queue levels
• Seqwrites.cfg.ini: BCP and restore
• Sparse.cfg.ini: DBCC and snapshots


Click to edit Master title stylerunning on a production server?
SQLIOSIM - What about

• Might expose IO errors
• Generates MDFx and LDFx files
• When IO checksums occur in the error log



Part II

SQLIO


SQLIO – What is it?

• Determine I/O capacity of disk subsystem
• Tested by different I/O types and sizes
– Read/Write
– Random/Sequential
– Threads
– Outstanding files
– Block size


SQLIO – What is it not?

• Not a simulation tool for I/O patterns
• Not really a SQL Server tool


Click to edit Master title style it?
SQLIO – Where can I find

• SQLIO Disk Subsystem Benchmark Tool:
http://www.microsoft.com/en-
us/download/details.aspx?id=20163


Click to edit Anatomy style
SQLIO - Master title

• SQLIO.exe
Same Directory
• Param.txt
– c:testfile.dat 2 0x0 1000

• Size(testfile.dat) = (2 to 4) x SAN or disk
cache


Click to edit Master title Use
SQLIO – Parameter style

• Using a param file:
sqlio -kW -s10 -fsequential -t8 -o8 -b8 –BH -LS -Fparam.txt

Read/ Duration Sequential/ Threads Outstanding Block Hardware Latencies Parameter file
Write Random Files Size Buffering from system Location & Name
Test File

• sqlio -kR -s10 -frandom –t8 –o8 -b8 -BH -LS -dC Testfile.dat


Click to edit Master Test style
SQLIO – Stress title Configuration Parameters


Click to edit Master Test style
SQLIO – Stress title Configuration Parameters

• Batch file
sqlio -kR -t1 -s120 -dC -o1 -fsequential -b8 -BH -LS Testfile.dat



Click to edit Execution style
SQLIO - Master title

• Example

• Batch file example
C:Program Files (x86)SQLIOSQLIOStressTest.bat >Results.txt


SQLIO – What does it look
Click to edit Master title style like?

• Demo: SQLIO


Click to edit Masterfile Example & Results
SQLIO – Batch title style


SQLIO – The Results

2500

2000

1500

1000 Sum of Threads
Sum of Block Size
Sum of Outstanding Files
500 Sum of Avg Latency(ms)

0
0.71
0.79
0.95
1.09
1.13
1.19
1.20
1.21
1.23
40.44
41.66
41.86
41.91
42.70
43.42
43.48
43.55
43.91
44.65
45.10
45.49
45.83
46.01
46.28
48.70
Random Sequential

Read Write


SQLIO – To Remember

• More outstanding files = higher queue depth =
higher throughput (until saturated)
• Larger I/O sizes
– higher latencies
– Increased throughput (depends on hardware config)
• Saturation = Lantency keeps rising while
throughput is stable
• Monitor saturation
– Average Disk Queue Length (outstanding IOs)
– Disk Reads/sec (IOs per sec)
– Average Disk sec/read (latency)


SQLIO – To Remember

• TempDB: High IOPS
• Data: 8K or 64K random (read/write), High
IOPS
(4-10ms; >100ms = issue)
• Log: High MB/sec (<2ms)
• Backup: High MB/sec, sequential
(read/write)


SQLIO – Tips from the field

• Wait > 1 min between tests
• First test = buidling the test file
• Duration of test = 5 to 10 min
• Keep batch file and results for future
reference


SQLIOSIM - Important links

• SQLIOSIM Download (Microsoft)
• SQL Server 2000 I/O Basics (Microsoft)
• SQL Server I/O Basics, Chapter 2 (Microsoft)
• How to use the SQLIOSim utility to simulate SQL
Server activity on a disk subsystem (Q231619)
• Understanding SQLIOSIM output (Kevin Kline)
• How It Works: SQLIOSim – Checksums
(Microsoft)
• SQLIOSIM Parser (Jens K. Suessmeyer & Jimmy
May)


SQLIO – Important Links

• Storage Performance Testing with SQLIO
(Brent Ozar)
• SAN Performance Tuning with SQLIO
(SQL Server Pedia)
• Parsing SQLIO Output to Excel Charts
using Regex in PowerShell (Jonathan
Kehayias)


Questions?

Steve@sqlug.be



Thank you


Stress testing using SQLIOSIM and SQLIO

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (20)

Semelhante a Stress testing using SQLIOSIM and SQLIO

Semelhante a Stress testing using SQLIOSIM and SQLIO (20)

Mais de Microsoft TechNet - Belgium and Luxembourg

Mais de Microsoft TechNet - Belgium and Luxembourg (20)

Último

Último (20)

Stress testing using SQLIOSIM and SQLIO