By now, Tier 1 apps deployed on flash is ubiquitous. However, Tier 2 apps often remain relegated to spinning media. This presentation explains the economics of consolidating on flash. Owing to the SQL Server core licensing model, licensing a 2-socket commodity server can cost up to $500,000 or more! Consolidating instances on flash can—and does—save hundreds of thousands to millions of dollars. This presentation provides real-life case studies showing such real-life savings.
Let’s talk about the I/O Blender effect for a moment.
The best I/O is the one you don’t have to do. —Gene Amdahl via @RichBaumet #faster
https://en.wikipedia.org/wiki/Amdahl%27s_law
The theoretical speedup in latency of the execution of a task at fixed workload that can be expected of a system whose resources are improved.
SanDisk hired DB Best Technologies to test SQL workload consolidation scenarios using hard drives, SanDisk FlashSoft caching software, and all-flash with SanDisk Fusion ioMemory. We’ll publish a detailed whitepaper shortly, but wanted to give you a sneak peek at the results. This testing was done using shipping software, they Hyper-V role of Windows Server 2012 R2 and SQL Server 2014.
This test was run with 24 x 15k RPM hard drives, and an increasing number of VMs. The VHDs for the VMs are all stored on the hard drives.
The vertical axis is Transactions Per Second x1000.
The horizontal axis is number of VMs running a TPC-C like transactional workload.
You can see that the maximum TPS occurs at 7 VMs with just over 30,000 TPS from those 7 VMs.
As more VMs are added, the total TPS delivered to the host declines – the I/O Blender effect maxes out the underlying storage system, and the amount of work the host can deliver declines to about 50% of its peak.
How would your customers react if you told them you could make that same system support 3 times as many workloads?
The top line uses SanDisk Fusion ioMemory, our PCIe add-in card. In this scenario, all the VHD files are hosted on ioMemory. You can see that the performance flattens out around 80,000 Transactions Per Second with 15 VMs, but continues to deliver 80k TPS out to 25 VMs.
That’s a 3x increase in the workloads the host can support, just by moving the databases to ioMemory.
This ioMemory solution is a great when you can fit all your VHDs on ioMemory, which come in capacities up to 6.4TB, and many servers can take multiple ioMemory cards.
The middle line uses SanDisk FlashSoft caching software with a single 1.3TB ioMemory card; this is our FlashSoft/ioMemory bundle. The VHDs still reside on the hard drives, the ioMemory card is used to hold cached data, nothing else. You can see that performance flattens out around 65k TPS with 15 VMs and declines very slightly out to 23 VMs.
This is also a 3x increase in the workloads the host can support, at about 20% lower peak transaction rate than with ioMemory. All you do is insert one PCIe card and install the FlashSoft software.
This FlashSoft solution is great when you want to leave your data where it is, or the databases exceed the capacity of the ioMemory cards you can deploy.
The top line uses SanDisk Fusion ioMemory, our PCIe add-in card. In this scenario, all the VHD files are hosted on ioMemory. You can see that the performance flattens out around 80,000 Transactions Per Second with 15 VMs, but continues to deliver 80k TPS out to 25 VMs.
That’s a 3x increase in the workloads the host can support, just by moving the databases to ioMemory.
This ioMemory solution is a great when you can fit all your VHDs on ioMemory, which come in capacities up to 6.4TB, and many servers can take multiple ioMemory cards.
The middle line uses SanDisk FlashSoft caching software with a single 1.3TB ioMemory card; this is our FlashSoft/ioMemory bundle. The VHDs still reside on the hard drives, the ioMemory card is used to hold cached data, nothing else. You can see that performance flattens out around 65k TPS with 15 VMs and declines very slightly out to 23 VMs.
This is also a 3x increase in the workloads the host can support, at about 20% lower peak transaction rate than with ioMemory. All you do is insert one PCIe card and install the FlashSoft software.
This FlashSoft solution is great when you want to leave your data where it is, or the databases exceed the capacity of the ioMemory cards you can deploy.
Here’s where it gets really interesting. Let’s assume
Move electrons, not molecules
Describe purpose of readable secondaries
Backup rate: 4GB/sec
4 x 600GB DB’s each with 5000 Warehouses each db is 8 files and a log file they all share the same Fusion ioMemory stripe
Doesn’t count Windows license savings, SAN upgrade, new shelves/disks, power, cooling, etc., etc., etc.,
4 HP DL685 blades 4 HP DL380 G9s
Source: Less is More at Intelliflo http://itblog.sandisk.com/less-is-more-at-intelliflo
Provides IT services to UK financial firms
Intelliflo has been providing information technology services exclusively to UK financial services companies since its inception in 2004. The company provides leading web-based business management software, Intelligent Office, which is used by more than 1,600 firms and 14,650 users. These customers have assets under management of more than £243 billion. Intelligent Office executes as many as 10,000 database transactions per second during peak hours and handles over 2.5 million web requests and as many as 250 million database queries each day.
The best way to understand the customer benefits is to take deeper look at another real customer example.
With each customer example, we highlight:
The business needs they were trying to achieve
Their environment
The business outcomes
United States Air Force Financial Data Warehouse
TekSouth is an innovative systems integrator that helped the US Air Force tackle data center sprawl
The Challenge
The US Air Force (USAF) uses a data warehouse called CRIS for financial management of unclassified appropriated historical data.
CRIS integrates data from geographically dispersed financial managers and gives them the tools to manage day-to-day operations, while providing senior leaders at all levels a near real-time snapshot of operational performance.
They wanted to reduce power, cooling, overall data center, and overall total cost
The challenges CRIS faced were daunting:
Deliver near real-time reporting for more than 15,000 users running up to 1.2 million queries per month
Perform Extract, Transform and Load (ETL) jobs to prepare data for end users without affecting end-user application performance
Address increasing pressure for datacenter space and energy conservation
Meet the USAF’s failover requirements to be operational to users and managers in every time zone around the world
Solution: SanDisk In Server flash and Microsoft SQL Server
Results:
3X more concurrent users
3X more queries
2X greater workload
Eliminated maintenance overhead for 27 disk arrays and over 400 disks
16:1 footprint consolidation
1/16th power and cooling
At the time this work was done, we celebrated along with our customer, but at the time we weren’t documenting in standardized fashion just how big such wins are. It’s clear, isn’t it, that among other things, the savings are significant?
Three primary servers consolidated to 1 (plus one for backup & one for ETL), total consolidation five servers to three.
The entire 22TB data warehouse was moved to Fusion ioMemory, for an all-Flash storage configuration.
Freeing up storage for redeployment.
This is “... the largest financial warehouse in the U.S. Air Force and one of the most active financial data warehouses in the entire Department of Defense.”
(source: TekSouth’s case study, under “Solution”, <http://www.teksouth.com/documents/CRIS%20Case%20Study.pdf>)
“Availability averages 99.97% uptime, attributable to its modular architecture that allows redundant subsystems.”
(source: same as above)
@SQLBob: Only flash you'll find over here would potentially involve HR violoations...
https://twitter.com/SQLBob/status/639097363332788224
SanDisk Fusion ioMemory SX350
www.sandisk.com/business/datacenter/products/flash-devices/pcie-flash/sx350
SanDisk Optimus MAX
www.sandisk.com/business/datacenter/products/flash-devices/ssds/sas-ssd/optimus
39
We collaborate with the world’s top server and storage vendors. The solutions you hear about today can be obtained at your preferred supplier.
Data
Each pair of red & blue columns represents results from a certified Microsoft Data Warehouse Fast Track Reference Architecture (MS DWFTRA) leveraging SanDisk flash.
For each pair we’re comparing performance metrics from the same system for row store (red) vs. columnstore (blue).
The takeaway from the first chart is as you can plainly see that the red columns is that row store is doing a lot of physical work, typically three times as much physical I/O.
Yet as the chart on the right shows, the relative output for columnstore is about seven times as much for each-&-every certified reference architecture.
Microsoft recommends that columnstore indexes as the default choice for data warehouse-type workloads.
The main takeaway. For row store, the performance numbers provided by our OEM partner systems leveraging SanDisk flash are enormously impressive. The results demonstrate that the combination of partner hardware, our flash, & Microsoft columnstore provide superlative results heretofore—plain-&-simply—unobtainable.