More Related Content
Similar to New Generation of Storage Tiering (20)
More from Tony Pearson (20)
New Generation of Storage Tiering
- 1. New Generation of Storage Tiering:
Less management, lower investment and increased performance
Tony Pearson – IBM Master Inventor and Senior Managing Consultant
March 2013
© 2013 IBM Corporation
- 2. Today’s Challenges, Tomorrow’s Opportunities
IMPROVE SERVICE
Not only ensuring high availability
and quality of existing services, but
also meeting customer expectations
for real-time, dynamic access to
innovative new services.
REDUCE COST
Not just containing operational cost
and complexity, but achieving
breakthrough productivity gains
Deliver the right through virtualization, optimization,
energy stewardship, and flexible
information, sourcing.
to the right people,
at the right time … MANAGE RISK
Not only addressing today’s security,
and compliance challenges, but also
… with an IT infrastructure preparing for the new risks posed by
in a dynamically changing an even more connected and
collaborative world.
environment
2 © 2013 IBM Corporation
- 3. Four Fundamental Truths – A Basis for Storage Tiering
100 Machine data
Email
80 EMR
Database
Data Value
Surveillance Video
60
40
20
0
1w 2w 3w 4w 3m 6m 9m 1 yr 2 yr 5 yr 10 yr
Age of Data
All data is not created equal IT resources should be allocated
according to the value of data
Information changes in business
value and in service level Information must be managed
requirements over time throughout its entire lifespan … data
outlives media
3 © 2013 IBM Corporation
- 4. Storage Tiers – A trade-off between performance and cost
Technologies allow us to
Server place and move data to the
appropriate storage tier to
Faster
balance between
Performance Cache and performance and cost
Solid-State Drives
Hard Disk Drives
Tape
Lower
Cost
Cloud
4 © 2013 IBM Corporation
- 5. Automated Sub-LUN Tiering within a Storage Array
Problem:
SSDs are considerably more expensive than traditional disks
Without optimization tools, clients have been over-provisioning them
Administrators spend too much time monitoring, reporting, and tuning tiers
Solution:
Three data relocation functions
that enable smart data
Solid-State Drives
placement to optimize SSD
deployments with minimal costs
Enterprise HDD
15K and 10K rpm
– Sub-LUN Automatic Movement
– Entire-LUN Manual Relocation
Nearline HDD – Re-balancing Intra-Tier Extent
7200 rpm Pool
5 © 2013 IBM Corporation
- 6. IBM Easy Tier®
Extent Pools can have mixed media
1. Solid-State Drives (SSD)
2. Enterprise HDD (15K and 10K RPM)
3. Nearline HDD (7200 RPM)
SSD RAID Array(s)
Easy Tier measures and manages activity
– 24 hour learning period
– Every five minutes: up to 8 extents moved
• Hottest Extents moved up to SSD
• Coldest Extents moved down to slowest
Enterprise HDD Disk
– New allocations placed initially on fastest HDD
A small amount of SSD (as little as 3%) can
dramatically reduce response times and increase
IOPS throughput
Nearline HDD
Storage Tier Advisory Tool can estimate
benefits of adding SSD before purchase!
6 © 2013 IBM Corporation
- 7. IBM Easy Tier Application Transaction Improvement
No change to
the database
240% from
or application
Original
brokerage
No work to
transaction identify active
indexes
No manual
Application
Transactions movement of
files or
volumes
Just turn it on
Easy Tier
In Action
and let it
Easy Tier work!
Learning
7 7 © 2013 IBM Corporation
- 8. IBM Easy Tier® Cooperative Server Caching
To avoid performance bottlenecks over
the SAN, IBM Easy Tier® will be
extended to support server-based Flash
Server Server
• Most active data will be moved from
SAN disk system to server SSD
• Global cache statistics maintained in
the Disk array
• Applications can provide “hints”
IBM Edge 2012 Demonstration showed
POWER7 server with EXP30 SSD and
SSD
DS8800 Easy Tier, resulting in 5x
performance boost for Filenet ECM
Ent
HDD
IBM has acquired Texas Memory
Systems, and plans to offer Easy Tier
NL support for PCiE Flash cards as well
HDD
Announcement : http://www-01.ibm.com/common/ssi/cgi-
bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUS
ZG12-0163
8 © 2013 IBM Corporation
- 9. IBM SmartCloud Virtual Storage Center (VSC)
Problem: Solution:
High-end disk arrays are SmartCloud VSC can manage up to 256
expensive arrays (IBM and non-IBM) per SmartCloud
VSC cluster
Difficult to identify which
data should be moved Storage Analytics Engine recommends
up-tier and down-tier moves based on
Manually re-locating LUNs
performance and age of the data
is manual and disruptive
Move LUNs non-disruptively within and
across arrays
SSD
Ent SSD
HDD Ent
HDD
NL
HDD
SAN NL NL
HDD HDD
9 © 2013 IBM Corporation
- 10. Hierarchical Storage Management (HSM)
Problem:
Disk faces challenges for
density and has slowed to 20%
Tape will continue to grow in
Density at an average 40%
CAGR
Cost difference – Disk is 20x
more expensive than Tape
Hard Solution:
Disk
Drives Migrate or archive data from disk to tape
based on age and anticipate access pattern
Tape Automatically recall data back to disk when
accessed by user or application
10 © 2013 IBM Corporation
- 11. Blended Disk and Tape Storage Solutions
Reduced Costs, Increased
Utilizing Tape Drastically Reduces TCO Flexibility
10 year TCO example. Assumes 250TB storage, 25% growth/yr
Lower costs primarily from:
$7 – Lower cost of media
$6,365,950
Floor space
– Minimal need for Power &
Power & Cooling
Cooling
Maintenance
Prod + DR Carts Increased flexibility from ability to:
Millions
Hardware
$3.5 – Add capacity by simply adding
Tape cartridges
$2,255,346
– Expand Tape libraries over
$946,405 and around existing equipment
in the data center
$0 Reliability: lower bit-error-rates,
NL/SATA Tape Blended Disk
Disk
read verifications after writes.
and Tape
* TCO estimates based on IBM internal studies.
11 © 2013 IBM Corporation
- 12. Automate Data Placement and Migration
File creation
Optional TSM/HSM
Server & Virtual or
30 days Physical Tape Pool
Initial
placement
Enterprise 180 days
SAS
NL-SAS
SONAS
Storwize V7000 Unified
12 © 2013 IBM Corporation
- 13. Linear Tape File System (LTFS)
Treat tape cartridges like USB memory sticks!
Contents
Tape
LTFS Library Edition
Device
Directory,
for the LTO5
tape
Attach Host to Tape
using a standard file System
LTFS Single Drive Edition
13 © 2013 IBM Corporation
- 14. Hybrid Cloud Storage and the IBM Active Cloud Engine™
Problem: Solutions:
Remote offices need A Cloud Storage Gateway can provide high
access to corporate data performance access to most recently
accessed data
Corporate HQ needs
access to Remote office
– IBM SmartCloud Enterprise Object
data
Storage
Data access across WAN
can be slow or difficult to
find IBM Active Cloud Engine provides a global
namespace of all your files across all of your
locations
Hard
Disk – Hub-and-Spoke design allows a central
Drives HQ location (Hub) to work with up to 1000
remote offices (Spokes)
Cloud
14 © 2013 IBM Corporation
- 15. The Ideal “Hybrid Storage Cloud”
Highly scalable
Variety of host
attachment Cloud
protocols Storage
NFS, CIFS, Gateway
iSCSI, FCoE
• OxygenCloud
• Nirvanix CloudNAS® Choices for
different Cloud
• TwinStrata (iSCSI)
services
• Panzura File System providers,
and/or other
data center
locations
15 © 2013 IBM Corporation
- 16. Active Cloud Engine™ -- Hub and Spoke Design
Central
Datacenter Hub
or Cloud SONAS
Spoke-1
Read-access to
SONAS
some filesets
Read-write access
to filesets owned by
this location
Fileset owned by the Central Hub
1 Each Spoke can have a read-only cache copy
Spoke-2
Periodic prefetch or On-Demand Pull. SONAS
2 Fileset owned at Spoke-1 (read/write)
Updates are sent to the Central Hub
Read-only cache copies available to other Spokes.
16 © 2013 IBM Corporation
- 17. The Shifting Roles of Storage
Solid-State Primary Data
Drives (SSD)
Combined with Disk replication
slower SATA and Virtual Backup Data
disk to reduce Tape Libraries
energy costs Physical tape,
Long-term Space
over 15K RPM Improved by combined with Management and
drives low cost SATA, automation Data Retention
compression,
“Flash & Stash” deduplication Linear Tape Work Task
File System Project Folder
(LTFS)
17 © 2013 IBM Corporation
- 18. 18 © 2013 IBM Corporation
- 19. Tony Pearson
9000 S. Rita Road
Bldg 9032 Room 1238
About the Speaker Master Inventor,
Tucson, AZ 85744
Senior Managing
Consultant
Mr. Tony Pearson +1 520-799-4309 (Office)
Master Inventor, IBM System Storage™
tpearson@us.ibm.com
Senior Managing Consultant
IBM System Storage
Tony Pearson is a Master Inventor and Senior managing consultant for the IBM System Storage™ product line. Tony joined
IBM Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on
storage topics covering the entire System Storage product line, Tivoli storage software products, and topics related to Cloud
Computing. He interacts with clients, speaks at conferences and events, and leads client workshops to help clients with
strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization products.
Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners
every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume
I through V.
Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and
software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in
Electrical Engineering, both from the University of Arizona. Tony holds 19 IBM patents for inventions on storage hardware and
software products.
19 © 2013 IBM Corporation
- 20. Additional Resources
Email:
tpearson@us.ibm.com
Twitter:
http://twitter.com/az99Øtony
Blog:
http://ibm.co/brAeZØ
Books:
http://www.lulu.com/spotlight/99Ø_tony
IBM Expert Network:
http://www.slideshare.net/az99Øtony
20 © 2013 IBM Corporation
- 21. Trademarks and disclaimers
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT
Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel
Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its
subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and
the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office
of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java
and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment,
Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM
Corp. and Quantum in the U.S. and other countries.
Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind.
The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and
performance characteristics may vary by customer.
Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an
endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and
vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions
on the capability of non-IBM products should be addressed to the supplier of those products.
All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery
schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current
investment and development activities as a good faith effort to help with our customers' future planning.
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience
will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.
Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM
representative or Business Partner for the most current pricing in your geography.
Photographs shown may be engineering prototypes. Changes may be incorporated in production models.
© IBM Corporation 2013. All rights reserved.
References in this document to IBM products or services do not imply that IBM intends to make them available in every country.
Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the
World Wide Web at http://www.ibm.com/legal/copytrade.shtml. ZSP03490-USEN-00
21 © 2013 IBM Corporation