S100297 ilm-archive-orlando-v1804c

IBM Systems Technical University © 2018 IBM Corporation
2018 IBM Systems
Technical University
Information Lifecycle
Management (ILM):
Why Archive is different than
Backup
—
Tony Pearson
Master Inventor and Senior IT Architect,
IBM Corporation
April 30 – May 4, 2018
Orlando, Florida

Abstract
2
Too often, companies save their backup tapes for
months or years, treating them as their "archive" to
meet government compliance or industry regulations.
Sadly, they often discover their mistake when taken to
court, or investigating employee misdeeds.
This session explains the difference between archive
and backup, and the right way to archive data.

This week with Tony Pearson
3
Day Time Topic
Monday 10:15am The 7 tiers of Business Continuity and Disaster Recovery
11:30am IBM Hybrid Cloud Storage Options
3:15pm
Reporting and Monitoring:
How to verify your storage is being used efficiently
Tuesday 11:30am
Introduction to IBM Cloud Object Storage System (powered by
Cleversafe)
Wednesday 3:15pm
Information Lifecycle Management: Why Archive is
different than Backup
Thursday 9:00am
Reporting and Monitoring:
How to verify your storage is being used efficiently
4:30pm Storage Meetup: Cloud and Object Storage BOF
Friday 9:00am Managing risks with Data Footprint Reduction
10:15am
The Pendulum Swings Back – Understanding Converged and
Hyperconverged Integrated Systems

IBM Systems Technical University © 2018 IBM Corporation 4
5/4/2018
The two faces of Archiving
Space Management
move old, inactive files
to less expensive
storage, resulting in
reduced backup
windows and reduced
storage costs
File Systems
Databases
E-mail
Enterprise Content Management
Data Retention
Protect your data for the
long term with non-
erasable, non-rewriteable
storage solutions and
demonstrate compliance
to regulations

Definition of Backup and Archiving
5
Backup is for recovery from hardware failure and/or recent
data corruption
Archive is for space management and long term data
retention
– Archiving is an intelligent process for managing inactive or
infrequently accessed data, that still has value, while
providing the ability to preserve, search and retrieve the
information during a specified retention period.

Archiving: Client Motivations
6
Compliance/Risk
• Manage to regulations (SOX, HIPPA etc).
• Penalties and brand damage.
• Exposure by keeping data too long.
• Litigation support.
Document/Process Automation
• Go paperless in a process.
• Integrate digitization to change/improve
business processes.
• Store all documents/images online to improve
access/sharing.
Information Innovation
• Mine information for unique value.
• Enhance business for competitive advantage
or organizational improvement.
Systems Efficiency
• Reduce high cost storage.
• Reduce backup & recovery resources.
• Improve managed TB/Admin. ratio.
• Improve server performance/longevity.
User Productivity
• Improve application performance and
availability.
• Reduce time to search for and access
historical/enterprise data.
&

Four Fundamental Truths – A Basis for ILM
Not all data is created equal
Information changes in business
value and in service level
requirements over time
IT resources should be allocated
according to the value of
information
Information must be managed
throughout its entire lifespan …
data outlives media
0
20
40
60
80
100
1 w 2 w 3 w 4 w 3 m 6 m 9 m 1 yr 2 yr 5 yr 10 yr
DataValue
Age of Data
Machine data
Email
EMR
Database
Surveillance Video

Shifting how Archive is Viewed
8Source: “Raiders of the Lost Ark”, LucasFilm LTD., a Disney Company
Disorganized
Keeping too much
Expensive with little value
Difficult to find particular items
Slow to retrieve
Indexed and Organized
Just what you need
Business Value
Low cost to maintain
Easy to locate and retrieve

Database Archiving Strategy
Current
Data
Active
Historical
Production
Database
Archive
Online/Offline
Archive or Delete
Retrieve
Report
Writer
XML ODBC /
JDBC
Application
Open Access to Application Data
Archive Files
Compressed
File Directory
SAN
0-2 yrs. 3-4 yrs. 7+ yrs.
Archive
Database Delete
Keep
Everything
Forever
Before: After:
Service Levels Missed
Big databases run
slower
Operations Risk
SQL accidently bulk
modify/delete
Multiplying IT costs
Growth for QA, Test,
Dev, Reporting,
Backup/Recovery

Archive for Space Management
10
Space Management
move old, inactive files
to less expensive
storage, resulting in
reduced backup
windows and reduced
storage costs
Availability
Sustainability
Cost-Effective
Infrastructure
Automated Data
Management

How are you dealing with Storage Growth?
11

Data: rate of change
Service-levelagreements(SLAs)
Collaborate Manage Archive RetireCreate/
capture
Online
Archival
Capacity
Online
NAS
Offline Tape
PerformanceandFunctionality
Requirements
DecadesYearsMonthsDays
Time
Set policies and automate the movement of data to the optimum
environment over time
Performance
Online
SAN
SSD
A systematic
approach to
data lifecycle:
Online access with
assured authenticity
Metadata-policy
management
Higher service levels
Streamline
management and
lower total cost of
ownership (TCO)
Use policy-based automation to move data across storage
tiers to reduce costs

DISPOSE OF UNNECESSARY DATA
Hold & Collect Evidence
Archive for Value & Dispose
Retain Records & Dispose
Enterprise
Information
StoredIQ: Very Simple Savings Proposition. Dispose of
Unnecessary Data Thru Visibility
Regulatory
Record
Keeping
5%
Has
Business
utility
25%
69%
%s based on CGOC Summit 2012 Survey
Everything Else
Subject
to Legal
Hold 1%
Cost & Risk
Reduction
Enables Disposal
Cost Reduction
Normalizes growth
curve
The biggest source of unstructured growth is coming from data inside the
enterprise. Behind every corporate firewall lies petabytes of unstructured and
unmanaged business-critical data. StoredIQ provides the first solution to
identify, analyze and ACT on unstructured data IN-PLACE, without moving
your data to a repository or specialty application.

Data Clean-Up – Defensible Disposal

Blended Solutions: Reducing Costs and Increasing
Flexibility
15
Reduced Costs, Increased
Flexibility
Lower costs primarily from:
– Lower cost of media
– Minimal need for Power &
Cooling
Increased flexibility from ability to:
– Add capacity by simply adding
Tape cartridges
– Expand Tape libraries over and
around existing equipment in the
data center
Reliability: lower bit-error-rates,
read verifications after writes.
Tape
$946,405
$7
$3.5
$0
Millions
SATA Disk
$6,365,950
Blended Disk
and Tape
$2,255,346
Hardware
Prod + DR Carts
Maintenance
Power & Cooling
Floor space
Utilizing Tape Drastically Reduces TCO
10 year TCO example. Assumes 250TB storage, 25% growth/yr
* TCO estimates based on IBM internal studies.

IBM Spectrum Scale Archive to Cloud or Tape
16
Unified file and object
storage. Optimized for
high performance, across
flash, disk and object
store
Flash
Object
Store
15K
Object storage on disk
( File, backup and archive interfaces
available through variety of options )
IBM Cloud
Amazon Web Services
Microsoft Azure
Swift S3 emulation
OpenStack Swift
Unified file and object
storage on tape
Transparent Cloud Tiering
Information Lifecycle
Management (ILM) across tiers
HighestPerformance
Lowest cost
Tape10K 7200

Archive for Data Retention
Integrity
Authenticity
Security
Trustworthiness
Auditability
Data Retention
Protect your data for the
long term with non-
erasable, non-rewriteable
storage solutions and
demonstrate compliance
to regulations

The Challenge…
Preventing a Digital Dark Age
Dead Sea Scroll ~70 AD
Media: Copper
Language: Hebrew
Mayan Glyph, Palenque
~630 AD
Coronation of King Pacal
• These documents were
created by pre-digital
societies.
• The media & information
content are
still accessible.
IBM Storage Today and Tomorrow

The Digital Preservation Challenge…
Bit Preservation Will today’s
last for 20 years? HDD…
Tape…
CD…
Logical Preservation Will it be
possible to access, and
present the data in 20 years? 50? 100?
The Confusion of Tongues
Gustave Doré (1865)
IBM Storage Today and Tomorrow

Digital Preservation
No Simple
Answers!
Object to Preserve
and Metadata
Extract AIP,
“tools” and
MetaData
Usable Preserved
Object
Create
Archival
Information
Package
Bit
Preservation
Logical
Preservation
Logical
Transformations
Emulators
Descriptive
Information
• Museum
• Emulation
• Migration
• Descriptive
Multiple
Approaches
Evolving
Standards
• OAIS / AIP, SNIA / SIRF,
PDF/A, Premis, LOTAR

How Long Do We Need to Keep the Data?
21

Primary Messaging
System Data Store
Domino Exchange
Search
Analyze
Retrieve
Disclose
Hold
Few
Authorized
Users
All Users
Links to
access
Hierarchy
Storage
Archive
Archive
Data Store
Content Collection for Email Reference Architecture
Source
Connector
Target
Connector
Task
Connectors
Copy, Move,
Delete, Stub,
Classify etc
Content
aware
Exchange
Online
SMTP

Email Example with various stages of processing
23

IBM InfoSphere Optim™
• IBM InfoSphere Optim Archive
– Improve performance
– Control data growth, save storage
– Support retention compliance
– Enable application retirement
– Streamline upgrades
• IBM InfoSphere Optim Test Data
Management & Fabrication
– Create targeted, right sized test environments
– Improve application quality
– Speed iterative testing processes
• IBM InfoSphere Optim Data Privacy
– Mask sensitive data
– Comply with privacy policies

Non-Erasable, Non-Rewriteable (NENR) storage
Optical Platters
The original write-once,
read-many (WORM)
media, including DVD
and CD-ROM
Tape Cartridges
IBM LTO and TS1150
drives support WORM
media
File and Object Storage
Disk media is not
WORM, but we can
add “software
enforcement” against
tampering via file
systems or object
storage protocols
WORM
NENR
From U.S. SEC 17a-4
If employing any electronic storage media other than optical disk technology (including CD-ROM), the member, broker, or
dealer must notify its designated examining authority at least 90 days prior to employing such storage media.
The electronic storage media must:
Preserve the records exclusively in a non-erasable, non-rewriteable, format;
Immutable

IBM Storage Options available
WORM cartridge media
– Special WORM cartridges are available
for IBM TS1120 drives , LTO-3 and above
– Same Tape Drives as for Read/Write
media
– Utilizes standard tape libraries and
drives
– Supports long term data retention
applications
– Helps comply with requirements for non-
rewriteable, non-erasable (NENR) media
– Cost effective storage
Immutable File System
– IBM Spectrum Scale offers immutability
options for file systems and file set
containers
Immutable Object Storage
– IBM Cloud Object Storage offers
Compliance Enabled Vaults (CEV) that
can co-reside on same slicestor storage
pools as regular objects
26

Archive Solution Architecture Example
27
Three critical components are required to build a solution:
1. Business application
2. Content management application
3. Storage Container: Rewriteable or Non-erasable / non-rewriteable (NENR) technology
Business
Application
content
Reports, Documents,
Records
IBM Content Manager
IBM CM OnDemand
IBM FileNet Image Services
Storage Container
Retention System
Content Management or
Archiving application
SQL Server
DB2
IBM Content Collector
IBM FileNet
Modalities
PACS Applications
File Data
IBM Content Collector
Spectrum Protect / SP-DR

IBM Spectrum Protect for Data Retention – Evolution
IBM DR550 IBM Information Archive
From 1 TB to ~100 TB
SSAM as key component
HA and DR support
From 8 TB to ~400 TB
SSAM as key component
HA and DR support
Optional NAS collection
2005 2010 Today
IBM System Stroage
Archive Manager
(SSAM) software
2013
Protect
for Data
Retention

Spectrum Protect
What is Spectrum Protect for Data Retention?
Primary Pool 1
Policy Set (Active)
Mgmt. Class
Archive
Policies
Backup
Policies
Backup pool
Policy Domain
Space Mgt.
Policies
Spacemgmt
Pool
Archive Client Backup Client HSM Client
SP-DR
SP-DR is a “hardened” version of Spectrum Protect,
made for compliance archiving

Differences between Spectrum Protect and SP-DR
Spectrum Protect Spectrum Protect
For Data Retention
Data Ingest Archive, Backup, Space
Management (HSM)
Archiving only
(via API and B/A client)
Client options Client can delete Client not allowed to delete
Admin option Admin can delete, increase or
decrease retention period
Admin not allowed to delete,
can increase but not decrease
retention period
Enforce retention None Chronological and Event-
based, Deletion hold/release
Node replication Yes, nodes can be replicated
from one Spectrum Protect to
another
Nodes cannot be replicated
between Spectrum Protect and
SP-DR
Server-to-Server Everything Only Library Sharing between
Spectrum Protect and SP-DR
Storage pools All pool types supported FILE and TAPE only
SP-DR is a sort of Spectrum Protect which is enabled on a empty server via
option and license

X
Chronological Based
Event Based with Fixed Protection Periods
Fixed Period
Minimum
Fixed Period
X
Event
Dispose after fixed period
from creation date
Dispose after fixed period
from event date
Day 0
Day 0
Minimum
Fixed Period
Event Based with no Fixed Protection Period
X
Event
Dispose after eventDay 0
Chronological and Event Based Retention

Day 0
Data stored
in Archive
RETMIN
API ‘Event’
issued
Automated
Expiration
Data deleted in
Archive
RETVER
X
Day 0
Data stored
in Archive
Automated
Expiration
Data deleted in
Archive
RETVER
X
API ‘Hold’
issued
API ‘Release’
issued
API ‘Release’
issued
API ‘Hold’
issued
Event-Based Retention Policy
Chronological Retention Policy
Deletion Hold and Release

SP-DR solution – International certification
SP-DR 8.1.5 (AIX and Linux) has been assessed according to:
– German Laws: HBG §§ 238 ff, AO §§ 140- 148, StGB, GoB, GoBS, GDPdU, IDW
PS330, IDW RS FAIT 1, IDW RS FAIT 3, IDW PS 880, Bundesdatenschutzgesetz
(BDSG)
– Austrian Laws: UGB , BAO, GoB, DSG, KFS/DV1 und DV2
– Swiss Laws: Obligationenrecht OR §§ 957 ff, GeBüV
– US Law: Security Exchange Commission rules 17a-4f
– International Law: Payment card Industry security standard (PCI-DSS)
SP-DR solution can be implemented based on best IT security practices
(see reference architecture)
Link to certificate:
http://www.kpmg.de/bescheinigungen/RequestReport.aspx?38076

SP-DR based solution with disk and WORM tape
Overview:
– SP-DR installed on server (system p or x)
– Disk can be within server or directly attached to server
– Application uses TSM API to archive and retrieve
– WORM tape can be used for backup or next tier
Key values:
– SP-DR prevents deletion and changes (data and admin)
• International certified for compliance (see references)
– Backup and migration to WORM tape possible
• Copy on IBM WORM Tape is assessed for compliance
– Business continuity through clustering (e.g. PowerHA) and
replication (LVM mirroring, Disk system mirror)
– Migration from previous solutions available
SP-DR software
Disk
WORM Tape Copy
Content
Management
System
SAN
Server
TSM API

The estimated cost benefits at our clients have varied
based on differences in their cost structure, growth rate
and estimated performance improvements
35
Estimated Cost Benefits at Recent Engagements:
Up to 30% reduction in storage investment
costs (HW, SW, transition costs)
Up to 25% reduction in storage operating
costs (support, HW/SW annual
maintenance, facilities, and incremental
operating cost associated with outages)
Return on Investment (ROI) ranging from
37% to 69%
Anticipated payback or break-even on the
investment ranging from 5 to 8 quarters

Please
complete
the session
survey!
36

About the Speaker
Tony Pearson is a Master Inventor and Senior IT Architect for the IBM Storage product line. Tony joined IBM Corporation in
1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on storage topics
covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to Cloud Computing,
Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads client workshops to
help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization
solutions.
Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners
every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume
I through V.
Over the past years, Tony has worked in development, marketing and consulting for various storage hardware and software
products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical
Engineering, both from the University of Arizona. Tony is an inventor or co-inventor of 19 patents in the field of electronic data
storage.
9000 S. Rita Road
Bldg 9032 Floor 1
Tucson, AZ 85744
+1 520-799-4309 (Office)
tpearson@us.ibm.com
Tony Pearson
Master Inventor
Senior IT Architect
IBM Storage

IBM Tucson Client Experience Center
Tucson, Arizona is headquarters
for IBM storage hardware and
software design and development
IBM Tucson Client Experience
Center offers:
– Technology briefings
– Product demonstrations
– Solution workshops
– Lab tours
Take a video tour!
– http://youtu.be/CXrpoCZAazg
https://www.ibm.com/it-infrastructure/services/client-centers

Email:
tpearson@us.ibm.com
Twitter:
twitter.com/az990tony
Blog:
ibm.co/Pearson
Books:
www.lulu.com/spotlight/990_tony
IBM Expert Network on Slideshare:
www.slideshare.net/az990tony
Facebook:
www.facebook.com/tony.pearson.16121
LinkedIn:
https://www.linkedin.com/in/az990tony
Additional Resources from Tony Pearson

Notices and disclaimers
41
© 2018 International Business Machines Corporation. No part of this
document may be reproduced or transmitted in any form without
written permission from IBM.
U.S. Government Users Restricted Rights — use, duplication or
disclosure restricted by GSA ADP Schedule Contract with IBM.
Information in these presentations (including information relating to
products that have not yet been announced by IBM) has been reviewed
for accuracy as of the date of initial publication and could include
unintentional technical or typographical errors. IBM shall have no
responsibility to update this information. This document is distributed
“as is” without any warranty, either express or implied. In no event,
shall IBM be liable for any damage arising from the use of this
information, including but not limited to, loss of data, business
interruption, loss of profit or loss of opportunity. IBM products and
services are warranted per the terms and conditions of the agreements
under which they are provided.
IBM products are manufactured from new parts or new and used parts.
In some cases, a product may not be new and may have been previously
installed. Regardless, our warranty terms apply.”
Any statements regarding IBM's future direction, intent or product
plans are subject to change or withdrawal without notice.
Performance data contained herein was generally obtained in a
controlled, isolated environments. Customer examples are presented as
illustrations of how those
customers have used IBM products and the results they may have
achieved. Actual performance, cost, savings or other results in other
operating environments may vary.
References in this document to IBM products, programs, or services
does not imply that IBM intends to make such products, programs or
services available in all countries in which IBM operates or does
business.
Workshops, sessions and associated materials may have been
prepared by independent session speakers, and do not necessarily
reflect the views of IBM. All materials and discussions are provided
for informational purposes only, and are neither intended to, nor shall
constitute legal or other guidance or advice to any individual
participant or their specific situation.
It is the customer’s responsibility to insure its own compliance
with legal requirements and to obtain advice of competent legal
counsel as to the identification and interpretation of any
relevant laws and regulatory requirements that may affect the
customer’s business and any actions the customer may need to take
to comply with such laws. IBM does not provide legal advice
or represent or warrant that its services or products will ensure that
the customer follows any law.
Information concerning non-IBM products was obtained from the
suppliers of those products, their published announcements or other
publicly available sources. IBM has not tested those products about
this publication and cannot confirm the accuracy of performance,
compatibility or any other claims related to non-IBM
products. Questions on the capabilities of non-IBM products should
be addressed to the suppliers of those products. IBM does not
warrant the quality of any third-party products, or the ability of
any such third-party products to interoperate with IBM’s products.
IBM expressly disclaims all warranties, expressed or implied,
including but not limited to, the implied warranties of
merchantability and fitness for a purpose.
The provision of the information contained herein is not intended to,
and does not, grant any right or license under any IBM patents,
copyrights, trademarks or other intellectual property right.
IBM, the IBM logo, ibm.com and [names of other referenced IBM
products and services used in the presentation] are trademarks of
International Business Machines Corporation, registered in many
jurisdictions worldwide. Other product and service names might
be trademarks of IBM or other companies. A current list of IBM
trademarks is available on the Web at "Copyright and trademark
information" at: www.ibm.com/legal/copytrade.shtml.

S100297 ilm-archive-orlando-v1804c

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a S100297 ilm-archive-orlando-v1804c

Semelhante a S100297 ilm-archive-orlando-v1804c (20)

Mais de Tony Pearson

Mais de Tony Pearson (20)

Último

Último (20)

S100297 ilm-archive-orlando-v1804c