SlideShare uma empresa Scribd logo
1 de 45
Baixar para ler offline
IBM Spectrum Scale
on the Cloud
Tony Pearson
IBM Master Inventor,
Senior IT Management Consultant,
TechU Content Manager
2019 IBM Systems Technical University
10-12 Sep 2019 | Johannesburg, SA
Session Abstract
— Many of you may think that Spectrum Scale is an on-premise solution only.
— This session will dispel that myth - we'll describe various ways Spectrum
Scale can be consumed in various clouds. Spectrum Scale can run on
Amazon; will run in future on Google Cloud; can tier data to AWS and
Azure.
— Learn about the full breadth of Spectrum Scale in the cloud to deploy fully
managed and custom designed solutions addressing extreme speed
requirements or more moderate POSIX compliant storage efficiency
requirements.
— Hear how you can use Spectrum Scale in these clouds today, and how you
can connect your current Spectrum Scale on-premise installations to these
clouds for true Hybrid cloud capability.
— A basic understanding of Spectrum Scale concepts is assumed
IBM Systems Technical University © Copyright IBM Corporation 2019 2
Disk
TapeStorage Rich
Servers
Client workstations
Users and applications
Compute
Farm
Single name space
Flash
NFS
HDFS
Connector
POSIX SMB/CIFS
OpenStack
Cinder
Glance
Manila
IBM Spectrum Scale
Automated data placement and data migration
On/Off Premises
Object
S3
Swift
Active = Hot+Warm = “Online” Archive = Cold = “Offline”
Object Storage
SAS
SAP
DB2
Oracle
MQ
etc.
Mainframe
Hadoop
Cloud
Providers
Docker
Kubernetes
Spark
Site A
Site B
Site C
iSCSI
Block
IBM Spectrum Scale – Scalable File and Object Store
IBM Systems Technical University © Copyright IBM Corporation 2019 3
Spectrum Scale in the Cloud
Today’s Agenda
• Spectrum Scale on Cloud - Vision
• Key Spectrum Scale Cloud Solutions
• Spectrum Scale on Amazon Web Services
• Transparent Cloud Tiering - tiering data to either
AWS or Azure
4IBM Systems Technical University © Copyright IBM Corporation 2019
Spectrum Scale On Cloud – Vision for Cloud Readiness
Workload Support
• Analytics & Cognitive
• High Performance Computing
• AI Data Pipeline
Workload Ecosystem
• Containers
• CaaS
• Ephemeral and Persistent Volumes
• Storage Enabler for Containers (SEC)
• Container Storage Interface (CSI)
• Hybrid Use Cases
• Cloud Burst
• Multi Cloud Data Sharing
• Archive
• High Performance Tier
5
IBM Systems Technical University © Copyright IBM Corporation 2019 5
Spectrum Scale On Cloud – Vision for Offerings
User Deployed – Build your own cluster
• IBM Cloud
Spectrum Scale Solutions
• IBM Spectrum Scale on AWS
Private Cloud Solutions
• IBM Cloud Private (ICP)
• Others
Partner Solutions
Trials
• AWS Quickstart
• Google (soon)
6
IBM Systems Technical University © Copyright IBM Corporation 2019 6
Spectrum Scale On Cloud – Vision for Ecosystem Integration
User Interface (Look and Feel)
Resource Provisioning and Initialization
• Provision Virtual Machines, Storage etc. and initialize
Deployment Automation and Orchestration
• AWS Cloud Formation etc.
Spectrum Scale Cluster Creation and Configuration
• Cluster Creation, File system Creation. Feature
enablement and configuration
Digital Business Integration
Service & Support Processes
Durability & Elasticity
7
IBM Systems Technical University © Copyright IBM Corporation 2019 7
Spectrum Scale on AWS
• Bring your own license
• Available Sept. 28 2018
• Data Management Edition
• 3 months trial license
• Available Sept. 13 2017
• Data Management Edition
Spectrum Scale Trial link Spectrum Scale Marketplace link
Run an entire Spectrum Scale cluster within the Amazon Web Services cloud!
8
IBM Systems Technical University © Copyright IBM Corporation 2019 8
Spectrum Scale on Amazon Web Services – value proposition
IBM Systems Technical University © Copyright IBM Corporation 2019 9
Spectrum Scale on Amazon Web Services – what’s available
Wow! A cluster of 16 EC2 Spectrum Scale instances can be launched and configured with a shared
filesystem mounted on all nodes in less than an hour (and does not require any Spectrum Scale Admin
Skills).
“Bring your own (existing Spectrum Scale Data Management Edition) license”
IBM Systems Technical University © Copyright IBM Corporation 2019 10
Spectrum Scale on Amazon Web Services – ideal usage case guidelines
Gives you ability to easily and quickly create and use a Highly Available Spectrum Scale cluster filesystem on
AWS infrastructure w/ POSIX semantics
• Targeted for HPC use cases (scalable bandwidth to capacity ratio) on AWS
o Ideal for use cases that can use a newly deployed cluster
o Data will be ingested by user into the new cluster
o Data will be exported after application use by user cluster termination after application is done
o Target is HPC use case where “extended” features of Spectrum Scale not required (i.e. Protocol nodes)
o Optimize cost of AWS resources by shutting down some pieces of the cluster deployed is manual (we
provide tools to optimize resource usage – you as customer must use those tools. Initial offering doesn’t
yet use auto-scaling to manage resources)
• Provides a Spectrum Scale global namespace across a set of EC2 instances
• Provides an AMI (Amazon Machine Image boot image) with Spectrum Scale 5.0.2 Data Management edition
installed on RHEL and GPL layer built
• Provides a AWS Cloud Formation script that deploys a cluster of EC2 instances using the provided AMI and
deploys Spectrum Scale using simple input to create a filesystem mounted on the launched instances
• You as a AWS customer pay Amazon for EC2 resources used and RHEL and other software you consume
• BYOL Data Management Edition licensed version of Scale is launched from the AWS Marketplace
IBM Systems Technical University © Copyright IBM Corporation 2019 11
Easy configuration through cloud formation
Spectrum Scale Listing On AWS Marketplace
IBM Systems Technical University © Copyright IBM Corporation 2019 12
Spectrum Scale on AWS – Architecture
 Solution based on EC2 instances and EBS volumes
 NSD servers separate from “Compute” nodes that
will mount the shared filesystem
 NSD servers using AWS EBS storage for Spectrum
Scale
 Data is replicated across multiple availability zones
 Support for creation of new VPCs or launching
instances into existing VPCs.
 Connection to these instances only via a Bastion
Host (as per AWS best practices)
 Focuses on simplicity/usability of deployment (e.g.
reduced config. options) and leverages Amazon
features such as Cloud Formation templates and
AMIs (Amazon Machine Image)
This diagram describes the deployment of the Multi Availability Zone configuration (2 AZs)
In single Availability Zone deployments, all resources are deployed into the same Availability Zone
IBM Systems Technical University © Copyright IBM Corporation 2019 13
Some AWS Terms Defined (Part 1 or 2)
AWS instance: a ‘node’ on AWS-- a virtual machine running on AWS hardware*
• Spectrum Scale clusters are comprised of AWS EC2 instances running Spectrum Scale 5.0.2.1 on
RHEL
Amazon Machine Image (AMI): An AMI stores the data needed to launch AWS instances. It includes:
• Launch permissions that control which AWS accounts can access the AMI to launch instances. You
must subscribe to the IBM Spectrum Scale BYOL Marketplace Offering to have access to launch the
AMI from the AWS Spectrum Scale Marketplace page
• A block device mapping defining the volumes attached to a launched instance
• A template for the root volume for the instance. Our AMI includes the RHEL operating system, IBM
Spectrum Scale, with the GPL layer pre-built
• Our AMI is backed by EBS (Amazon Web Services’ Elastic Block Storage), which means the root
device for instances launched by the AMI will always use EBS volumes. IBM does not support the
use of Amazon instance store volumes with Spectrum Scale instance root device volumes or NSD
volumes)
* Notes: In general IBM does have any way of mapping virtual resources (e.g., instances or EBS volumes) to their underlying AWS physical
hardware (e.g., the memory, CPU and disks). Thus IBM Spectrum Scale on AWS can’t figure out which EC2 instances might share the same
physical CPUs, memory, etc.
IBM Systems Technical University © Copyright IBM Corporation 2019 14
CloudFormation: according to Amazon, "AWS CloudFormation is a service that helps you model and set
up your Amazon Web Services resources”.
• CloudFormation templates define resources, like EC2 instances and EBS volumes, and allow these
resources to be provisioned and configured
• The Spectrum Scale Marketplace page has links to an IBM created CloudFormation template that will
provision resources on AWS, using AMIs that already have Spectrum Scale installed, and then
configure a Spectrum Scale cluster using these resources
EBS Volume: An Amazon EBS volume is a basically a virtual disk*, providing block storage that can be
attached to a single EC2 instance (at any given point)
• The AMI stores the root volume and that is transferred to an EBS volume on every node that is
deployed in a Spectrum Scale cluster.
• NSD Servers on AWS will use EBS Volumes for Spectrum Scale file system NSDs
• Amazon provides mirroring for these NSD volumes, and AWS claims “99.999% availability” (this an
AWS AFR (annual failure rate) number). AWS and your AWS design is responsible for data durability of
data on EBS volumes, even in configurations in which we replicate the volumes contents across AZs.
More AWS Terms Defined Part 2 of 2)
IBM Systems Technical University © Copyright IBM Corporation 2019 15
Spectrum Scale on AWS – other AWS services and components
16IBM Systems Technical University © Copyright IBM Corporation 2019
EC2 Instance
(NSD Server)
EBS
volume
EBS
volume
[. . . ]
Spectrum Scale on AWS: Running on EC2 Instances Backed by EBS
EC2 Instance
(NSD Server)
EBS
volume
EBS
volume
[. . . ]
Network EBS connection
[. . . Additional servers]
EC2 Instance
(NSD Client)
EC2 Instance
(NSD Client)
EC2 Instance
(NSD Client)
Network Connection tor Non-EBS traffic
[. . . Additional clients]
[. . . Additional clients]
17
Successful Stack Creation
IBM Systems Technical University © Copyright IBM Corporation 2019 18
Sample timings for Cluster Creation (testing results from Sept. 5/18)
Cluster Stack Analysis Start time End time Execution time Comments
Cluster Stack 11:27:41 AM 12:46:29 PM 1:18:48UTC -7
Scaling gtoup + instance create 11:27:41 UTC 64 T2.Medium instances
CFI init inside instance 6:31:51 PM 7:45:41 PM 1:13:50UTC
aws_init_setup 6:31:51 PM 6:34:07 PM 0:02:16UTC Create nodelist.txt file
aws_passwordless_setup 6:34:08 PM 6:34:10 PM 0:00:02UTC 64 nodes
aws_nsd_server_setup - AZ1 6:34:11 PM 7:09:57 PM 0:35:46UTC
Create, 40 * 10 GB EBS volumes, attach (5 per
instance)
aws_nsd_server_setup - AZ2 6:34:23 PM 7:10:17 PM 0:35:54UTC
Create, 40 * 10 GB EBS volumes, attach (5 per
instance)
aws_cluster_setup 7:09:58 PM 7:20:13 PM 0:10:15UTC sleeps for 100s twice
aws_add_compute_nodes 7:20:13 PM 7:26:31 PM 0:06:18UTC
aws_filesystem_setup 7:26:31 PM 7:29:20 PM 0:02:49UTC
aws_mount_setup 7:29:24 PM 7:29:54 PM 0:00:30UTC
aws_zimon_setup 7:29:54 PM 7:30:28 PM 0:00:34UTC
aws_tunning_aids_setup 7:30:28 PM 7:41:36 PM 0:11:08UTC Scope of improvement
aws_verification_setup 7:41:36 PM 7:45:41 PM 0:04:05UTC
Stack name Start Time End Time Execution Time
VPC Stack 11:19:09 AM 11:22:04 AM 0:02:55UTC -7
Bastion Node Stack 11:22:19 AM 11:27:28 AM 0:05:09UTC -7
Cluster Stack 11:27:41 AM 12:46:29 PM 1:18:48UTC -7
Total Create Time 11:19:09 AM 12:46:29 PM 1:27:20
64 nodes –
80 EBS volumes
deployed in 87 minutes
IBM Systems Technical University © Copyright IBM Corporation 2019 19
AWS EC2 Instance View of Spectrum Scale Cluster
IBM Systems Technical University © Copyright IBM Corporation 2019 20
Demonstration use case: Scaling in the Cloud
IBM Systems Technical University © Copyright IBM Corporation 2019 21
Demonstration use case: Cloudburst
IBM Systems Technical University © Copyright IBM Corporation 2019 22
Hybrid Cloud Workflows – Bursting to the Cloud:
Data Agility and Collaboration with IBM Spectrum Scale
IBM Cloud
Connect via VPN over WAN
Available
2. Data Mobility via IBM
Spectrum Scale
Advanced File
Management (tech
preview)1. On-Premises Private Cloud
Using:
• IBM Cloud Private
• IBM Cloud Automation
Manager for multicloud self
service environment
• IBM Spectrum Scale
4. Archive to S3 within
AWS
3. Automated deployment
using IBM Cloud
Automation Manager
leveraging AWS EC2
instance and EBS
volumes. Deployed in 3-
node cluster.
Available
5. Deployed leveraging
BareMetal servers and
block storage. Deployed
in 2-node cluster.
6. Archive to IBM COS
IBM Systems Technical University © Copyright IBM Corporation 2019 23
On-Premise Private Cloud
IBM cloud
1
2
AFM home
AFM Cache
AFM Cache
Spectrum Scale AFMSpectrum Scale AFM
1. On-Premises Private Cloud Using:
 IBM Spectrum Scale
 IBM Cloud Private
 IBM Cloud Automation Manager for
multicloud self service environment
3
4
5
2. IBM Spectrum Scale automated
deployment using IBM Cloud
Automation Manager leveraging AWS
EC2 instance and EBS volumes. Data
mobility via IBM Spectrum scale
Active File Management for
collaboration
3. Backup/Archive to S3 within AWS
4. Deployed using IBM Bare Metal
servers and block storage. Data
mobility via IBM Spectrum scale
Active File Management for Data
analytics using IBM Cloud Private for
Data and Watson analytics.
5. Backup/Archive to IBM COS
Hybrid Cloud Workflows using IBM Spectrum Scale AFM
IBM Systems Technical University © Copyright IBM Corporation 2019 24
Transparent Cloud Tiering TCT Is Used Across IBM Storage
Cloud
Tiering
DS8000
Policy
DFSMS
Cloud Storage
TS7700
Cloud
Tiering
Cloud
Tiering
Spectrum Scale provides
policy driven data movement to
from the Cloud using TCT
• Managed data placement or
migration of cold data
IBM Systems Technical University © Copyright IBM Corporation 2019 25
Spectrum Scale Transparent Cloud Tiering (TCT)
26
Swift/S3
NFS
SMB
Hadoop
Docker
Kubernetes
POSIX
Transparent
Data
Metadata is managed by Spectrum Scale Cloud appears as external storage pool
Auto-tiering & migration
Store as Buckets
Ensure data integrity
Transparent
Cloud Tiering
IBM Systems Technical University © Copyright IBM Corporation 2019
Protocol mapping vs. Transparent Cloud Tiering
— Protocol Mapping
— Pros
• Simple Architecture
• No cache storage
— Cons
• All writes&reads have
to be mapped
• No cache for high-
performance read/write
• Often vendor mix
required
NFS/SMB
Protocol
Mapper
NFS/SMB
Protocol Node
TCT
NFS/SMB
Clients
NSD Server Cache
Meta
Data
Transparent Cloud Tiering
Pros
 High performance write
operations
 High performance read
for cached data
 Public cloud-ready
Cons
 More complex
architecture
 Cache storage required
 Increased response time
for non-cached data
…
Object Storage
IBM Systems Technical University © Copyright IBM Corporation 2019 27
Spectrum Scale TCT Value
— Extend Spectrum Scale to private or public cloud
• Open object store interfaces drive new Data
Economics
• Public Cloud:
o IBM Cloud Object Storage
o Amazon S3
o Microsoft Azure
• Private Cloud or on-premises:
o IBM Cloud Object Storage
o OpenStack Swift
— Transparent to end-users using Spectrum Scale
— Enhancing Object Storage choice
• Spectrum Scale as High-Performance, unified file&object
• IBM Cloud Object Storage as cost-optimized, scalable
object storage
Encrypted Ingegrity
Check
IBM Systems Technical University © Copyright IBM Corporation 2019 28
Recommended Environment for Spectrum Scale TCT
29
— Requires Spectrum Scale Advanced Edition or Data
Management Edition
— Prerequisite expectations / best practices:
 Appropriate median file sizes (>1MB, the larger, the better)
 Stable data for long-term retention
 Files unlikely to be updated or deleted (reads are ok)
 Sufficient Object Storage capacity
 Appropriate network connectivity to cloud storage
IBM Systems Technical University © Copyright IBM Corporation 2019
Cloud Object
Storage Provider 2
Cloud Service Node
Class
Cloud Service Node Class
Cloud Object Storage
Provider 1
Cloud Account
Node3 Node 5 Node 7 Node 8 Node 9
CES Protocol nodes
NSD Storage nodes
File System
Spectrum Scale
Cluster
File SetFile System
Node1
Cloud
Service
Node
Cloud
Service
Node
Cloud
Service
Node
Cloud
Service
Node
Node 6Node 4Node 2
Container
Cloud
Client
Container
Cloud
Service
Node
Cloud
Service
Node
Cloud Account
Container
Cloud
Client
Cloud
Client
Cloud Account
Container
Node 1
Remote
Mounted
Cloud
Client
Spectrum Scale
Cluster
Transparent Cloud Tiering Example
IBM Systems Technical University © Copyright IBM Corporation 2019 30
IBM Spectrum Scale Cloud Data Sharing
Swift/S3
Swift/S3
NFS
SMB
Hadoop
Docker
Kubernetes
POSIX
Traditional
Applications
Native Cloud
Applications
IBM Systems Technical University © Copyright IBM Corporation 2019 31
IBM Spectrum Scale Cloud Data Sharing details
— IBM Cloud Object Storage serves as
• Central data repository
• Data distribution point
• Data is accessible for native cloud applications through IBM COS S3 API
— Sharing can occur between object storage and many Spectrum Scale
Clusters
— Shared Data may originate in either the cloud or Spectrum Scale
— Data may be moved or copied between Spectrum Scale clusters and object
storage
— Efficient sharing mode: Special stubbed move available, so metdata only is
stored on Spectrum Scale with data imported transparently when a file is
requested
— One or more Spectrum Scale clusters can push to the cloud
— Spectrum Scale can pull data on demand
IBM Systems Technical University © Copyright IBM Corporation 2019 32
• Can now do Transparent Cloud Tiering to Microsoft Azure
– With the same features as S3 support
• Direct client high performance recalls
– Allows clients to issue recalls directly without having to go through the TCT
server nodes
• Asynchronous import support on COS
– COS Event-driven import of data from object storage
Spectrum Scale TCT capabilities in the latest Spectrum Scale 5.0.3
IBM Systems Technical University © Copyright IBM Corporation 2019 33
Cloud Object Storage
Provider 2
Cloud Service Node Class Cloud Service Node Class
Cloud Object
Storage Provider
1
Cloud Account
Node3 Node 7 Node 8 Node 9
CES Protocol nodes
NSD Storage nodes Spectrum Scale
Cluster
File SetFile System
Node1
Cloud
Service
Node
Cloud
Service
Node
Node 6Node 2
Cloud
Client
Container
Cloud
Service
Node
Cloud
Service
Node
Cloud Account
Container
Cloud
Client
Cloud
Client
Direct Client Transparent Recall Overview
1
2
3
4
Gateway recalls
1. LWE recall
received
2. Client forwards
to cloud service
node
3. Object read
4. Transfer from
cloud service
node to client
node
Direct recalls
1. LWE recall
received
2. Object read
1
2
Direct Recall Key Benefits
• Efficient
• Performance scales with
cluster size
IBM Systems Technical University © Copyright IBM Corporation 2019 34
— An AWS solution architect can to deploy a global namespace,
with flexible capacity to performance ratio in less than an
hour, without any knowledge of Spectrum Scale.
— An AWS solution administrator can dynamically start, stop,
add, and remove compute and data resources associated with
my global namespace, with limited knowledge of Spectrum
Scale.
— An AWS solution administrator, within an hour, can do either
disruptive or non-disruptive (in terms of the cluster, e.g.
rolling) upgrades of the Operating System and Spectrum
Software on my cluster, with limited knowledge of Spectrum
Scale, while still keeping existing applications and data in
place.
Summary – Value of Spectrum Scale on Amazon Web Services
IBM Systems Technical University © Copyright IBM Corporation 2019 35
Thank you!
IBM Systems Technical University © Copyright IBM Corporation 2019 36
Tony Pearson
tpearson@us.ibm.com
+1-520-799-4309
Please complete the Session
Evaluation!
Spectrum Scale User Group
— The Spectrum Scale User Group is free to join and open to all using, interested in using or
integrating Spectrum Scale. Check out the links below for upcoming meetings.
— In addition to the User Group hosting their own meetings, IBM will host Spectrum Scale
User Group meetings at most IBM Systems Technical Universities in 2019.
— Join the User Group activities. Join the mailing list. Meet peers. Get access to experts
from partners and IBM. Check out the Presentations link, free download of excellent
material.
— Web page: http://www.spectrumscale.org/
— Presentations: http://www.spectrumscale.org/presentations/
— Mailing list: http://www.spectrumscale.org/join/
Contact: http://www.spectrumscale.org/committee/
YouTube channel for Spectrum Scale User Group:
https://www.youtube.com/watch?v=iX440e__VHE&list=PLrdepxEIEyCp1TqZ2z3WfGOgqO9oY01xY
http://www.spectrumscaleug.org/category/posts-meetings/
IBM Systems Technical University © Copyright IBM Corporation 2019 37
Join or browse the Spectrum Scale UG mailing list!
Example of
User Group
content
https://www.spectrumscale.org/pipermail/gpfsug-discuss/
URL to gpfsug-
Archives
IBM Systems Technical University © Copyright IBM Corporation 2019 38
• Enhanced IBM Knowledge Center with all details for Spectrum Scale on Amazon
Web Services
• https://www.ibm.com/support/knowledgecenter/en/STXKQY_AWS_SHR/com.ibm.spectrum.scale.aws.v5r01.doc/bl1cld_aws_kclanding.htm
• https://www.ibm.com/support/knowledgecenter/STXKQY_AWS_SHR/com.ibm.spectrum.scale.aws.v5r01.doc/pdf/scale_aws.pdf
• YouTube: Deploying IBM Spectrum Scale Quick Start on AWS: https://www.youtube.com/watch?v=kc8JPAEzkPE
• Enabling Hybrid Cloud Storage using Transparent Cloud Tiering Redpaper
published May 2018
• http://www.redbooks.ibm.com/abstracts/redp5411.html?Open
• Spectrum Scale Cloud Blogs on IBM Developerworks
• https://developer.ibm.com/storage/2018/10/02/hpc-storage-aws-ibm-spectrum-scale/
• https://developer.ibm.com/storage/search/?q=spectrum+scale+cloud
39
IBM Spectrum Scale in the Cloud: more information
Special Thanks
I would like to thank the following colleagues
who contributed charts, insights, and review
comments for these presentation materials
— Chris Maestas
IBM Systems Technical University © Copyright IBM Corporation 2019 40
About the Speaker
41
Tony Pearson is a Master Inventor, Senior IT Management Consultant, and Content Manager for the
IBM Systems Technical University events. Tony joined IBM Corporation in 1986 in Tucson, Arizona,
USA, and has lived there ever since. Tony presents briefings on storage topics covering the entire IBM
Storage product line, IBM Spectrum Storage software products, and topics related to Cloud Computing,
Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and
leads client workshops to help clients with strategic planning for IBM’s integrated set of storage
management software, hardware, and virtualization solutions.
Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and
IBM Business Partners every week. This blog was rated one of the top 10 blogs for the IT storage
industry by “Networking World” magazine, and #1 most read IBM blog on IBM’s developerWorks. The
blog has been published in series of books, Inside System Storage: Volume I through V.
Over the past years, Tony has worked in development, marketing and consulting for various IBM
Systems hardware and software products. Tony has a Bachelor of Science degree in Software
Engineering, and a Master of Science degree in Electrical Engineering, both from the University of
Arizona. Tony is an inventor or co-inventor of 19 patents in the field of IBM Systems and electronic data
storage.
9000 S. Rita Road
Bldg 9032 Floor 1
Tucson, AZ 85744
+1 520-799-4309 (Office)
tpearson@us.ibm.com
Tony Pearson
Master Inventor
Senior Management
Consultant, IBM Systems
La Services
IBM Storage
IBM Systems
Technical University
My Social Media Presence
42
Blog*:
ibm.co/Pearson
LinkedIn:
https://www.linkedin.com/in/az990tony
Books:
www.lulu.com/spotlight/990_tony
IBM Expert Network on Slideshare:
www.slideshare.net/az990tony
Twitter:
twitter.com/az990tony
Facebook:
www.facebook.com/tony.pearson.16121
Instagram:
www.instagram.com/az990tony/
Email:
tpearson@us.ibm.com
* Not a typo. This is short URL for https://www.ibm.com/developerworks/mydeveloperworks/blogs/InsideSystemStorage/
IBM Systems
Technical University
Notices and disclaimers
— © 2019 International Business Machines Corporation. No part of
this document may be reproduced or transmitted in any form
without written permission from IBM.
— U.S. Government Users Restricted Rights — use, duplication or
disclosure restricted by GSA ADP Schedule Contract with IBM.
— Information in these presentations (including information
relating to products that have not yet been announced by IBM)
has been reviewed for accuracy as of the date of
initial publication and could include unintentional technical or
typographical errors. IBM shall have no responsibility to update
this information. This document is distributed “as is” without
any warranty, either express or implied. In no event, shall IBM
be liable for any damage arising from the use of this
information, including but not limited to, loss of data, business
interruption, loss of profit or loss of opportunity.
IBM products and services are warranted per the terms and
conditions of the agreements under which they are provided.
— IBM products are manufactured from new parts or new and used
parts.
In some cases, a product may not be new and may have been
previously installed. Regardless, our warranty terms apply.”
— Any statements regarding IBM's future direction, intent or
product plans are subject to change or withdrawal without
notice.
— Performance data contained herein was generally obtained in a
controlled, isolated environments. Customer examples are
presented as illustrations of how those
— customers have used IBM products and the results they may have
achieved. Actual performance, cost, savings or other results in
other operating environments may vary.
— References in this document to IBM products, programs, or
services does not imply that IBM intends to make such products,
programs or services available in all countries in which
IBM operates or does business.
— Workshops, sessions and associated materials may have been
prepared by independent session speakers, and do not necessarily
reflect the views of IBM. All materials and discussions are provided
for informational purposes only, and are neither intended to, nor
shall constitute legal or other guidance or advice to any individual
participant or their specific situation.
— It is the customer’s responsibility to insure its own compliance
with legal requirements and to obtain advice of competent legal
counsel as to the identification and interpretation of any
relevant laws and regulatory requirements that may affect the
customer’s business and any actions the customer may need to
take to comply with such laws. IBM does not provide legal advice
or represent or warrant that its services or products will ensure that
the customer follows any law.
IBM Systems Technical University © Copyright IBM Corporation 2019 43
Notices and disclaimers continued
— Information concerning non-IBM products was obtained from the suppliers
of those products, their published announcements or other publicly
available sources. IBM has not tested those products about this publication
and cannot confirm the accuracy of performance, compatibility or any other
claims related to non-IBM products. Questions on the capabilities of non-
IBM products should be addressed to the suppliers of those products.
IBM does not warrant the quality of any third-party products, or the ability of
any such third-party products to interoperate with IBM’s products. IBM
expressly disclaims all warranties, expressed or implied, including but
not limited to, the implied warranties of merchantability and fitness for a
purpose.
— The provision of the information contained herein is not intended to, and
does not, grant any right or license under any IBM patents, copyrights,
trademarks or other intellectual property right.
— IBM, the IBM logo, ibm.com and [names of other referenced
IBM products and services used in the presentation] are
trademarks of International Business Machines Corporation,
registered in many jurisdictions worldwide. Other product and
service names might be trademarks of IBM or other
companies. A current list of IBM trademarks is available on
the Web at "Copyright and trademark information" at:
www.ibm.com/legal/copytrade.shtml
IBM Systems Technical University © Copyright IBM Corporation 2019 44
This presentation uses the IBM Plex™ font
IBM Plex™ is our new typeface. It’s global, it’s versatile and it’s
distinctly IBM.
IBM Plex
Sans
The IBM company is freeing itself from the cold, modernist cliché
and replacing Helvetica with a new corporate typeface. Also
replaces Arial, Calibri, Lucida Grande, Trebuchet, etc.
IBM Plex
Mono
A little something for developers. Replaces
Courier New, Letter Gothic, Lucida Console, etc.
IBM Plex
Serif
A hybrid of the third kind (combining the best of Plex, Bodoni,
and Janson into a contemporary serif). Replaces Cambria,
Garamond, Lucida Bright, Times New Roman, etc.
IBM Plex is freely available as TrueType and OpenType at: https://github.com/IBM/plex/releases
and looks consistently good across Windows, Linux and Mac
IBM Systems Technical University © Copyright IBM Corporation 2019 45

Mais conteúdo relacionado

Mais procurados

Cloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarbor
Cloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarborCloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarbor
Cloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarborSvetlin Nakov
 
(ENT222) Reduce Business Cost and Risk with Disaster Recovery for AWS | AWS r...
(ENT222) Reduce Business Cost and Risk with Disaster Recovery for AWS | AWS r...(ENT222) Reduce Business Cost and Risk with Disaster Recovery for AWS | AWS r...
(ENT222) Reduce Business Cost and Risk with Disaster Recovery for AWS | AWS r...Amazon Web Services
 
13h00 aws 2012-fault_tolerant_applications
13h00   aws 2012-fault_tolerant_applications13h00   aws 2012-fault_tolerant_applications
13h00 aws 2012-fault_tolerant_applicationsinfolive
 
Oracle COTS Applications on AWS
Oracle COTS Applications on AWSOracle COTS Applications on AWS
Oracle COTS Applications on AWSTom Laszewski
 
Oracle on aws overview sep 2011
Oracle on aws overview   sep 2011Oracle on aws overview   sep 2011
Oracle on aws overview sep 2011Jamie Kinney
 
Build a Cloud Render-Ready Infrastructure
Build a Cloud Render-Ready InfrastructureBuild a Cloud Render-Ready Infrastructure
Build a Cloud Render-Ready InfrastructureAvere Systems
 
A Step By Step Guide To Put DB2 On Amazon Cloud
A Step By Step Guide To Put DB2 On Amazon CloudA Step By Step Guide To Put DB2 On Amazon Cloud
A Step By Step Guide To Put DB2 On Amazon CloudDeepak Rao
 
Oracle on AWS partner webinar series
Oracle on AWS partner webinar series Oracle on AWS partner webinar series
Oracle on AWS partner webinar series Tom Laszewski
 
[판교에서 만나는 아마존웹서비스] 새롭게 출시된 AWS 제품 소개
[판교에서 만나는 아마존웹서비스] 새롭게 출시된 AWS 제품 소개[판교에서 만나는 아마존웹서비스] 새롭게 출시된 AWS 제품 소개
[판교에서 만나는 아마존웹서비스] 새롭게 출시된 AWS 제품 소개Amazon Web Services Korea
 
Keynote: Your Future With Cloud Computing - Dr. Werner Vogels - AWS Summit 2...
Keynote: Your Future With Cloud Computing - Dr. Werner Vogels  - AWS Summit 2...Keynote: Your Future With Cloud Computing - Dr. Werner Vogels  - AWS Summit 2...
Keynote: Your Future With Cloud Computing - Dr. Werner Vogels - AWS Summit 2...Amazon Web Services
 
Oracle Solutions on AWS : May 2014
Oracle Solutions on AWS : May 2014Oracle Solutions on AWS : May 2014
Oracle Solutions on AWS : May 2014Tom Laszewski
 
So There’s This Amazon Thing
So There’s This Amazon ThingSo There’s This Amazon Thing
So There’s This Amazon ThingJared Faris
 
IBM Software Available In The Cloud With Amazon Web Services
IBM Software Available In The Cloud With Amazon Web ServicesIBM Software Available In The Cloud With Amazon Web Services
IBM Software Available In The Cloud With Amazon Web ServicesSteven Gerhardt
 
AWS Summit 2011: Migrating Existing Applications to AWS
AWS Summit 2011: Migrating Existing Applications to AWSAWS Summit 2011: Migrating Existing Applications to AWS
AWS Summit 2011: Migrating Existing Applications to AWSAmazon Web Services
 
Disaster recovery webinar - oct.7
Disaster recovery   webinar - oct.7Disaster recovery   webinar - oct.7
Disaster recovery webinar - oct.7Amazon Web Services
 
Does your Infrastructure Zone Match Your Application Workload?
Does your Infrastructure Zone Match Your Application Workload?Does your Infrastructure Zone Match Your Application Workload?
Does your Infrastructure Zone Match Your Application Workload?Aaron Delp
 

Mais procurados (20)

Cloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarbor
Cloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarborCloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarbor
Cloud for Developers: Azure vs. Google App Engine vs. Amazon vs. AppHarbor
 
(ENT222) Reduce Business Cost and Risk with Disaster Recovery for AWS | AWS r...
(ENT222) Reduce Business Cost and Risk with Disaster Recovery for AWS | AWS r...(ENT222) Reduce Business Cost and Risk with Disaster Recovery for AWS | AWS r...
(ENT222) Reduce Business Cost and Risk with Disaster Recovery for AWS | AWS r...
 
13h00 aws 2012-fault_tolerant_applications
13h00   aws 2012-fault_tolerant_applications13h00   aws 2012-fault_tolerant_applications
13h00 aws 2012-fault_tolerant_applications
 
Fault Tolerant Applications on AWS
Fault Tolerant Applications on AWSFault Tolerant Applications on AWS
Fault Tolerant Applications on AWS
 
Oracle COTS Applications on AWS
Oracle COTS Applications on AWSOracle COTS Applications on AWS
Oracle COTS Applications on AWS
 
Oracle on aws overview sep 2011
Oracle on aws overview   sep 2011Oracle on aws overview   sep 2011
Oracle on aws overview sep 2011
 
Build a Cloud Render-Ready Infrastructure
Build a Cloud Render-Ready InfrastructureBuild a Cloud Render-Ready Infrastructure
Build a Cloud Render-Ready Infrastructure
 
A Step By Step Guide To Put DB2 On Amazon Cloud
A Step By Step Guide To Put DB2 On Amazon CloudA Step By Step Guide To Put DB2 On Amazon Cloud
A Step By Step Guide To Put DB2 On Amazon Cloud
 
Oracle on AWS partner webinar series
Oracle on AWS partner webinar series Oracle on AWS partner webinar series
Oracle on AWS partner webinar series
 
Masterclass Webinar: Amazon S3
Masterclass Webinar: Amazon S3Masterclass Webinar: Amazon S3
Masterclass Webinar: Amazon S3
 
[판교에서 만나는 아마존웹서비스] 새롭게 출시된 AWS 제품 소개
[판교에서 만나는 아마존웹서비스] 새롭게 출시된 AWS 제품 소개[판교에서 만나는 아마존웹서비스] 새롭게 출시된 AWS 제품 소개
[판교에서 만나는 아마존웹서비스] 새롭게 출시된 AWS 제품 소개
 
Keynote: Your Future With Cloud Computing - Dr. Werner Vogels - AWS Summit 2...
Keynote: Your Future With Cloud Computing - Dr. Werner Vogels  - AWS Summit 2...Keynote: Your Future With Cloud Computing - Dr. Werner Vogels  - AWS Summit 2...
Keynote: Your Future With Cloud Computing - Dr. Werner Vogels - AWS Summit 2...
 
Oracle Solutions on AWS : May 2014
Oracle Solutions on AWS : May 2014Oracle Solutions on AWS : May 2014
Oracle Solutions on AWS : May 2014
 
So There’s This Amazon Thing
So There’s This Amazon ThingSo There’s This Amazon Thing
So There’s This Amazon Thing
 
IBM Software Available In The Cloud With Amazon Web Services
IBM Software Available In The Cloud With Amazon Web ServicesIBM Software Available In The Cloud With Amazon Web Services
IBM Software Available In The Cloud With Amazon Web Services
 
AWS Summit 2011: Migrating Existing Applications to AWS
AWS Summit 2011: Migrating Existing Applications to AWSAWS Summit 2011: Migrating Existing Applications to AWS
AWS Summit 2011: Migrating Existing Applications to AWS
 
Disaster recovery webinar - oct.7
Disaster recovery   webinar - oct.7Disaster recovery   webinar - oct.7
Disaster recovery webinar - oct.7
 
Bn1007 demo ppt aws
Bn1007 demo ppt awsBn1007 demo ppt aws
Bn1007 demo ppt aws
 
Introduction to AWS tools
Introduction to AWS toolsIntroduction to AWS tools
Introduction to AWS tools
 
Does your Infrastructure Zone Match Your Application Workload?
Does your Infrastructure Zone Match Your Application Workload?Does your Infrastructure Zone Match Your Application Workload?
Does your Infrastructure Zone Match Your Application Workload?
 

Semelhante a S111477 scale-in-cloud-jburg-v1909d

AWSome Day Roadshow 2017
AWSome Day Roadshow 2017AWSome Day Roadshow 2017
AWSome Day Roadshow 2017Tom Woodyer
 
AWS Webcast - Explore the AWS Cloud for Government
AWS Webcast - Explore the AWS Cloud for GovernmentAWS Webcast - Explore the AWS Cloud for Government
AWS Webcast - Explore the AWS Cloud for GovernmentAmazon Web Services
 
AWS Webcast - Best Practices in Architecting for the Cloud
AWS Webcast - Best Practices in Architecting for the CloudAWS Webcast - Best Practices in Architecting for the Cloud
AWS Webcast - Best Practices in Architecting for the CloudAmazon Web Services
 
Technical Essentials Training: AWS Innovate Ottawa
Technical Essentials Training: AWS Innovate OttawaTechnical Essentials Training: AWS Innovate Ottawa
Technical Essentials Training: AWS Innovate OttawaAmazon Web Services
 
WKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot Instances
WKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot InstancesWKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot Instances
WKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot InstancesAmazon Web Services
 
Architecting for the Cloud: Best Practices
Architecting for the Cloud: Best PracticesArchitecting for the Cloud: Best Practices
Architecting for the Cloud: Best PracticesAmazon Web Services
 
AWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh Varia
AWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh VariaAWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh Varia
AWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh VariaAmazon Web Services
 
Cloud & Native Cloud for Managers
Cloud & Native Cloud for ManagersCloud & Native Cloud for Managers
Cloud & Native Cloud for ManagersEitan Sela
 
Workshop; Deploy a Deep Learning Framework on Amazon ECS and Spot Instances
Workshop; Deploy a Deep Learning Framework on Amazon ECS and Spot InstancesWorkshop; Deploy a Deep Learning Framework on Amazon ECS and Spot Instances
Workshop; Deploy a Deep Learning Framework on Amazon ECS and Spot InstancesAmazon Web Services
 
HSBC and AWS Day - AWS foundations
HSBC and AWS Day - AWS foundationsHSBC and AWS Day - AWS foundations
HSBC and AWS Day - AWS foundationsAmazon Web Services
 

Semelhante a S111477 scale-in-cloud-jburg-v1909d (20)

Aws coi7
Aws coi7Aws coi7
Aws coi7
 
AMAZON CLOUD Course Content
AMAZON CLOUD Course ContentAMAZON CLOUD Course Content
AMAZON CLOUD Course Content
 
AWSome Day Roadshow 2017
AWSome Day Roadshow 2017AWSome Day Roadshow 2017
AWSome Day Roadshow 2017
 
Aws101
Aws101Aws101
Aws101
 
AWSome Day Dublin - June 2016
AWSome Day Dublin - June 2016AWSome Day Dublin - June 2016
AWSome Day Dublin - June 2016
 
AWSomeDays 2018 TechTrack
AWSomeDays 2018 TechTrackAWSomeDays 2018 TechTrack
AWSomeDays 2018 TechTrack
 
AWS Webcast - Explore the AWS Cloud for Government
AWS Webcast - Explore the AWS Cloud for GovernmentAWS Webcast - Explore the AWS Cloud for Government
AWS Webcast - Explore the AWS Cloud for Government
 
AWS Architecting In The Cloud
AWS Architecting In The CloudAWS Architecting In The Cloud
AWS Architecting In The Cloud
 
AWSome Day Leeds
AWSome Day Leeds AWSome Day Leeds
AWSome Day Leeds
 
AWS-services.pdf
AWS-services.pdfAWS-services.pdf
AWS-services.pdf
 
AWS Webcast - Best Practices in Architecting for the Cloud
AWS Webcast - Best Practices in Architecting for the CloudAWS Webcast - Best Practices in Architecting for the Cloud
AWS Webcast - Best Practices in Architecting for the Cloud
 
AWSome Day - 2018
AWSome Day - 2018AWSome Day - 2018
AWSome Day - 2018
 
Technical Essentials Training: AWS Innovate Ottawa
Technical Essentials Training: AWS Innovate OttawaTechnical Essentials Training: AWS Innovate Ottawa
Technical Essentials Training: AWS Innovate Ottawa
 
WKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot Instances
WKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot InstancesWKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot Instances
WKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot Instances
 
EC2.pdf
EC2.pdfEC2.pdf
EC2.pdf
 
Architecting for the Cloud: Best Practices
Architecting for the Cloud: Best PracticesArchitecting for the Cloud: Best Practices
Architecting for the Cloud: Best Practices
 
AWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh Varia
AWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh VariaAWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh Varia
AWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh Varia
 
Cloud & Native Cloud for Managers
Cloud & Native Cloud for ManagersCloud & Native Cloud for Managers
Cloud & Native Cloud for Managers
 
Workshop; Deploy a Deep Learning Framework on Amazon ECS and Spot Instances
Workshop; Deploy a Deep Learning Framework on Amazon ECS and Spot InstancesWorkshop; Deploy a Deep Learning Framework on Amazon ECS and Spot Instances
Workshop; Deploy a Deep Learning Framework on Amazon ECS and Spot Instances
 
HSBC and AWS Day - AWS foundations
HSBC and AWS Day - AWS foundationsHSBC and AWS Day - AWS foundations
HSBC and AWS Day - AWS foundations
 

Mais de Tony Pearson

Rapid_Recovery-T75-v2204j.pdf
Rapid_Recovery-T75-v2204j.pdfRapid_Recovery-T75-v2204j.pdf
Rapid_Recovery-T75-v2204j.pdfTony Pearson
 
L203326 intro-maria db-techu2020-v9
L203326 intro-maria db-techu2020-v9L203326 intro-maria db-techu2020-v9
L203326 intro-maria db-techu2020-v9Tony Pearson
 
S200743 storage-announcements-ist2020-v2001a
S200743 storage-announcements-ist2020-v2001aS200743 storage-announcements-ist2020-v2001a
S200743 storage-announcements-ist2020-v2001aTony Pearson
 
S200516 copy-data-management-ist2020-v2001c
S200516 copy-data-management-ist2020-v2001cS200516 copy-data-management-ist2020-v2001c
S200516 copy-data-management-ist2020-v2001cTony Pearson
 
S200515 storage-insights-ist2020-v2001d
S200515 storage-insights-ist2020-v2001dS200515 storage-insights-ist2020-v2001d
S200515 storage-insights-ist2020-v2001dTony Pearson
 
F200612 deliver-message-ist2020-v2001c
F200612 deliver-message-ist2020-v2001cF200612 deliver-message-ist2020-v2001c
F200612 deliver-message-ist2020-v2001cTony Pearson
 
Z111806 strengthen-security-sydney-v1910a
Z111806 strengthen-security-sydney-v1910aZ111806 strengthen-security-sydney-v1910a
Z111806 strengthen-security-sydney-v1910aTony Pearson
 
G111614 top-trends-sydney2019-v1910a
G111614 top-trends-sydney2019-v1910aG111614 top-trends-sydney2019-v1910a
G111614 top-trends-sydney2019-v1910aTony Pearson
 
G111416 personal-brand-sydney-v1910b
G111416 personal-brand-sydney-v1910bG111416 personal-brand-sydney-v1910b
G111416 personal-brand-sydney-v1910bTony Pearson
 
Z109889 z4 r-storage-dfsms-vegas-v1910b
Z109889 z4 r-storage-dfsms-vegas-v1910bZ109889 z4 r-storage-dfsms-vegas-v1910b
Z109889 z4 r-storage-dfsms-vegas-v1910bTony Pearson
 
Z110932 strengthen-security-jburg-v1909c
Z110932 strengthen-security-jburg-v1909cZ110932 strengthen-security-jburg-v1909c
Z110932 strengthen-security-jburg-v1909cTony Pearson
 
Z109889 z4 r-storage-dfsms-jburg-v1909d
Z109889 z4 r-storage-dfsms-jburg-v1909dZ109889 z4 r-storage-dfsms-jburg-v1909d
Z109889 z4 r-storage-dfsms-jburg-v1909dTony Pearson
 
S110646 storage-for-ai-jburg-v1909c
S110646 storage-for-ai-jburg-v1909cS110646 storage-for-ai-jburg-v1909c
S110646 storage-for-ai-jburg-v1909cTony Pearson
 
G108263 personal-brand-berlin-v1904a
G108263 personal-brand-berlin-v1904aG108263 personal-brand-berlin-v1904a
G108263 personal-brand-berlin-v1904aTony Pearson
 
S108283 svc-storwize-lagos-v1905d
S108283 svc-storwize-lagos-v1905dS108283 svc-storwize-lagos-v1905d
S108283 svc-storwize-lagos-v1905dTony Pearson
 
G108277 ds8000-resiliency-lagos-v1905c
G108277 ds8000-resiliency-lagos-v1905cG108277 ds8000-resiliency-lagos-v1905c
G108277 ds8000-resiliency-lagos-v1905cTony Pearson
 
G108276 public-speaking-lagos-v1905b
G108276 public-speaking-lagos-v1905bG108276 public-speaking-lagos-v1905b
G108276 public-speaking-lagos-v1905bTony Pearson
 
G108266 stack-the-deck-lagos-v1905c
G108266 stack-the-deck-lagos-v1905cG108266 stack-the-deck-lagos-v1905c
G108266 stack-the-deck-lagos-v1905cTony Pearson
 
G107984 personal-brand-atlanta-v1904a
G107984 personal-brand-atlanta-v1904aG107984 personal-brand-atlanta-v1904a
G107984 personal-brand-atlanta-v1904aTony Pearson
 
G107980 top-it-trends-atlanta-v1904b
G107980 top-it-trends-atlanta-v1904bG107980 top-it-trends-atlanta-v1904b
G107980 top-it-trends-atlanta-v1904bTony Pearson
 

Mais de Tony Pearson (20)

Rapid_Recovery-T75-v2204j.pdf
Rapid_Recovery-T75-v2204j.pdfRapid_Recovery-T75-v2204j.pdf
Rapid_Recovery-T75-v2204j.pdf
 
L203326 intro-maria db-techu2020-v9
L203326 intro-maria db-techu2020-v9L203326 intro-maria db-techu2020-v9
L203326 intro-maria db-techu2020-v9
 
S200743 storage-announcements-ist2020-v2001a
S200743 storage-announcements-ist2020-v2001aS200743 storage-announcements-ist2020-v2001a
S200743 storage-announcements-ist2020-v2001a
 
S200516 copy-data-management-ist2020-v2001c
S200516 copy-data-management-ist2020-v2001cS200516 copy-data-management-ist2020-v2001c
S200516 copy-data-management-ist2020-v2001c
 
S200515 storage-insights-ist2020-v2001d
S200515 storage-insights-ist2020-v2001dS200515 storage-insights-ist2020-v2001d
S200515 storage-insights-ist2020-v2001d
 
F200612 deliver-message-ist2020-v2001c
F200612 deliver-message-ist2020-v2001cF200612 deliver-message-ist2020-v2001c
F200612 deliver-message-ist2020-v2001c
 
Z111806 strengthen-security-sydney-v1910a
Z111806 strengthen-security-sydney-v1910aZ111806 strengthen-security-sydney-v1910a
Z111806 strengthen-security-sydney-v1910a
 
G111614 top-trends-sydney2019-v1910a
G111614 top-trends-sydney2019-v1910aG111614 top-trends-sydney2019-v1910a
G111614 top-trends-sydney2019-v1910a
 
G111416 personal-brand-sydney-v1910b
G111416 personal-brand-sydney-v1910bG111416 personal-brand-sydney-v1910b
G111416 personal-brand-sydney-v1910b
 
Z109889 z4 r-storage-dfsms-vegas-v1910b
Z109889 z4 r-storage-dfsms-vegas-v1910bZ109889 z4 r-storage-dfsms-vegas-v1910b
Z109889 z4 r-storage-dfsms-vegas-v1910b
 
Z110932 strengthen-security-jburg-v1909c
Z110932 strengthen-security-jburg-v1909cZ110932 strengthen-security-jburg-v1909c
Z110932 strengthen-security-jburg-v1909c
 
Z109889 z4 r-storage-dfsms-jburg-v1909d
Z109889 z4 r-storage-dfsms-jburg-v1909dZ109889 z4 r-storage-dfsms-jburg-v1909d
Z109889 z4 r-storage-dfsms-jburg-v1909d
 
S110646 storage-for-ai-jburg-v1909c
S110646 storage-for-ai-jburg-v1909cS110646 storage-for-ai-jburg-v1909c
S110646 storage-for-ai-jburg-v1909c
 
G108263 personal-brand-berlin-v1904a
G108263 personal-brand-berlin-v1904aG108263 personal-brand-berlin-v1904a
G108263 personal-brand-berlin-v1904a
 
S108283 svc-storwize-lagos-v1905d
S108283 svc-storwize-lagos-v1905dS108283 svc-storwize-lagos-v1905d
S108283 svc-storwize-lagos-v1905d
 
G108277 ds8000-resiliency-lagos-v1905c
G108277 ds8000-resiliency-lagos-v1905cG108277 ds8000-resiliency-lagos-v1905c
G108277 ds8000-resiliency-lagos-v1905c
 
G108276 public-speaking-lagos-v1905b
G108276 public-speaking-lagos-v1905bG108276 public-speaking-lagos-v1905b
G108276 public-speaking-lagos-v1905b
 
G108266 stack-the-deck-lagos-v1905c
G108266 stack-the-deck-lagos-v1905cG108266 stack-the-deck-lagos-v1905c
G108266 stack-the-deck-lagos-v1905c
 
G107984 personal-brand-atlanta-v1904a
G107984 personal-brand-atlanta-v1904aG107984 personal-brand-atlanta-v1904a
G107984 personal-brand-atlanta-v1904a
 
G107980 top-it-trends-atlanta-v1904b
G107980 top-it-trends-atlanta-v1904bG107980 top-it-trends-atlanta-v1904b
G107980 top-it-trends-atlanta-v1904b
 

Último

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 

Último (20)

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 

S111477 scale-in-cloud-jburg-v1909d

  • 1. IBM Spectrum Scale on the Cloud Tony Pearson IBM Master Inventor, Senior IT Management Consultant, TechU Content Manager 2019 IBM Systems Technical University 10-12 Sep 2019 | Johannesburg, SA
  • 2. Session Abstract — Many of you may think that Spectrum Scale is an on-premise solution only. — This session will dispel that myth - we'll describe various ways Spectrum Scale can be consumed in various clouds. Spectrum Scale can run on Amazon; will run in future on Google Cloud; can tier data to AWS and Azure. — Learn about the full breadth of Spectrum Scale in the cloud to deploy fully managed and custom designed solutions addressing extreme speed requirements or more moderate POSIX compliant storage efficiency requirements. — Hear how you can use Spectrum Scale in these clouds today, and how you can connect your current Spectrum Scale on-premise installations to these clouds for true Hybrid cloud capability. — A basic understanding of Spectrum Scale concepts is assumed IBM Systems Technical University © Copyright IBM Corporation 2019 2
  • 3. Disk TapeStorage Rich Servers Client workstations Users and applications Compute Farm Single name space Flash NFS HDFS Connector POSIX SMB/CIFS OpenStack Cinder Glance Manila IBM Spectrum Scale Automated data placement and data migration On/Off Premises Object S3 Swift Active = Hot+Warm = “Online” Archive = Cold = “Offline” Object Storage SAS SAP DB2 Oracle MQ etc. Mainframe Hadoop Cloud Providers Docker Kubernetes Spark Site A Site B Site C iSCSI Block IBM Spectrum Scale – Scalable File and Object Store IBM Systems Technical University © Copyright IBM Corporation 2019 3
  • 4. Spectrum Scale in the Cloud Today’s Agenda • Spectrum Scale on Cloud - Vision • Key Spectrum Scale Cloud Solutions • Spectrum Scale on Amazon Web Services • Transparent Cloud Tiering - tiering data to either AWS or Azure 4IBM Systems Technical University © Copyright IBM Corporation 2019
  • 5. Spectrum Scale On Cloud – Vision for Cloud Readiness Workload Support • Analytics & Cognitive • High Performance Computing • AI Data Pipeline Workload Ecosystem • Containers • CaaS • Ephemeral and Persistent Volumes • Storage Enabler for Containers (SEC) • Container Storage Interface (CSI) • Hybrid Use Cases • Cloud Burst • Multi Cloud Data Sharing • Archive • High Performance Tier 5 IBM Systems Technical University © Copyright IBM Corporation 2019 5
  • 6. Spectrum Scale On Cloud – Vision for Offerings User Deployed – Build your own cluster • IBM Cloud Spectrum Scale Solutions • IBM Spectrum Scale on AWS Private Cloud Solutions • IBM Cloud Private (ICP) • Others Partner Solutions Trials • AWS Quickstart • Google (soon) 6 IBM Systems Technical University © Copyright IBM Corporation 2019 6
  • 7. Spectrum Scale On Cloud – Vision for Ecosystem Integration User Interface (Look and Feel) Resource Provisioning and Initialization • Provision Virtual Machines, Storage etc. and initialize Deployment Automation and Orchestration • AWS Cloud Formation etc. Spectrum Scale Cluster Creation and Configuration • Cluster Creation, File system Creation. Feature enablement and configuration Digital Business Integration Service & Support Processes Durability & Elasticity 7 IBM Systems Technical University © Copyright IBM Corporation 2019 7
  • 8. Spectrum Scale on AWS • Bring your own license • Available Sept. 28 2018 • Data Management Edition • 3 months trial license • Available Sept. 13 2017 • Data Management Edition Spectrum Scale Trial link Spectrum Scale Marketplace link Run an entire Spectrum Scale cluster within the Amazon Web Services cloud! 8 IBM Systems Technical University © Copyright IBM Corporation 2019 8
  • 9. Spectrum Scale on Amazon Web Services – value proposition IBM Systems Technical University © Copyright IBM Corporation 2019 9
  • 10. Spectrum Scale on Amazon Web Services – what’s available Wow! A cluster of 16 EC2 Spectrum Scale instances can be launched and configured with a shared filesystem mounted on all nodes in less than an hour (and does not require any Spectrum Scale Admin Skills). “Bring your own (existing Spectrum Scale Data Management Edition) license” IBM Systems Technical University © Copyright IBM Corporation 2019 10
  • 11. Spectrum Scale on Amazon Web Services – ideal usage case guidelines Gives you ability to easily and quickly create and use a Highly Available Spectrum Scale cluster filesystem on AWS infrastructure w/ POSIX semantics • Targeted for HPC use cases (scalable bandwidth to capacity ratio) on AWS o Ideal for use cases that can use a newly deployed cluster o Data will be ingested by user into the new cluster o Data will be exported after application use by user cluster termination after application is done o Target is HPC use case where “extended” features of Spectrum Scale not required (i.e. Protocol nodes) o Optimize cost of AWS resources by shutting down some pieces of the cluster deployed is manual (we provide tools to optimize resource usage – you as customer must use those tools. Initial offering doesn’t yet use auto-scaling to manage resources) • Provides a Spectrum Scale global namespace across a set of EC2 instances • Provides an AMI (Amazon Machine Image boot image) with Spectrum Scale 5.0.2 Data Management edition installed on RHEL and GPL layer built • Provides a AWS Cloud Formation script that deploys a cluster of EC2 instances using the provided AMI and deploys Spectrum Scale using simple input to create a filesystem mounted on the launched instances • You as a AWS customer pay Amazon for EC2 resources used and RHEL and other software you consume • BYOL Data Management Edition licensed version of Scale is launched from the AWS Marketplace IBM Systems Technical University © Copyright IBM Corporation 2019 11
  • 12. Easy configuration through cloud formation Spectrum Scale Listing On AWS Marketplace IBM Systems Technical University © Copyright IBM Corporation 2019 12
  • 13. Spectrum Scale on AWS – Architecture  Solution based on EC2 instances and EBS volumes  NSD servers separate from “Compute” nodes that will mount the shared filesystem  NSD servers using AWS EBS storage for Spectrum Scale  Data is replicated across multiple availability zones  Support for creation of new VPCs or launching instances into existing VPCs.  Connection to these instances only via a Bastion Host (as per AWS best practices)  Focuses on simplicity/usability of deployment (e.g. reduced config. options) and leverages Amazon features such as Cloud Formation templates and AMIs (Amazon Machine Image) This diagram describes the deployment of the Multi Availability Zone configuration (2 AZs) In single Availability Zone deployments, all resources are deployed into the same Availability Zone IBM Systems Technical University © Copyright IBM Corporation 2019 13
  • 14. Some AWS Terms Defined (Part 1 or 2) AWS instance: a ‘node’ on AWS-- a virtual machine running on AWS hardware* • Spectrum Scale clusters are comprised of AWS EC2 instances running Spectrum Scale 5.0.2.1 on RHEL Amazon Machine Image (AMI): An AMI stores the data needed to launch AWS instances. It includes: • Launch permissions that control which AWS accounts can access the AMI to launch instances. You must subscribe to the IBM Spectrum Scale BYOL Marketplace Offering to have access to launch the AMI from the AWS Spectrum Scale Marketplace page • A block device mapping defining the volumes attached to a launched instance • A template for the root volume for the instance. Our AMI includes the RHEL operating system, IBM Spectrum Scale, with the GPL layer pre-built • Our AMI is backed by EBS (Amazon Web Services’ Elastic Block Storage), which means the root device for instances launched by the AMI will always use EBS volumes. IBM does not support the use of Amazon instance store volumes with Spectrum Scale instance root device volumes or NSD volumes) * Notes: In general IBM does have any way of mapping virtual resources (e.g., instances or EBS volumes) to their underlying AWS physical hardware (e.g., the memory, CPU and disks). Thus IBM Spectrum Scale on AWS can’t figure out which EC2 instances might share the same physical CPUs, memory, etc. IBM Systems Technical University © Copyright IBM Corporation 2019 14
  • 15. CloudFormation: according to Amazon, "AWS CloudFormation is a service that helps you model and set up your Amazon Web Services resources”. • CloudFormation templates define resources, like EC2 instances and EBS volumes, and allow these resources to be provisioned and configured • The Spectrum Scale Marketplace page has links to an IBM created CloudFormation template that will provision resources on AWS, using AMIs that already have Spectrum Scale installed, and then configure a Spectrum Scale cluster using these resources EBS Volume: An Amazon EBS volume is a basically a virtual disk*, providing block storage that can be attached to a single EC2 instance (at any given point) • The AMI stores the root volume and that is transferred to an EBS volume on every node that is deployed in a Spectrum Scale cluster. • NSD Servers on AWS will use EBS Volumes for Spectrum Scale file system NSDs • Amazon provides mirroring for these NSD volumes, and AWS claims “99.999% availability” (this an AWS AFR (annual failure rate) number). AWS and your AWS design is responsible for data durability of data on EBS volumes, even in configurations in which we replicate the volumes contents across AZs. More AWS Terms Defined Part 2 of 2) IBM Systems Technical University © Copyright IBM Corporation 2019 15
  • 16. Spectrum Scale on AWS – other AWS services and components 16IBM Systems Technical University © Copyright IBM Corporation 2019
  • 17. EC2 Instance (NSD Server) EBS volume EBS volume [. . . ] Spectrum Scale on AWS: Running on EC2 Instances Backed by EBS EC2 Instance (NSD Server) EBS volume EBS volume [. . . ] Network EBS connection [. . . Additional servers] EC2 Instance (NSD Client) EC2 Instance (NSD Client) EC2 Instance (NSD Client) Network Connection tor Non-EBS traffic [. . . Additional clients] [. . . Additional clients] 17
  • 18. Successful Stack Creation IBM Systems Technical University © Copyright IBM Corporation 2019 18
  • 19. Sample timings for Cluster Creation (testing results from Sept. 5/18) Cluster Stack Analysis Start time End time Execution time Comments Cluster Stack 11:27:41 AM 12:46:29 PM 1:18:48UTC -7 Scaling gtoup + instance create 11:27:41 UTC 64 T2.Medium instances CFI init inside instance 6:31:51 PM 7:45:41 PM 1:13:50UTC aws_init_setup 6:31:51 PM 6:34:07 PM 0:02:16UTC Create nodelist.txt file aws_passwordless_setup 6:34:08 PM 6:34:10 PM 0:00:02UTC 64 nodes aws_nsd_server_setup - AZ1 6:34:11 PM 7:09:57 PM 0:35:46UTC Create, 40 * 10 GB EBS volumes, attach (5 per instance) aws_nsd_server_setup - AZ2 6:34:23 PM 7:10:17 PM 0:35:54UTC Create, 40 * 10 GB EBS volumes, attach (5 per instance) aws_cluster_setup 7:09:58 PM 7:20:13 PM 0:10:15UTC sleeps for 100s twice aws_add_compute_nodes 7:20:13 PM 7:26:31 PM 0:06:18UTC aws_filesystem_setup 7:26:31 PM 7:29:20 PM 0:02:49UTC aws_mount_setup 7:29:24 PM 7:29:54 PM 0:00:30UTC aws_zimon_setup 7:29:54 PM 7:30:28 PM 0:00:34UTC aws_tunning_aids_setup 7:30:28 PM 7:41:36 PM 0:11:08UTC Scope of improvement aws_verification_setup 7:41:36 PM 7:45:41 PM 0:04:05UTC Stack name Start Time End Time Execution Time VPC Stack 11:19:09 AM 11:22:04 AM 0:02:55UTC -7 Bastion Node Stack 11:22:19 AM 11:27:28 AM 0:05:09UTC -7 Cluster Stack 11:27:41 AM 12:46:29 PM 1:18:48UTC -7 Total Create Time 11:19:09 AM 12:46:29 PM 1:27:20 64 nodes – 80 EBS volumes deployed in 87 minutes IBM Systems Technical University © Copyright IBM Corporation 2019 19
  • 20. AWS EC2 Instance View of Spectrum Scale Cluster IBM Systems Technical University © Copyright IBM Corporation 2019 20
  • 21. Demonstration use case: Scaling in the Cloud IBM Systems Technical University © Copyright IBM Corporation 2019 21
  • 22. Demonstration use case: Cloudburst IBM Systems Technical University © Copyright IBM Corporation 2019 22
  • 23. Hybrid Cloud Workflows – Bursting to the Cloud: Data Agility and Collaboration with IBM Spectrum Scale IBM Cloud Connect via VPN over WAN Available 2. Data Mobility via IBM Spectrum Scale Advanced File Management (tech preview)1. On-Premises Private Cloud Using: • IBM Cloud Private • IBM Cloud Automation Manager for multicloud self service environment • IBM Spectrum Scale 4. Archive to S3 within AWS 3. Automated deployment using IBM Cloud Automation Manager leveraging AWS EC2 instance and EBS volumes. Deployed in 3- node cluster. Available 5. Deployed leveraging BareMetal servers and block storage. Deployed in 2-node cluster. 6. Archive to IBM COS IBM Systems Technical University © Copyright IBM Corporation 2019 23
  • 24. On-Premise Private Cloud IBM cloud 1 2 AFM home AFM Cache AFM Cache Spectrum Scale AFMSpectrum Scale AFM 1. On-Premises Private Cloud Using:  IBM Spectrum Scale  IBM Cloud Private  IBM Cloud Automation Manager for multicloud self service environment 3 4 5 2. IBM Spectrum Scale automated deployment using IBM Cloud Automation Manager leveraging AWS EC2 instance and EBS volumes. Data mobility via IBM Spectrum scale Active File Management for collaboration 3. Backup/Archive to S3 within AWS 4. Deployed using IBM Bare Metal servers and block storage. Data mobility via IBM Spectrum scale Active File Management for Data analytics using IBM Cloud Private for Data and Watson analytics. 5. Backup/Archive to IBM COS Hybrid Cloud Workflows using IBM Spectrum Scale AFM IBM Systems Technical University © Copyright IBM Corporation 2019 24
  • 25. Transparent Cloud Tiering TCT Is Used Across IBM Storage Cloud Tiering DS8000 Policy DFSMS Cloud Storage TS7700 Cloud Tiering Cloud Tiering Spectrum Scale provides policy driven data movement to from the Cloud using TCT • Managed data placement or migration of cold data IBM Systems Technical University © Copyright IBM Corporation 2019 25
  • 26. Spectrum Scale Transparent Cloud Tiering (TCT) 26 Swift/S3 NFS SMB Hadoop Docker Kubernetes POSIX Transparent Data Metadata is managed by Spectrum Scale Cloud appears as external storage pool Auto-tiering & migration Store as Buckets Ensure data integrity Transparent Cloud Tiering IBM Systems Technical University © Copyright IBM Corporation 2019
  • 27. Protocol mapping vs. Transparent Cloud Tiering — Protocol Mapping — Pros • Simple Architecture • No cache storage — Cons • All writes&reads have to be mapped • No cache for high- performance read/write • Often vendor mix required NFS/SMB Protocol Mapper NFS/SMB Protocol Node TCT NFS/SMB Clients NSD Server Cache Meta Data Transparent Cloud Tiering Pros  High performance write operations  High performance read for cached data  Public cloud-ready Cons  More complex architecture  Cache storage required  Increased response time for non-cached data … Object Storage IBM Systems Technical University © Copyright IBM Corporation 2019 27
  • 28. Spectrum Scale TCT Value — Extend Spectrum Scale to private or public cloud • Open object store interfaces drive new Data Economics • Public Cloud: o IBM Cloud Object Storage o Amazon S3 o Microsoft Azure • Private Cloud or on-premises: o IBM Cloud Object Storage o OpenStack Swift — Transparent to end-users using Spectrum Scale — Enhancing Object Storage choice • Spectrum Scale as High-Performance, unified file&object • IBM Cloud Object Storage as cost-optimized, scalable object storage Encrypted Ingegrity Check IBM Systems Technical University © Copyright IBM Corporation 2019 28
  • 29. Recommended Environment for Spectrum Scale TCT 29 — Requires Spectrum Scale Advanced Edition or Data Management Edition — Prerequisite expectations / best practices:  Appropriate median file sizes (>1MB, the larger, the better)  Stable data for long-term retention  Files unlikely to be updated or deleted (reads are ok)  Sufficient Object Storage capacity  Appropriate network connectivity to cloud storage IBM Systems Technical University © Copyright IBM Corporation 2019
  • 30. Cloud Object Storage Provider 2 Cloud Service Node Class Cloud Service Node Class Cloud Object Storage Provider 1 Cloud Account Node3 Node 5 Node 7 Node 8 Node 9 CES Protocol nodes NSD Storage nodes File System Spectrum Scale Cluster File SetFile System Node1 Cloud Service Node Cloud Service Node Cloud Service Node Cloud Service Node Node 6Node 4Node 2 Container Cloud Client Container Cloud Service Node Cloud Service Node Cloud Account Container Cloud Client Cloud Client Cloud Account Container Node 1 Remote Mounted Cloud Client Spectrum Scale Cluster Transparent Cloud Tiering Example IBM Systems Technical University © Copyright IBM Corporation 2019 30
  • 31. IBM Spectrum Scale Cloud Data Sharing Swift/S3 Swift/S3 NFS SMB Hadoop Docker Kubernetes POSIX Traditional Applications Native Cloud Applications IBM Systems Technical University © Copyright IBM Corporation 2019 31
  • 32. IBM Spectrum Scale Cloud Data Sharing details — IBM Cloud Object Storage serves as • Central data repository • Data distribution point • Data is accessible for native cloud applications through IBM COS S3 API — Sharing can occur between object storage and many Spectrum Scale Clusters — Shared Data may originate in either the cloud or Spectrum Scale — Data may be moved or copied between Spectrum Scale clusters and object storage — Efficient sharing mode: Special stubbed move available, so metdata only is stored on Spectrum Scale with data imported transparently when a file is requested — One or more Spectrum Scale clusters can push to the cloud — Spectrum Scale can pull data on demand IBM Systems Technical University © Copyright IBM Corporation 2019 32
  • 33. • Can now do Transparent Cloud Tiering to Microsoft Azure – With the same features as S3 support • Direct client high performance recalls – Allows clients to issue recalls directly without having to go through the TCT server nodes • Asynchronous import support on COS – COS Event-driven import of data from object storage Spectrum Scale TCT capabilities in the latest Spectrum Scale 5.0.3 IBM Systems Technical University © Copyright IBM Corporation 2019 33
  • 34. Cloud Object Storage Provider 2 Cloud Service Node Class Cloud Service Node Class Cloud Object Storage Provider 1 Cloud Account Node3 Node 7 Node 8 Node 9 CES Protocol nodes NSD Storage nodes Spectrum Scale Cluster File SetFile System Node1 Cloud Service Node Cloud Service Node Node 6Node 2 Cloud Client Container Cloud Service Node Cloud Service Node Cloud Account Container Cloud Client Cloud Client Direct Client Transparent Recall Overview 1 2 3 4 Gateway recalls 1. LWE recall received 2. Client forwards to cloud service node 3. Object read 4. Transfer from cloud service node to client node Direct recalls 1. LWE recall received 2. Object read 1 2 Direct Recall Key Benefits • Efficient • Performance scales with cluster size IBM Systems Technical University © Copyright IBM Corporation 2019 34
  • 35. — An AWS solution architect can to deploy a global namespace, with flexible capacity to performance ratio in less than an hour, without any knowledge of Spectrum Scale. — An AWS solution administrator can dynamically start, stop, add, and remove compute and data resources associated with my global namespace, with limited knowledge of Spectrum Scale. — An AWS solution administrator, within an hour, can do either disruptive or non-disruptive (in terms of the cluster, e.g. rolling) upgrades of the Operating System and Spectrum Software on my cluster, with limited knowledge of Spectrum Scale, while still keeping existing applications and data in place. Summary – Value of Spectrum Scale on Amazon Web Services IBM Systems Technical University © Copyright IBM Corporation 2019 35
  • 36. Thank you! IBM Systems Technical University © Copyright IBM Corporation 2019 36 Tony Pearson tpearson@us.ibm.com +1-520-799-4309 Please complete the Session Evaluation!
  • 37. Spectrum Scale User Group — The Spectrum Scale User Group is free to join and open to all using, interested in using or integrating Spectrum Scale. Check out the links below for upcoming meetings. — In addition to the User Group hosting their own meetings, IBM will host Spectrum Scale User Group meetings at most IBM Systems Technical Universities in 2019. — Join the User Group activities. Join the mailing list. Meet peers. Get access to experts from partners and IBM. Check out the Presentations link, free download of excellent material. — Web page: http://www.spectrumscale.org/ — Presentations: http://www.spectrumscale.org/presentations/ — Mailing list: http://www.spectrumscale.org/join/ Contact: http://www.spectrumscale.org/committee/ YouTube channel for Spectrum Scale User Group: https://www.youtube.com/watch?v=iX440e__VHE&list=PLrdepxEIEyCp1TqZ2z3WfGOgqO9oY01xY http://www.spectrumscaleug.org/category/posts-meetings/ IBM Systems Technical University © Copyright IBM Corporation 2019 37
  • 38. Join or browse the Spectrum Scale UG mailing list! Example of User Group content https://www.spectrumscale.org/pipermail/gpfsug-discuss/ URL to gpfsug- Archives IBM Systems Technical University © Copyright IBM Corporation 2019 38
  • 39. • Enhanced IBM Knowledge Center with all details for Spectrum Scale on Amazon Web Services • https://www.ibm.com/support/knowledgecenter/en/STXKQY_AWS_SHR/com.ibm.spectrum.scale.aws.v5r01.doc/bl1cld_aws_kclanding.htm • https://www.ibm.com/support/knowledgecenter/STXKQY_AWS_SHR/com.ibm.spectrum.scale.aws.v5r01.doc/pdf/scale_aws.pdf • YouTube: Deploying IBM Spectrum Scale Quick Start on AWS: https://www.youtube.com/watch?v=kc8JPAEzkPE • Enabling Hybrid Cloud Storage using Transparent Cloud Tiering Redpaper published May 2018 • http://www.redbooks.ibm.com/abstracts/redp5411.html?Open • Spectrum Scale Cloud Blogs on IBM Developerworks • https://developer.ibm.com/storage/2018/10/02/hpc-storage-aws-ibm-spectrum-scale/ • https://developer.ibm.com/storage/search/?q=spectrum+scale+cloud 39 IBM Spectrum Scale in the Cloud: more information
  • 40. Special Thanks I would like to thank the following colleagues who contributed charts, insights, and review comments for these presentation materials — Chris Maestas IBM Systems Technical University © Copyright IBM Corporation 2019 40
  • 41. About the Speaker 41 Tony Pearson is a Master Inventor, Senior IT Management Consultant, and Content Manager for the IBM Systems Technical University events. Tony joined IBM Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. Tony presents briefings on storage topics covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to Cloud Computing, Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization solutions. Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1 most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume I through V. Over the past years, Tony has worked in development, marketing and consulting for various IBM Systems hardware and software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical Engineering, both from the University of Arizona. Tony is an inventor or co-inventor of 19 patents in the field of IBM Systems and electronic data storage. 9000 S. Rita Road Bldg 9032 Floor 1 Tucson, AZ 85744 +1 520-799-4309 (Office) tpearson@us.ibm.com Tony Pearson Master Inventor Senior Management Consultant, IBM Systems La Services IBM Storage IBM Systems Technical University
  • 42. My Social Media Presence 42 Blog*: ibm.co/Pearson LinkedIn: https://www.linkedin.com/in/az990tony Books: www.lulu.com/spotlight/990_tony IBM Expert Network on Slideshare: www.slideshare.net/az990tony Twitter: twitter.com/az990tony Facebook: www.facebook.com/tony.pearson.16121 Instagram: www.instagram.com/az990tony/ Email: tpearson@us.ibm.com * Not a typo. This is short URL for https://www.ibm.com/developerworks/mydeveloperworks/blogs/InsideSystemStorage/ IBM Systems Technical University
  • 43. Notices and disclaimers — © 2019 International Business Machines Corporation. No part of this document may be reproduced or transmitted in any form without written permission from IBM. — U.S. Government Users Restricted Rights — use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM. — Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. This document is distributed “as is” without any warranty, either express or implied. In no event, shall IBM be liable for any damage arising from the use of this information, including but not limited to, loss of data, business interruption, loss of profit or loss of opportunity. IBM products and services are warranted per the terms and conditions of the agreements under which they are provided. — IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.” — Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice. — Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those — customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary. — References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. — Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation. — It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer follows any law. IBM Systems Technical University © Copyright IBM Corporation 2019 43
  • 44. Notices and disclaimers continued — Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products about this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non- IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM expressly disclaims all warranties, expressed or implied, including but not limited to, the implied warranties of merchantability and fitness for a purpose. — The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. — IBM, the IBM logo, ibm.com and [names of other referenced IBM products and services used in the presentation] are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml IBM Systems Technical University © Copyright IBM Corporation 2019 44
  • 45. This presentation uses the IBM Plex™ font IBM Plex™ is our new typeface. It’s global, it’s versatile and it’s distinctly IBM. IBM Plex Sans The IBM company is freeing itself from the cold, modernist cliché and replacing Helvetica with a new corporate typeface. Also replaces Arial, Calibri, Lucida Grande, Trebuchet, etc. IBM Plex Mono A little something for developers. Replaces Courier New, Letter Gothic, Lucida Console, etc. IBM Plex Serif A hybrid of the third kind (combining the best of Plex, Bodoni, and Janson into a contemporary serif). Replaces Cambria, Garamond, Lucida Bright, Times New Roman, etc. IBM Plex is freely available as TrueType and OpenType at: https://github.com/IBM/plex/releases and looks consistently good across Windows, Linux and Mac IBM Systems Technical University © Copyright IBM Corporation 2019 45