OBJECT STORAGE: - WHAT DOES THAT MEAN? - BENEFITS & REPERCUSSIONS - TIERING STORAGE - VALID & INVALID USE CASES

1. Object Storage is
Awesome!
Q4 2015
( Truth or…. ? )
presented at the
Project Cloud Quarterly Meeting

2. Today’s (storage) Wonk…
Paul Evans
Principal Architect
• 20+ years in Media & Technology
engineering
• Tours of duty with Lucasfilm, IBM,
PayPal, Brocade, Fox, USC
• OEM-level Integration using
Commercial & Open-Source
components

3. AGENDA
OBJECT STORAGE:
- WHAT DOES THAT MEAN?
- BENEFITS & REPERCUSSIONS
- TIERING STORAGE
- VALID & INVALID USE CASES

4. OBLIGATORY ‘FRAMING’ SLIDE
DATA IS GROWING!
(Garter, IDC, etc. all say it is so….)
Note: ‘Clouds’ are hot too

5. “a storage architecture that manages data as objects, as opposed
to other storage architectures like file systems which manage
data as a file hierarchy and block storage which manages data as
blocks within sectors and tracks.”
OBJECT STORAGE

6. OBJECT STORAGE
Object Storage: Split MeaningTOP
HALF
HALF
BOTTOM

7. Object Storage: Split MeaningTOP
BOTTOM
ACCESSING
STORED DATA
PROTECTING
STORED DATA

8. OBJECTSTORAGE:
TOPHALF GENERIC HTTP EXTENDED API
PUT
GET
DELETE
S3
AZURE
SWIFT (OPENSTACK)
RADOS
WOS
SCALITY
AMPLISTOR
CLEVERSAFE
…OTHERS

9. OBJECTSTORAGE:
TOPHALF BENEFITS
LOOSELY COUPLED CLIENTS
RICH METADATA
SEAMLESS SCALE
SIMPLE PROTOCOL

10. OBJECTSTORAGE:
TOPHALF ANTI-BENEFITS
OBJECT FRAGMENTATION
…and….
SLOW ‘PER-CLIENT’

11. OBJECTSTORAGE:
TOPHALF ANTI-BENEFITS…
MACHINE-FRIENDLY,
ORGANICS-
FRIENDLY
NOT

12. OBJECTSTORAGE:
BOTTOMHALF
Example: RAID-BASED PROTECTION
If Data Was Stored by Ducks….

13. OBJECTSTORAGE:
BOTTOMHALF
Ex: OBJECT-BASED PROTECTION
If Data Was Stored by Ducks….

14. OBJECTSTORAGE:
BOTTOMHALF
ERASURE CODING

15. OBJECTSTORAGE:
BOTTOMHALF
+ GEO-SPREAD
ERASURE CODING

16. the (private) Object Landscape
Ceph SWIFT Amplistor
& La<us EMC Cleversafe Scality WOS
open open commercial commercial commercial commercial commercial
naEve
(in-kernel)
via iSCSI
Gateway
via iSCSI
Gateway
via iSCSI
Gateway
via iSCSI
Gateway
integrated
gateway
via iSCSI
Gateway
naEve via
File GTWY hybrid semi-naEve via
File GTWY semi-naEve hybrid
modular modular rateless
(fountain)
Cauchy
Reed-
Solomon
Luby CRS proprietary
(Reed-Sol)
proprietary
(Reed-Sol)
Licenseblockfileerasure
coding

17. OBJECTSTORAGE:
BOTTOMHALF
BENEFITS
SCALE!
EXTREME RELIABILITY

18. OBJECTSTORAGE:
BOTTOMHALF
ANTI-BENEFITS
COMPLEXITY -> LATENCY
‘DIFFERENT’-> CONFUSION
Also: BEST PERFORMANCE = REPLICA

19. OBJECTSTORAGE:
BOTTOMHALF
NOTABLE ‘OS’ EXCEPTIONS
(in the realm of performance…)
Custom OSS/OST
Primarily HPC/Linux usage
LUSTRE
ANSI T10 OSD model
Improved SMB access
PanFS
RADOS+CRUSH
Object / File / Block
CEPH
Out-of-Band Metadata
‘StorNext on NFS’
pNFS

20. TIERINGDATA
SEETHEBIGPICTURE
Object Storage / API Cold Storage
Archive
Virtualized Namespace
blockstorage
openstackhadoop
Scale Out
Storage
Remote
Cloud
Access
Direct

21. OBJECT STORAGE USESVALID
• GLOBAL ‘SHARED’ ACCESS
• LOW BIT-RATE STREAMING
• ORIGIN SERVER (CDN)
• BULK PROCESSING (TRANSCODING)
• BULK STORAGE / STAGING SPACE

22. OBJECT STORAGE USES
SUB-OTPIMAL
• REAL-TIME ACCESS
• HIGH-THROUGHPUT CLIENTS
• PERFORMANCE EFFICIENCY
• LOW-LATENCY APPLICATIONS
USUALLY

23. In Summary…
orSAN NAS& OBJECTImperial Envoy of Massive Persuasion
Light/Fast vs
Work-at-Scale

24. Q&A
Paul Evans
Principal Architect
paul@daystrom.com