Benefits of an Agile Data Fabric for Business Intelligence

Benefits of an Agile Data Fabric for
Business Intelligence
© 2016 BROCADE COMMUNICATIONS SYSTEMS, INC.

We are the Data Interconnect for
the worlds top Datacenters
IP Fabric AutomationGen6Mobility RoutingSoftware
2

Leading from Data Center to Network Edge
Positioned where the world is going
• New mobile edge
• New telco edge
• New enterprise edge
• Public/private cloud
• 5G
• IoT
© 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. 3
# 1Hospitality
Wi-Fi
# 2 Data Center
Networking
# 3 Enterprise
Wireless
LAN
# 3
Enterprise edge
networking in
the U.S. & EMEA
# 1Storage Area
Networking
# 1Service
Provider
Wi-Fi

Brocade Is Building a New Networking Company
To enable businesses to thrive in the Digital Business Era
Switching &
Routing
Software-based
Virtualization
& Control
Analytics
Mobile
Networking
Wireless
EDGE
DATA
CENTER
Fabrics
Storage
Networking IP Fabrics
Campus
Products
vRouter
vADC
SDN Controller
Network
Automation
Machine
Learning
NVA
AMP
Security
vEPC
MEC WLAN
Small-cell

Innovative
Always optimized
IT-as-a-Service
Automated
Optimized for
application and
cloud access
Today
Build the network
you need
Agile
Optimized for
spend, speed,
and efficiency
Intelligent
Optimized for
opportunity
STORAGE FOUNDATION
FABRICS
ANALYTICS
NFV
SDN CONTROLLER
MACHINE LEARNING
SECURITY BOLTED ON PERVASIVE SECURITY
Helping Our Customers on This Journey to
the Agile Data Fabric
Hyperscale cloud

An Industry
in Transition
MapReduce
HDFS, Reliable Storage platform
Hadoop 1.0
Yarn and Container management.
Rapid ecosystem growth
Multi-Purpose Platform
Real Time Processing
Explosive Ecosytem
Interactive, Streaming
Delivery
IT
Relevance
Gap
Expectations
2013
2016
IoT > $1.7T Cloud spending
> $500B
Mobile phones
> 2.1B
> 1.5B people
affected by
data hacks
By 2020
The biggest risk is to do nothing!
2011

The Ecosystem
Customer Considerations
• Existing + New systems
• Partnerships
• Connectivity
– Scale
– Performance
– Automation
– Local, multi-site &
external -aaS

The Data Silo Lifecycle
Agile Data Fabric to Break the Cycle
Strategic vision
Proof of Concept
Execution
Vision
Focused BI Goals
Data Silo

The Data Silo Lifecycle
Agile Data Fabric to Break the Cycle
Execution
Vision
BI based on a
Agile Data
Fabric

Innovation &
Intelligence
Intelligent large dataset mobility
• Real time network visibility
• Arizona State use case
Flexible, Agile,
Open at Scale
Joint CSC design and architecture
• Multi-datacenter Solution
• Open Scalable Flexible Architecture
Modular
Multipurpose
Multi-Purpose Data lake
• Hitachi Data Systems HSP
• EMC Federated Datalake
Data Fabric Case Studies

• Hitachi Data Systems HSP
• EMC Federated DataLake
Modular & Multipurpose

Enterprise Data Lake HSP
- Most flexible and efficient
on-premise architecture
- Persistent and managed
data layer
- Fast direct data ingest
- Ready-to-go data refinery
appliance
- Run multiple applications
concurrently in VMs
- Data-in-place analytics
reduces copies
Faster time-to-value,
flexible and secure
Hitachi Data Systems HSP
Comparing Big Data Infrastructure
Choices
Bare-Metal DIY Hadoop
- Inexpensive whitebox
hardware
- OpenSource software
- DIY projects can be
complicated
- Test case is small
- Underestimate effort
- Management and data
protection overhead
- Projects often fail
DIY project on a tight
budget – often fails!
Public Cloud
- Fastest way to get up and
running for specific
workloads
- Easy-to-use and provision
- Transparent Hardware
and Software costs
- Fine for specific
applications, but not
flexible
- Network bottleneck
Fast TTV and initially
cheaper, but not flexible Integrated
Brocade
ICX

Big Picture: The HDS Big Data Infrastructure Portfolio
Data Lake
PDI
PDI
PDI
PDI
Enterprise Hyper-Converged Scale-out
PDI in KVMs
 Archive
 Regulatory
Compliance
 Analytics
 Hadoop/Spark
 NoSQL
 Elastic SearchPBA

15
Hitachi’s HSP with ICX 7750 Top of Rack
• 2 Brocade ToR per rack
‒ 40G QSFP
• 20 nodes per rack
‒ (cluster 5 -100 nodes)
Standard PDUs
▪ 10/40 GbE Distributed switch
▪ Industry leading port-density
▪ Leading price/performance
▪ Low latency
▪ Cut-through
▪ Reliable, scalable, HA, efficient
Start small ..and scale as you go

16
• 2 Brocade ToR per rack
‒ 40G QSFP
• 20 nodes per rack
‒ (cluster 5 -100 nodes)
• Up to 5 racks
Start small ..and scale as you go
HSP: The Network Matters for Hyper Scale-out
Standard PDUs
Network Layout with
Brocade ToR

The ICX Family
17
• 48-Port SFP+ 10 GbE
• 6+6-Port QSFP+/40 GbE
ICX7750-48FKey Highlights & Differentiators
• Unprecedented port density: 96×10
GbE /32×40 GbE per unit or 48×10
GbE with up to 12×40 GbE
uplinks/stack ports
• Market-leading stacking scalability up
to 12 units per stack
• Longer stacking distance:
40 GbE (QSFP-LR)
• Chassis performance (~ 5.7 Tbps
aggregate stacking bandwidth)
• Hitless Failover within the stack
• SDN- Openflow 1.0 and 1.3 with hybrid
mode
• Full IPv4 and IPv6 routing support,
includes BGP and VRF
• Extended operating temp
(up to 50°C)
• Common Criteria and FIPs certification
• 48-Port RJ-45 10 GbE
• 6+6-Port QSFP+ (six optional)
ICX7750-48C
• 26 to 40 GbE ports QSFP+
• 32 to 40 GbE with optional module
ICX7750-26Q
• Quad-core 1.5 GHz CPU 8 GB system
memory, 2 G Flash, USB storage
• Optional 6×40 GbE QSFP
• Redundant power supplies and fans with
front-to-back or back-to-front airflow
All Brocade ICX7750 Models

18
ISILON ECS
© Copyright 2015 EMC Corporation. All rights reserved.
EMC
Data Lake
Foundation

IP Networks for Data Lakes
• Deliver predictable performance and unmatched
resiliency for business-critical applications
• Provision network capacity with minimal
intervention and virtually no learning curve
• Configure and manage multiple switches in the
fabric as a single logical element
• Provide storage-class resiliency with non-
disruptive failover after a path or link failure
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. CONFIDENTIAL 19
NAS iSCSI Flash

Federation Business Data Lake
Fully Engineered Solution
© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. COMPANY PROPRIETARY INFORMATION 20
ISILON ECS DSSD
D A T A L A K E S T O R A G E
F O U N D A T I O N
VNXXTREMIO
D A T A M A N A G E R
D A T A I N D E X I N G E N G I N ED A T A
I N G E S T
E N G I N E S T O R A G E W O R K F L O W S & A U T O M A T I O N
P I V O T A L B I G D A T A S U I T E
A N A L Y T I C S M A N A G E R
A N A L Y T I C S A N D D A T A L A Y E R I N T E R F A C E
A N A L Y T I C S W O R K L O W S & A U T O M A T I O N
V M W A R E V C L O U D S U I T E
P I V O T A L C L O U D F O U N D R Y
D A T A & A N A L Y T I C S
C A T A L O G
A P P S A P P S
Connectrix VDX-6740B

• Multi-Site Secure Solution with CSC
• Fabric Design options
Flexible, Agile & Open

Solution Overview
Key Drivers
• End customer data collection and analysis
• Integrated Applications
• Hadoop, VMware, PostgresDB, Flume
• Open infrastructure
• SAN, Load balancing, Checkpoint, Scale out
network
Design Considerations
• Fabric & IP Overview
• Storage Services
• Management Overview
• Multi-Tenant Deployment
• Futures
Design Options for multi-
multi-tenant growth
• Virtual Fabrics
• L3 VRFs
• Virtual Firewalls
• Virtual Load Balancers
• Storage

SYSTEM INTEGRATOR: DC2SYSTEM INTEGRATOR: DC1
Familiar Design :: Big Data Objective
© 2015 Brocade Communications Systems, Inc. Company Proprietary Information 23
Internet
Secure
MGT Access
175Mb/s
Protected
Internet
Router
Checkpoint 4800
Perimeter Instance
4Mb/s
1Gb/s
User Cell Phone
(Internet
Connected)
CUSTOMER DC
Existing Apps
& Infrastructure
TRUSTED NETWORK
tcServer Farm
Physical/Virtual
Hadoop Farm
Physical/Virtual
SQL Farm
Physical/Virtual
Rabbit/MQ Farm
Physical/Virtual
F5 LTM
Load Balancers
TRUSTED NETWORK
tcServer Farm
Physical/Virtual
Hadoop Farm
Physical/Virtual
SQL Farm
Physical/Virtual
Rabbit/MQ
Farm
Physical/Virtual
F5 LTM
Load Balancers
DMZ
Trusted Network
Segments MGT Network
DMZ
Replication
WAN MPLS
175Mb/s
4Mb/s
1Gb/s
Checkpoint 4800
Protected Internet
Instance
Brocade 6610
Out of Band MGT
Checkpoint 4800
WAN Instance
(FW & UPSEC Tunnel)
Brocade
8770
Core/Agg
Trusted Network
Segments
Checkpoint 4800
WAN Instance
(FW & UPSEC Tunnel)
Brocade
8770
Core/Agg
Checkpoint 4800
Protected
Internet
Instance
Brocade 6610
Out of Band MGT
Protected
Internet
Router
Checkpoint 4800
Perimeter Instance
• Redundant Datacenters
(replication)
• BI in both
• Trusted zones
• Integrated with customer datacenter

Designing for Flexibility
© 2014 Brocade Communications Systems, Inc. CONFIDENTIAL—For Internal Use Only
24

Brocade Data Center Fabrics and Network Virtualization Options
All Built on Brocade VDX Switches and Network Operating System
Architectural Flexibility: DC Fabrics
VDX 6740 VDX 6940 VDX 8770-4 VDX 8770-8
Layer 2 Scale-out: up to 10,000 Servers
VDX VDX
Automatic self forming fabric without
spanning tree.. Topology agnostic with up to
8K virtual fabrics.. Entire fabric managed
from a single IP address.
VDX VDX VDX VDX
Layer 3 Scale-out: up to 500,000 Servers
VDX VDX VDX VDX
VDX VDX VDXVDX
Controller-less Network Virtualization using
industry standard BGP-EVPN, and VxLAN. Includes
ZTP, programmatic APIs.

LEAFSPINE
1 GbE/10 GbE/10 GBASE-T
optimized with 40 GbE uplinks
Brocade VDX Switches
Complete breadth of portfolio
© 2016 BROCADE COMMUNICATIONS SYSTEMS, INC. COMPANY PROPRIETARY INFORMATION
Brocade VDX 6740 Family
• 24MB on chip buffer
• 750 nSec latency
• 25MB on chip buffer
• 750 nSec latency
10 GbE/40 GbE optimized
with 100 GbE uplinks
10 GbE/10 GBASE-T/40 GbE/100
GbE optimized modular system
Brocade VDX 6940-36Q
Brocade VDX 6940-144S
Brocade VDX 6740
Brocade VDX 6740T
Brocade VDX 6740T-1G
SCALABILITY
Brocade VDX 8770-4 Brocade VDX 8770-8
Ultra deep buffers
3.5 uSec latency

Brocade VCS Fabrics Evolve Data Centers
Continual evolution with VCS fabrics
Lower
OpEx
Greater
network utilization
Faster time
to application
deployment
Efficient Automated Cloud-Optimized
• All links fully active
• Multipathing at all layers:
Layers 1, 2, and 3
• IP storage-aware
• Low latency
• Automatic provisioning
• Zero-touch VM discovery, Layer
2/Layer 3 configuration, and
mobility
• Self-forming trunks
• Manage many switches as
a single logical device
• Multitenancy at scale with Brocade
VCS Virtual Fabric and VMware
NSX
• Scale out non-disruptively
• Orchestrated via OpenStack
• DevOps support

33%
33%
33%
Brocade VCS Multipathing at Multiple Layers
Dramatic increases in network utilization and reliability
Feature
Layer 3: Fabric load
balancing across multiple
Layer 3 gateways
Improved scalability
and resiliency
Benefit
Layer 1: Trunking with
frame striping
Near-perfect load
balancing across all links in
a trunk group
Layer 2: Equal Cost
Multi-Path (ECMP)
All links utilized with
flow-based load
balancing
Layer 3 Core
Brocade
VCS
Fabric

Big Data Design Topology
LEAF
COMPUTE
IP Routing Core
Start Small and Scale Out
LAG

LEAF
COMPUTE
IP Routing Core
Start Small and Scale Out
LAG LAG

LEAF
COMPUTE
IP Routing CoreStart Small and Scale Out
LAG LAGLAG LAG
SPINE
Edge services rack

IP/MPLS
Connectivity
Data Center 1
LEF
BGP-EVPN OVERLAY EDGE
LEAF
Data Center 2
LEAF
Data Center3
LEAF
Simplified DCI Solution
• Independent of DC Fabric Underlays
• Extend VLANs between DC or between
fabrics within a DC
• High Performance across the WAN
• Offloads core router processer cycles
Brocade BGP-EVPN Data Center Interconnect (DCI)
Simplified DCI across multi-vendor and multi-fabric underlay networks

Getting more out of the network
• Arizona State University, United States
Innovation & Intelligence

• Improved Operational Efficiency
• Increased Agility / Dynamic Elasticity
• Programmable, Pluggable Architectures
• Low Latency / High Bandwidth / High
Availability
• Hybridized Cloud Model (Software Defined
Datacenter - SDN)
• Improved Time to Research!
Key University Needs

Brocade Flow Optimizer Enables Research Environment Based
on Industry-Leading SDN Capabilities
• SDN to support
high-
performance
research
innovation
• A research
network
environment as
foundation to
attract new
development
opportunities
ASU Needs Brocade Solution
• Complete, scalable HPC
and L2 firewall bypass
solution:
– MLXe, SDN
Controller and Flow
Optimizer
• High Availability and
Resiliency, IPv4, IPv6
and OpenFlow 1.3
• Open networking:
– OpenDayLight
Why Brocade
Brocade
SDN
Controller
Brocade
Flow
Optimizer
sFlow
Inband
Internet 2
100G Connections
ESNet DTN
40G Connection
ASU Campus Network
10G Connections
Fortinet FW
100G Connections
40G
10G
10G
100G
100G
100G
100G
100G
100G MLXeMLXe
MLXe
MLXe MLXe
Science DMZ
L2 FW Bypass
40G
Fortinet FW
40G Connections
http://www.brocade.com/content/dam/common/documents/content-types/success-story/brocade-arizona-state-university-ss.pdf

Innovation &
Intelligence
It’s the information age and research
institutions processing massive
datasets need solutions to move more
efficiently. Selective SDN acceleration
of good flows makes Big Data analytics
possible.
Flexible, Agile,
Open at Scale
Planned users are as important as
planned uses. Data is distributed and
large scale automation may be needed.
Some customers design Open, Scalable
Data Fabrics and develop their own
automation.
Modular
Multipurpose
Lessons learned tell us to plan
the growth, be extensible, and
build for changing needs.
Recap: Data Fabric Case Studies

Benefits of an Agile Data Fabric for Business Intelligence

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Benefits of an Agile Data Fabric for Business Intelligence

Semelhante a Benefits of an Agile Data Fabric for Business Intelligence (20)

Mais de DataWorks Summit/Hadoop Summit

Mais de DataWorks Summit/Hadoop Summit (20)

Último

Último (20)

Benefits of an Agile Data Fabric for Business Intelligence