Product of the Month sessie 17 april. VNX Monitoring en Reporting

1. 1© Copyright 2013 EMC Corporation. All rights reserved.
EMC Storage Resource
Management Suite
Technical Review
Tim Piqueur

2. 2© Copyright 2013 EMC Corporation. All rights reserved.
The Challenge
Over the next decade…
– Data managed by enterprise
datacenters will grow 50x
– Number of files will grow by
75x
– Number of IT professionals
will grow < 1.5x
Optimizing storage resources is
essential to controlling IT costs
Investments in Storage
Resource Management help
reduce these costs
Rapid data growth leads to rising
storage costs while $/GB declines
Source: IDC Digital Universe Study, June 2011

3. 3© Copyright 2013 EMC Corporation. All rights reserved.
What’s the impact on YOUR business?
The Impact of Application Downtime

4. 4© Copyright 2013 EMC Corporation. All rights reserved.
What if you could…
Understand ALL storage relationships,
dependencies and application impact?
Assure storage-related Service Levels
and Chargeback?
Optimize storage investments to
control costs and improve productivity?

5. 5© Copyright 2013 EMC Corporation. All rights reserved.
Storage Resource Management Suite
EMC Storage Resource Management Suite
Configuration
& Compliance
Configuration
& Compliance
PerformancePerformance CapacityCapacity
Relationship
Mapping
Relationship
Mapping
EMC
Storage
Hosts
Brocade & Cisco
Switches
3rd Party
Storage
Planning
Scorecards
Role-based Reporting
Troubleshooting
SLA
Situations to Watch
Resource / Usage
Virtual
Machines
AlertingAlerting
Applications
TopologyTopology
Represents capabilities of the entire Storage Resource Management suite.

6. 6© Copyright 2013 EMC Corporation. All rights reserved.
What’s Included in the SRM Suite?
EMC ProSphere – Displays data path relationships and
dependencies and analyzes performance and capacity to
optimize storage resources.
EMC Storage Configuration Advisor – Tracks
configuration changes and validates compliance with
design best practices and the EMC Support Matrix to
eliminate configuration errors that impact service levels
EMC Watch4net for Storage – Monitors application
health and performance and provides dashboards to
monitor the application to storage service levels across
heterogeneous storage environments

7. 7© Copyright 2013 EMC Corporation. All rights reserved.
Storage Resource Management Suite
• EMC & Third-Party Storage
– Symmetrix
– VNX Block & File
– Isilon
– VPLEX
– NetApp Filers
– IBM SVC & DS
– Hewlett Packard
• Data Path
– VMware
– HP-UX
– IBM AIX
– Linux SUSE & RHEL
– Microsoft Windows
– Sun Solaris
SAN Switches
– Cisco
– Brocade
– McDATA
Applications
– Oracle
– Microsoft SQL Server*
– MySQL*
– IBM DB2*
(*) Additional licenses required for application support
Supported Environments
Support specific details

8. 8© Copyright 2013 EMC Corporation. All rights reserved.
Solution Enabler (SE) 7.4
SMIS 4.4
NaviSecCLI 7.3
SRM 1.1 Suite Architecture
vApp
ProSphere 1.7
SuSE 11 ES
Virtual Machine
SCA 3.0
rPath 4
Application
W4N 6.1
Windows SuSE 11ES
MySQLSybase 10Greenplum 4
Collection | Aggregation | Enrichment
W4N utilizes object polling mechanism marked with (*) for Symmetrix, VNX Block, SAN and Windows Hosts
Data Storage
SE* SMIS
NaviSecCLI*
SMIS
SSH
XMLAPI
SNMP SMIS
SNMP*
SMIS
SSH SSH
Sudo
SNMP
PowerShell*
WinRM* SNMP*
WMI WS-Man
VISDK JDBC …
Symmetrix VNX Block VNX File NetApp Filer
IBM DS
IBM SVC
SAN
(Cisco,
Brocade)
Unix Hosts Windows Hosts VMware Oracle
Other
Optional
Apps
Install on W4N Host

9. 9© Copyright 2013 EMC Corporation. All rights reserved.
System Requirements
Total resource for SRM Suite – full scale
– 32 Virtual CPU (vCPU)
– 108 GB of memory (vMemory)
– 1.3 TB starting to 2.5 TB storage for data retention of 1 year
Components
vApp
Storage
Manager
vApp
Discovery
Engine
vApp
Historical DB
Collector
Each
CPU
4
3.0 Ghz
4
3.0 Ghz
4
3.0 Ghz
2
3.0 Ghz
Memory 12 GB 8 GB 6 GB 6 GB
Storage 230 GB 30 GB 230 GB 30 GB
ProSphere SCA W4N
Virtual
Machine
4
3.0 Ghz
16 GB
50 GB
W4N
UI Portal
W4N SuSE/Win
Host #2 & more
4
3.0 Ghz
4
3.0 Ghz
16 GB 8GB
500 GB 64 GB

10. 10© Copyright 2013 EMC Corporation. All rights reserved.
Scalability
Solution
Physical Hosts/
Host Devices
ESX
Servers
Virtual
Machine
EMC Arrays/
# of LUNs
3rd Party
Arrays
NetApp
Filer
SAN
Switches
SAN Ports Databases
ProSphere 1.7
With 4 Collectors
2500/161k 125 2500 63/275k n/a n/a 113 8192 n/a
SCA 3.0
(Virtual Machine)
800/136k 800 40/68k n/a # of 8192 SAN Ports n/a
W4Net 6.1
(2-3 W4n Hosts)
2500 hosts 125 2500 63 arrays 30 30 113 8192 400

11. 11© Copyright 2013 EMC Corporation. All rights reserved.
Watch4Net Logical Architecture
Collector
• Periodically starts collection
• Connects to remote systems to collect
• Filter/enrich data
• Formats data for backend
Backend
Collector3rd
Party
Array
Infrastructure
Backend
• Processes data from collection
• Computes aggregates
• Database maintainer
Web Portal
• User login
• Admin management
• Generate and browse reports
Database
• Storage for Data
• Storage for metric properties
Retrieve
Send
Polled

12. 12© Copyright 2013 EMC Corporation. All rights reserved.
Pick your client language and destination platform/application
of choice, for example…
ProSphere Open Architecture
Open via REST
• HTTP-based, Stateless and
Information transferred in XML
• Fully documented and supported
• Exposes all information visible
through UI
• Based on EMC standards
• Hides details and differences in
internal ProSphere persistence
• Can be used for a truly headless
solutionHistorical DatabaseHistorical DatabasePro ApplicationPro Application Discovery EngineDiscovery Engine
RDFRS RS RS
REST Services
HTTP:// POST, PUT, DELETE
(future)
GET

13. 13© Copyright 2013 EMC Corporation. All rights reserved.
Policy A
Policy B
Policy
B
Policy
A
Rules
Rules
Rules
Rules
Rules
Access Profile
Storage Environments Discovery Policies Repository Data & Dependencies Configuration Policies
Administrative web-based
interface
Access Profile
Access Profile
Access Profile
Access Profile
Discovery Changes Storage
Storage Configuration Advisor Architecture

14. 14© Copyright 2013 EMC Corporation. All rights reserved.
Relationships, Dependencies & Impact
• Dynamic reporting of ALL resources and
performance dependencies
RECEIVE REAL-TIME UPDATES
• Trending and threshold notifications correlated with
storage metrics
ANALYZE APPLICATION PERFORMANCE
• Visualize all physical and virtual relationships from
application to host and from host through storage
UNDERSTAND INTERDEPENDENCIES

15. 15© Copyright 2013 EMC Corporation. All rights reserved.
Application – Storage Interdependencies
• Understand relationships and
topology end-to-end across all
layers
– Storage & Fabric
– Virtual Machine & Datastore
– App & Database
• Analyze infrastructure with a
view into:
– Performance
– Availability
– Configuration
END-TO-ENDANALYSIS

16. 16© Copyright 2013 EMC Corporation. All rights reserved.
Analyze Application Storage Related Issues
• Overview of Oracle
application and infrastructure
uptime
– Drill into application for details
and status
• Additional application report
packs available:
– Microsoft SQL Server
– MySQL
– IBM DB2
– Websphere

17. 17© Copyright 2013 EMC Corporation. All rights reserved.
Analyze Application Storage Related Issues
• Examine application hosts
– Datastore Usage
– Disk Rate
– CPU Usage
– Memory
• Identify application host
to investigate further
– Data path
– Configuration policy
– Virtual to Physical host

18. 18© Copyright 2013 EMC Corporation. All rights reserved.
View End-to-End Topology for EMC Storage

19. 19© Copyright 2013 EMC Corporation. All rights reserved.
Analyze Data Path & Configuration Policies
View host to storage
topology details for EMC
storage
Enable analysis of host
performance issues
Investigate configuration
policies to determine
compliance

20. 20© Copyright 2013 EMC Corporation. All rights reserved.
vCenter Servers Arrays
EMC Professional Services Can Assist to Design Your Custom Reports
Unified SLA Reports From Heterogeneous Sources
One pane of glassOne pane of glass
Host Unification (Physical Windows/Unix, Virtual)Host Unification (Physical Windows/Unix, Virtual)
Allocated
Storage
Allocated
Storage
Capacity MetricsCapacity Metrics Performance MetricsPerformance Metrics

21. 21© Copyright 2013 EMC Corporation. All rights reserved.
Launch to Element Managers for Remediation
• Launch in context to:
– Symmetrix Management
Console (SMC)
– Symmetrix Performance
Analyzer (SPA)
– Unisphere for VMAX
– Unisphere (for VNX)
– Brocade Top Talkers
• Real-time investigation
unique to the element
– Active commands and
detail information
Symmetrix Management Console
Symmetrix Performance Analyzer
Unisphere for VMAX

22. 22© Copyright 2013 EMC Corporation. All rights reserved.
Assure Storage SLAs & Chargeback
• Custom thresholds and dashboards across
heterogeneous storage environments
IDENTIFY SLA ISSUES
• Automatically, using the EMC Support Matrix and
your own design best practices
VALIDATE CONFIGURATIONS
• See the impact of FAST on performance and
chargeback based on policy
OPTIMIZE USE OF FAST VP

23. 23© Copyright 2013 EMC Corporation. All rights reserved.
Performance and SLA Monitoring
Historical, real-time views, trending, and forecasting
Correlation between performance metrics & events
Performance analytics, with adaptive alerting

24. 24© Copyright 2013 EMC Corporation. All rights reserved.
Identify SLA Issues
Identify SLAs at risk
Identify SLA issues requiring
immediate investigation

25. 25© Copyright 2013 EMC Corporation. All rights reserved.
Validate Storage Configurations
Determine if SLA issue is due
to a configuration issue

26. 26© Copyright 2013 EMC Corporation. All rights reserved.
Identify Configuration Compliance Issues
SLA issue is due to a
path problem. Defined
policy calls for 2 paths.

27. 27© Copyright 2013 EMC Corporation. All rights reserved.
Array #2Array #1
Identify True Cost of Application Storage
Primary
volume
Local
copy
Remote
copySnapshots
Local
copy Mapped/masked
to backup server
Copy for testing new
version of application
Mapped to Dev server
DR Copy. May or
may not be
mapped to a DR
server
Application
Cluster
Backup
Server
Dev/Test
Server
Total Charge Should Include All This Capacity
Primary
volume
Local
copy
Remote
copySnapshots
Local
copy
Map storage to Service
Levels based on FAST
policy, etc.
Understand storage to
host relationships,
including clusters, etc.
Need to handle copies
correctly – should be
charged to application
server, not backup
server

28. 28© Copyright 2013 EMC Corporation. All rights reserved.
Analyze Storage Usage for Chargeback
EMC
NetApp
IBM

29. 29© Copyright 2013 EMC Corporation. All rights reserved.
Optimize Resources & Productivity
• Analyze capacity trends with visibility of all replicas
IMPROVE CAPACITY PLANNING
• Analyze application performance with storage
workload trends to select best storage tier
IDENTIFY APPROPRIATE TIER OF STORAGE
• Through anywhere, any-device access to
comprehensive analysis
ENHANCE PRODUCTIVITY

30. 30© Copyright 2013 EMC Corporation. All rights reserved.
Assure Storage SLAs
Service Level Utilization
Service Levels
Service Level storage details

31. 31© Copyright 2013 EMC Corporation. All rights reserved.
Monitor Federated Tiered Storage
Encapsulated and
Externally Provisioned
volumes in use
Unused Externally
Provisioned volumes
Federated Tiered Storage capacity per array

32. 32© Copyright 2013 EMC Corporation. All rights reserved.
Improve Capacity Planning
Show capacity used by purpose
Pools are close to
running out of space

33. 33© Copyright 2013 EMC Corporation. All rights reserved.
Identify Capacity Issues
Only 6 weeks to “Pool Full”
Identify what type of
storage to add
Time to order more 15K
drives for Hopkinton

34. 34© Copyright 2013 EMC Corporation. All rights reserved.
Enhance Productivity
Anywhere, Any-Device Access to Comprehensive Analysis
Access reports on the go!