IT systems management has shifted from a manual 1:1 process to focus on 1:1,000’s automated processes. The adoption of Hybrid cloud technologies is driving the future of systems management automation and forcing a shift in the processes and methods of systems management. This is why Dell is meeting this challenge with Dell PowerEdge Embedded RESTful API and DMTF Redfish standard support. In this session, we will outline the evolving IT landscape and its implications on systems management and present a future vision for automation that helps address emerging market needs driven by hybrid cloud adoption and web-scale operations.
MT135_Simplifying web-scale systems management with the Dell PowerEdge Embedded RESTful Interface
1. Simplifying web-scale systems management with
the Dell PowerEdge Embedded RESTful Interface
Paul Rubin
Senior Product Manager
Dell EMC Systems Management Marketing
2. 2
Today’s IT operations challenges
Organization
• On-demand,elastic services
• Agility to meetchanging objectives
• BimodalIT – Traditional and Exploratory
Typically less concerned with…
• Security
• On-going support
• IT costs
IT Operations
• Provisioning, deployment,updates and
management of infrastructure
• Competitionwith shadow IT
Often challenged with…
• Focus on legacy systems
• Meeting control and governance objectives
• Time-to-production
3. 3
And if you need to achieve “Web-Scale”?
Open Standards Infrastructure
Automation and Auto-Remediation
Predictive Analytics
The typical ratio of
administrator to server in
web-scale environments is
1:20,000* and growing
*Data Center Knowledge, Facebook Ops:
Each Staffer Manages 20,000 Servers,
November 20, 2013
SPEED Breaks Software
SCALE Breaks Hardware
Adding Agility and Scalability leads to…
SPEED at SCALE
Breaks Everything!!
Adrian Cockroft, Technical Fellow, Battery
Ventures, formerly Cloud Architect at Netflix
4. 4
System Management Vision for Future-Ready Enterprises
Data Center
Virtualization and
Hybrid Cloud
Extensibility
CapEx
Reduction
Infrastructure
DeliveryAutomation
Reduced
Delivery Time
Streamlined and
Automated Data
Center Operations
OpEx
Reduction
Business
Mobility
Anywhere
Deployment
Security Controls
Native to
Infrastructure
Improved Security
to Effort Ratio
High Availability
and Resilient
Infrastructure
Improved
Uptime
5. 5
The systems management automation journey
1990’s
Proprietary Era
2000’s
Early Standards Age
2010’s->
Next-gen Standards Age
Functions
Automation
technologies
Predominate
management
interfaces
Inventory
and monitor
Inventory, monitor, and
server control
Inventory, Monitor, Server Control,
Configuration, and Update
Proprietary command
line interfaces
Integration with
network managers
IPMI,
Common Information Model,
WS-Man and Wbem
Integration with OS and ISV
system management consoles
DMTF Redfish and
OEM RESTful API’s
Integration with open source and
ISV orchestration / automation
solutions
Vendor CLIs
SNMP
IPMI API
Vendor CLIs
Vendor SOAP APIs
Redfish API
Vendor REST APIs
Vendor CLIs
6. 6
Introducing – Redfish, a new systems management
standard for an evolving IT environment
DMTF Scalable Platform Management Forum has created
an open industry standard specificationand schema for
simple, modern, and secure management of scalable
platform hardware
A secure, multi-node, RESTful management interface built
upon HTTPS in JSON format based upon OData v4
Schema-based but human-readable; usable by client
applications and browser-based GUIs
Covers key use cases and customer requirements
7. 7
What can you do with Redfish?
Provides a common interface across
platforms and vendors supporting:
Reset, reboot, and power control servers
Inventory server hardware and firmware versions
Monitor health status of server
Access system logs
Alert on server health status changes
8. 8
PowerEdge iDRAC with Lifecycle Controller
Embedded, agent-free enablement for PowerEdge server management automation
GUI
HTTPS
SSL
Active Directory
LDAP
SmartCard
CLI
APIs
IPMI
SNMP
WS-MAN
REST - Redfish
Access
Points
Security
Methods
Key Functions
9. 9
PowerEdge embedded RESTful API overview
Uniting Redfish with PowerEdge REST
PowerEdge RESTful API enables modern, secure, scalable
management automation
Conformant with Redfish v1.0.2
PowerEdge REST API extensions
– RESTful server configuration
– Detailed inventory and health status of server storage – controllers,
enclosures and drives - and network interfaces
– Chassis-level health monitoring for PowerEdge FX2 Modular
Infrastructure
10. 10
PowerEdge embedded RESTful API overview
Modern tools for management automation
Server inventory with Python scripting
importrequests
importjson
system = requests.get('https://<iDRAC
IP>/redfish/v1/Systems/System.Embedded.1',verify=False,auth=('root','calvin'))
storage = requests.get('https://<iDRAC
IP>/redfish/v1/Systems/System.Embedded.1/Storage/Controllers/RAID.Integrated.1-
1',verify=False,auth=('root','calvin'))
systemData = system.json()
storageData = storage.json()
print "Model: {}".format(systemData[u'Model'])
print "Manufacturer: {}".format(systemData[u'Manufacturer'])
print "Service tag {}".format(systemData[u'SKU'])
print "Serial number: {}".format(systemData[u'SerialNumber'])
print "Hostname: {}".format(systemData[u'HostName'])
print "Power state: {}".format(systemData[u'PowerState'])
print "Asset tag:
{}".format(systemData[u'AssetTag'])
print "Memory size:
{}".format(systemData[u'MemorySummary'][u'TotalSystemMemoryGiB'])
print "CPU type: {}".format(systemData[u'ProcessorSummary'][u'Model'])
print "Number of CPUs: {}".format(systemData[u'ProcessorSummary'][u'Count'])
print "System status: {}".format(systemData[u'Status'][u'Health'])
print "RAID health: {}".format(storageData[u'Status'][u'Health'])
Server storage health status via Postman plug-in
11. 11
PowerEdge Embedded REST API
RESTful Server Configuration
REST API supports templated server configuration
with Server Configuration Profile (SCP) operations
SCP files describe all settings for PowerEdge
components, enabling complete configuration with
single API call
– RESTful configuration of BIOS, iDRAC, PERC RAID
controllers, Ethernet and Fibre Channel adapters
API provides for export, preview and import
operations for replication of existing or creating
customized server configurations
SCP
Target server Management station
File share server
Management
network
SCP
12. 12
PowerEdge Embedded REST API
RESTful management with open source Redfishtool CLI
Redfishtool: open-source Python tool published by DMTF; available @ https://github.com/DMTF/Redfishtool
Easy-to-use command line, handles hypermedia and unique aspects of Redfish RESTful API
Examples
$ redfishtool -r<ip> Systems -I <id> reset <resetType> # Manage server power and reset control
$ redfishtool -r<ip> Systems -I<Id> Processors # Inventory server processors
$ redfishtool -r<ip> Chassis -I<Id> Thermal # Get server thermal status
$ redfishtool -r<ip> AccountService adduser john 12345 Admin # Manage iDRAC user accounts
COMING SOON - executables such as “redfishtool.exe” for Windows and versions for leading Linux distros
13. 13
DevOps automation with REST APIs
Benefits
Fast, reliable, and repeatable outcome
On-demand runtime environment creation
Consistent environment for staging and production
Automated provisioning
PowerEdge hardware settings
PowerEdge firmware
Operating Systems and drivers
OS-based agents and applications
Deployment approach
“Infrastructure as a Code”
Bottom-to-top version control covering code,
configuration, and data
Aligns development and operations
iDRAC with LC REST
APIs / Scripts
Server
Configuration
Profile
Version controlServer
template
Ansible Playbook
Provisioning Plays Update Plays
Staging Environment Production EnvironmentReference Server
Component
Settings
BIOS
RAID
NIC
iDRAC
iDRAC with LC REST
APIs / Scripts
ImportSCP
iDRAC with LC REST
APIs / Scripts
Illustrative only
Chef, Puppet,Salt…
14. 14
What’s coming next for Redfish?
Dell and the SPMF driving development of Redfish
with significant additions planned
Redfish standards planned include
– BIOS configuration
– Firmware update
– Secure boot configuration
– Detailed inventory and health status monitoring
for storage, memory and NIC/HBAs
15. 15
A future vision of management automation
REST APIs such as Redfish are just the beginning…
– “Swordfish” extends Redfish concept to shared storage
– Network switching REST API
– Environmental REST APIs for power and HVAC
Management automation AI via “Big Data”
– Current x86 servers produce 1000’s of data points
– As data center instrumentation standardizes, management
data grows to millions of data points
– Big data science coupled with AI can deliver actionable
information to optimize physical and virtual component
operations
16. 16
How many of you…
Currently use APIs or CLIs to automate server management?
Currently / plan to use RESTful APIs to manage server hardware?
– If not, will you use other APIs or CLIs for management automation?
What is your preferred scripting language for RESTful server management?
– PowerShell? Python? Ruby? Go? Other?
Currently / plan to use Orchestration and Automation (O&A) solutions to
configure server hardware?
– Ansible? Chef? Puppet? Salt? Other?
Is there need for server-local support for RESTful API via a CLI tool such as
Redfishtool?
17. 17
PowerEdge Embedded REST
Summary
REST APIs enabling web-scale automation
aligned to emerging tools and processes
Dell and SPMF driving development of Redfish
with significant additions planned
Dell is committed to meeting our customers’ needs
for management automation through open,
industry standards
18. 18
PowerEdge Embedded REST
Developer Resources
• DMTF Redfish specification
http://www.dmtf.org/sites/default/files/standards/documents/DSP0266_1.0.1.pdf
• Dell PowerEdge Redfish API Reference Guide - http://topics-cdn.dell.com/pdf/idrac7-8-lifecycle-
controller-v2.30.30.30_reference%20guide2_en-us.pdf
• Introducing the Dell PowerEdge Redfish API white paper
http://en.community.dell.com/techcenter/extras/m/white_papers/20442330
• Advanced REST Client for Google Chrome
https://chrome.google.com/webstore/detail/advanced-rest-
client/hgmloofddffdnphfgcellkdfbfbjeloo
• Postman REST Client for Google Chrome
https://chrome.google.com/webstore/detail/postman/fhbjgbiflinjbdggehcddcbncdddomop
• cURL command line interface - https://curl.haxx.se/
• Python “requests” library - http://docs.python-requests.org/en/master/
20. 20
The rise of REST APIs
• Representational State Transfer (REST) has
become the leading architecture for APIs
• Why is REST the winning method for APIs?
– Two words: “mobile apps” - bandwidth efficient,
lower processing overhead
– Easier to learn, aligned to web technologies
• What’s driving demand for REST?
– REST fits with DevOps tools and processes,
hybrid cloud and virtualization automation
– More enablement choices: open source utilities,
browser plug-ins, and scripting support
Source: programmablew eb.com, 2014
21. 21
Redfish enabling technologies
• HTTP/HTTPS communications: the Redfish API is accessed using this well-known and highly
secure interface. Individual management objects addressed as Universal Resource Identifiers (URIs)
• RESTful API: management objects read and written using REpresentational State Transfer (REST)
approach with standard HTTP “verbs” such as GET, POST and PATCH. RESTful APIs are a
preferred approach for IT automation
• JSON data representation: Java Script Notation (JSON) is a lightweight data interchange format
designed to be human readable and writeable. JSON uses computer language conventions well
known to IT developers
• OData data exchange protocol: created by Microsoft and standardized by the OASIS standards
body, OData enables standardization of data formats for the management data objects
• These technologies were chosen to support the needs for simple, scalable, and secure server
management that fits well with modern IT developers’ tools and processes
22. 22
Standard Redfish specifications and schemas
• BMC infrastructure
– View / configure BMC network settings
– Manage local BMC user accounts
• Discovery
– System topology – rack/chassis/server/node
• Inventory
– Basic server identification and asset info
– Simple storage - HDD/SSD
– Host NIC addresses
• Core server actions
– Reboot / power cycle server
– Change boot order / device
– Set power thresholds
• Monitoring
– Health state
– Temperature sensors and fans
– Power supplies, consumption and thresholds
– Event notification
• Access and logging
– Session-based secure access with HTTPS
– Serial console access via SSH
– Logging methods
23. 23
PowerEdge Embedded REST API
Dell unique capabilities
• PowerEdge Server Configuration Profile support for server configuration
• Metadata URL providing XML-formatted description of resources and collections available
• Information on all iDRAC out-of-band services – web server, SNMP, vMedia, SSH, Telnet, IPMI
and KVM
• Configuration of boot source using UEFI boot path
• UEFI Device path for storage and network devices
• With Dell iSM installed: detailed reporting of LOMs, NICs and network interface details
including IP address, subnet mask, and gateway for the Host OS
• Expanded storage subsystem reporting covering controllers, enclosures and drives
• PowerEdge FX2: Detailed chassis information covering power supplies, temperatures, and fans