An introduction to Solinea's goldstone application. Goldstone is a tool that OpenStack cloud operators can use to help see the structure and health of their cloud.

1. Accelerating Adoption of Open Infrastructure
May 2014
Goldstone Overview

2. Copyright 2014 Solinea, Inc.
Solinea at a Glance
CUSTOMERSOVERVIEW
Industry Focus Open Infrastructure, OpenStack
Headquarters San Francisco, CA
Founded January 2013
Geographies Asia, USA
PAST DEPLOYMENTS
TEAM
Major US Telco
US Infrastructure Service Provider
North Asian Telco
Global Electronics Manufacturer
Global Gaming Company
Top 5 Global Automotive Firm
Tier 1 Network Provider
Risk Management Analytics
Easter Europe CSP
OpenStack Distro Provider
Security Analytics Firm
Leading SDN Provider

3. Copyright 2014 Solinea, Inc.
Solinea Services
Conceive Architect Integrate Adopt
Conceive the
cloud strategy
for existing and
new cloud
services to drive
customer
adoption
Architect the
cloud platforms
based on
market demand
and internal
capabilities
Implement the
cloud offerings
and integrate
them into the
existing
infrastructure &
processes
Operate the
cloud, transfer
knowledge,
train the team
and enable
rapid adoption

4. Copyright 2014 Solinea, Inc.
Complexity Reigns in Cloud (not just OpenStack)

5. Copyright 2014 Solinea, Inc.
Same Problems, Different Clouds
• Every cloud Solinea
built needed
operational tools
• Tired of integrating
series of expensive
tools that didn’t exactly
match the need …

6. Copyright 2014 Solinea, Inc.
Cloud Operators Need Tools
Require full FCAPS suite of functionality
Fault
Configuration
Accounting
Performance
Security
Need history to determine normal operations
Troubleshooting is very important

7. Copyright 2014 Solinea, Inc.
Existing OpenStack Tools
Ceilometer
Metering tool
Aimed at
accounting
information of
FCAPS model
No management
No troubleshooting
Horizon
Cloud user focused
No history
Security challenges
No troubleshooting
Synchronous only -
no scheduling of
tasks

8. Copyright 2014 Solinea, Inc.
Common Monitoring Tools
Nagios and Zabbix
Monitoring tool only - no management
capabilities
Scalability issues for larger cloud
Not OpenStack specific - requires significant
customization
Requires agents on each node

9. Copyright 2014 Solinea, Inc.
Areas of Focus
Discover
• Map OpenStack
topology
• Present map
view for
sysadmin
Report
• Display key
metrics specific
to OpenStack
• Alert sysadmin
on abnormalities
Analyze
• Calculate key
indicators
• Provide guidance
on
troubleshooting

11. Copyright 2014 Solinea, Inc.
Manage and Monitor OpenStack
http://gssr.jpl.nasa.gov/index.html
The Goldstone Deep Space Communications Complex
(GDSCC), commonly called the Goldstone Observatory, is
located in the U.S. state of California's Mojave Desert.
Operated for the Jet Propulsion Laboratory, its main purpose
is to track and communicate with space missions.
It is named after Goldstone, California, a nearby gold-mining
ghost town.
(Because everyone asks…)

12. Copyright 2014 Solinea, Inc.
Cross-Product Resource View
• Service resource view
of OpenStack cloud
topology
• Self-discovered and
auto-updating
• Discovers across
availability zones
• Drills down into
individual services

13. Copyright 2014 Solinea, Inc.
Nova Discovery View

14. Copyright 2014 Solinea, Inc.
Cinder Discovery View

15. Copyright 2014 Solinea, Inc.
Detailed Resource Inspection
Popup provides
full details on
the chosen
resource

16. Copyright 2014 Solinea, Inc.
Glance Discovery View

17. Copyright 2014 Solinea, Inc.
Keystone Discovery View

18. Copyright 2014 Solinea, Inc.
Log Viewing, Filtering, and Searching

19. Copyright 2014 Solinea, Inc.
API Performance
• Database keeps
long history of
events
• Analysis to
provide key
performance
metric - API
response time

20. Copyright 2014 Solinea, Inc.
Key Metric Reporting

21. DEMO

22. Copyright 2014 Solinea, Inc.
Goldstone Architecture

23. Copyright 2014 Solinea, Inc.
Anatomy of an OpenStack Message
 Most projects use a similar format
– Date: 2014-05-02 14:10:57.278
– PID: 3609
– Level: INFO
– Prog: oslo.messaging._drivers.impl_qpid
– ID: [-]
– Msg: Connected to AMQP …

24. Copyright 2014 Solinea, Inc.
Shipping via rsyslog (conf.d)
 rsyslog.d/10-goldstone.conf file:
$WorkDirectory /var/lib/rsyslog # where to place spool files
$ActionQueueFileName fwdGoldstone # unique name prefix for spool files
$ActionQueueMaxDiskSpace 1g # 1gb space limit (use as much as possible)
$ActionQueueSaveOnShutdown on # save messages to disk on shutdown
$ActionQueueType LinkedList # run asynchronously
$ActionResumeRetryCount -1 # infinite retries if host is down
local0.* @@10.10.11.122:5514 # nova
local1.* @@10.10.11.122:5514 # glance
local2.* @@10.10.11.122:5514 # neutron
local3.* @@10.10.11.122:5514 # ceilometer
local4.* @@10.10.11.122:5514 # swift
local5.* @@10.10.11.122:5514 # cinder
local6.* @@10.10.11.122:5514 # keystone

25. Copyright 2014 Solinea, Inc.
Logstash Input
input {
tcp {
port => 5514 # matches port that rsyslog ships to
type => syslog # insert a type field to identify this as an incoming message from syslog
}
}

26. Copyright 2014 Solinea, Inc.
Logstash Filtering
filter {
magic_happens_here: {
tokenizing, pattern matching, categorization, transformation, etc.
}
}

27. Copyright 2014 Solinea, Inc.
Logstash Output
output {
elasticsearch {
host => localhost
port => 9200
protocol => http
}
}

28. Copyright 2014 Solinea, Inc.
Result in ES:
photo credit: <a
href="http://www.flickr.com/photos/robbie73/4346732208/">Robbert van der
Steeg</a> via <a href="http://photopin.com">photopin</a> <a
href="http://creativecommons.org/licenses/by-sa/2.0/">cc</a>

29. Copyright 2014 Solinea, Inc.
Goldstone Availability
Currently in early access program
Available free of charge
Sending out batches of installations in weekly
waves for support reasons (installer)
Next batch goes out on June 15th
Tell us about your environment and register:
 http://www.solinea.com/goldstone

30. Copyright 2014 Solinea, Inc.
Goldstone Requirements
Goldstone server
4GB RAM
x64 CPU
CentOS / RHEL 6.5
Network access to OpenStack servers on
management network
Logs need to be forwarded to this server
Requires OpenStack Icehouse

31. Copyright 2014 Solinea, Inc.
Goldstone Roadmap
Regular point release updates during OpenStack
development periods
Releasing version 1 (“Asteroid”) now
Major release to coincide with OpenStack Juno
release in October
Version 2 due at OpenStack Summit Paris
(“Blackhole”)
Concentrating on reporting and analysis features

32. John Stanford, VP Development; john@solinea.com
Ken Pepple, CTO; ken@solinea.com
Thank You