A mid-cycle review of ceilometer for Juno

1. Eoghan Glynn1
Ceilometer:
Juno at the halfway point
Eoghan Glynn
eglynn@redhat.com

2. Eoghan Glynn2
Agenda
● Top-level themes for Juno
● Changes in “how we do things” upstream
● Detailed work items

3. Eoghan Glynn3
Top-level themes for Juno
● Address TC-mandated requirements from gap analysis
● Pay-down known architectural debt
● Adopt some new processes upstream
● Stretch goal: figure out relationship with Monasca &
Stacktach

4. Eoghan Glynn4
TC-mandated requirements from gap analysis
● Word-smith the project mission statement
● https://review.openstack.org/87526
● Viable sql-alchemy driver in the gate
● required by distro issues and mongo licensing concerns
● Land stalled Tempest coverage
● complicated by branchless Tempest
● Enhance user & ops oriented documentation
● re-purpose RDO Getting Started guide
● Participate in grenade upgrade test harness
● stretch: extend Javelin resource survivability assertions

5. Eoghan Glynn5
Pay-down architectural debt
● Snapshot'ing of resource-metadata per datapoint now
recognized as a major early misstep
● Leads to write & query inefficiencies in the metering
store for little benefit
● Solution is to re-imagine ceilometer as more like a
Time-Series-Data-as-a-Service
● prototyped in stackforge/gnocchi project
● sample data shorn of resource metadata
● eager pre-aggregation & rollup
● resource state timeline reconstructed from events
● Gnarly migration issues remain to be worked out

6. Eoghan Glynn6
Changes in upstream team dynamic
● Collaborative decision-making within core team
● Adoption of ceilometer-specs repo for BP review
● FPF for juno-3 versus down-to-the-wire
● Mid-cycle meetup to ensure momentum
● Direct engagement with QA team
● More proactive BP-to-resource matchmaking

7. Eoghan Glynn7
Detailed work items
● TSDaaS
● canonical implementation against pandas+swift
● additional drivers e.g. using InfluxDB
● integration with metrics pipeline and alarm evaluation
● work of OPW intern re-based on this
● Sql-alchemy viability
● removal of v1 API support
● rationalization of schema, selective denormalization
● simplification of upsert/retry-on-rollback logic
● input from sqlalchemy author Mike Bayer

8. Eoghan Glynn8
Detailed work items
● SNMP improvements
● declarative pollsters
● reduce chattiness with snmpd
● Central agent SpoF
● tooz for coordination, possibly taskflow for workload
partitioning
● similarly for partitioned alarm evaluator
● Events completion
● support in mongo and hbase drivers
● assumes additional importance with advent of TSDaaS

9. Eoghan Glynn9
Detailed work items
● QA
● beef up Tempest & Grenade coverage
● backporting conumdrum with branchless Tempest
● IPMI sensor data
● agreed at summit that Ironic will “own the polling cycle”,
emitting notifications for ceilometer to consume
● Miscellaneous
● network services metering: (LB|FW|VPN)aaS
● arithmetic transformer to combine samples across
multiple meters
● eventlet deprecation, replacement by asyncio/trollius?