The document discusses the importance of monitoring systems to prevent outages and reduce the time it takes to discover problems. It recommends immediately backing up databases and monitoring all backups to prevent data loss from future issues. Over time, the infrastructure should be developed using a monitoring-driven approach where monitors iterate the infrastructure and drive infrastructure work to match needs before issues occur. This helps ensure problems are addressed proactively rather than feeling it is always "just too late".

1. Just Too Late
Jeremy Katz
@katzj

3. Developer Operations

4. http://www.flickr.com/photos/adam_holloway/324330048/

5. http://www.flickr.com/photos/7969902@N07/510672745/

6. Post-Mortem
Why? Why?
Why? Why?
Why?

7. Reduce Time
To Discover
Problems
http://www.flickr.com/photos/wwarby/3296379139/

8. Immediate Fixes

9. EBS Outage
Oops, no
backups for
one server
http://www.flickr.com/photos/pargon/2444128581/

10. Backup the database
Monitor the backup
Monitor all the backups
http://www.flickr.com/photos/8669065@N06/2262078872/

11. Backup the database
Monitor the backup
Monitor all the backups
Backup all the databases
Automate for future!
http://www.flickr.com/photos/8669065@N06/2262078872/

12. Monitoring
Driven
Infrastructure
Development
http://www.flickr.com/photos/caveman_92223/3346906435/

13. http://www.flickr.com/photos/epublicist/3546059144/

14. ≈
MDID
TDD

16. http://www.flickr.com/photos/machinemade/5089297557/

17. Create monitors
Iterate infrastructure to match
http://www.flickr.com/photos/rpmarks/4503154179/

18. It’s like we have a team
doing all of this
infrastructure work just in
time for when we need it!

19. More like it’s
just too late!

20. Thanks
! Let monitors drive infrastructure work
! Stop feeling like it’s “Just Too Late”
! http://dev.hubspot.com
! @hubspotdev