DevOps Powered by Splunk
•
11 gostaram•5,033 visualizações
DevOps is powering the computing environments of tomorrow. When properly configured, the Splunk platform allows us to gain real-time visibility into the velocity, quality, and business impact of DevOps-driven application delivery across all roles, departments, process, and systems. Splunk can be used by DevOps practitioners to provide continuous integration/deployment and the real-time feedback to help the organization with their operational intelligence. Join us for a exciting talk about Splunk’s current approach to DevOps, and for examples of how Splunk is being used by customers today to transform DevOps initiatives.
Recomendados
Mais conteúdo relacionado
Mais procurados
Mais procurados (20)
Destaque
Destaque (9)
Semelhante a DevOps Powered by Splunk
Semelhante a DevOps Powered by Splunk (20)
Mais de Splunk
Mais de Splunk (20)
Último
Último (20)
DevOps Powered by Splunk
- 1. Devops Powered by Splunk Domnick Eger – Devops SME Majors Southwest #domeger
- 2. 2 2
- 3. 3
- 4. 4 4
- 5. 5 DevOps Workflow Is Complex 5 Build (Jenkins, Bamboo) Code (Git, MS-TFS) Plan (JIRA, Rally) Test/QA (Cucumber, SonarQube) Stage (Pivotal, AWS) Release (Jenkins, Octopus) Datacenter Device Data Engagement Data Config (Puppet, Ansible) Monitor (New Relic, Dynatrace) Cloud Services Network Services www/HTTP Data Social Sentiment Wire Data Application Data Continuous Integration (CI)/Continuous Delivery (CD) Site Reliability Engineering Business Impact Monitoring API ServicesSecurity/Compliance
- 6. 6 6 Application Development Testing and Artifact Collection Production Feedback Services Regression Testing Constraint Analysis Data Mining Requirements Code Development Build Environment Integration / DeploymentCode ReviewTesting and Artifacts Data Model Predictive AnalyticsAnalytics Store Enhanced Search Development & Operational Intelligence
- 7. 7 7 API SDKs UI Other Tools Escalation/ Collaboration No rigid schemas – add in data from any other source. Visibility Across the Dev Lifecycle Plan Code Build Test/QA Stage Release Config Monitor
- 8. 8 8 API SDKs UI Server, Storage. N/W Server Virtualization Operating Systems Infrastructure Applications Mobile Applications Cloud Services Other Tools Ticketing/Help Desk No rigid schemas – add in data from any other source. Custom Applications Visibility Across the Ops Environment API Services
- 9. 9 9 Continuous Feedback and Delivery Production Artifact Repo Developer Repository Build Automation Cloud Collaboration QA Automation Isolated Enviroment IT OPS Splunk 360 Degree of Visibility, Velocity and Versioning
- 10. 10 Devops Teams at Work 1 DEVELOPERS QA OPERATIONSPROJECT MANAGEMENT Manage Tag / Release Process Disparate Build Servers Deploy after Different Team Review Process Maintain Branch Builds Manual Deployments Environment Flavors Deployment Testing for Pre- Production Testing and Performance Determining Business Impact and Change Operations Building Epics and Setting Stories Direct and lead teams to build successful deployments Manual / Automation Deployment Idiosyncrasies of Each Application by Iterations. Stability and Scaling Platforms
- 11. 11 Application Development Testing and Artifact Collection Production App Dynamics Servicenow BSM ALM VersionOne GitHub Enterprise Jenkins Build Server RunDeckVersionOneSonarQube Artifacts BUILD TEST RUN 1 2 3 4 5 6 Application Dynamics ServiceNow HP BSM HP ALM 78910 Example Use Cases
- 12. 12 Developer Values – Operational Values – Application Development - Use Cases Breakdown Use Cases # 1 Availability of Application Use Cases # 2 Systematic Availability Use Cases # 3 Delivery Health Score Use Cases # 4 Data Quality Scoring Use Cases # 5 System Metrics KPI Use Cases # 6 Code Coverage Vs Sprints Vs Technical Debt Use Cases # 7 Built Time Vs Technical Debt Use Cases # 8 Test Coverage Vs Defects in QA Use Cases # 9 Development Activities Vs Velocity Use Cases # 10 Sprints Vs Defects
- 13. 13 Application Development Testing and Artifact Collection Production APM Change Management ITOA Documentation Atlassian Jira Atlassian Bitbucket Bamboo Bamboo / SaltStackSonarQube Artifacts BUILD TEST RUN 1 2 3 4 5 6 ZipKin ServiceNow 78910 IT Service Intelligence Atlassian Confluence Example Use Cases Atlassian Jira
- 14. 14 Developer Values – Operational Values – Use Cases # 1 Time to Production Use Cases # 2 Deployment Analytics Use Cases # 3 Health of Deployment Use Cases # 4 Application Availability Use Cases # 5 CT to FTE Developer Use Cases # 6 Automation Test Coverage Use Cases # 7 Bamboo Agent Health Use Cases # 8 Release Cycles & Hours per Project Use Cases # 9 Salt Stack Deployment Monitoring Use Cases # 10 Release Management & Version Control Automation & Deployment - Use Cases Breakdown
- 15. 15 Application Development Unit Testing Code Quality & Analysis Metrics & Monitoring APM Automation Tests Deployment Team Foundation Server Team City BUILD TEST QA 1 4 5 6 Solarwinds Selenium Octopus 78910 Continuous Build Pipeline 2 3 Dynatrace SPLUNK PLATFORM Jasmine Tibco Custom Veracode NDepend
- 16. 16 Developer Values Operational Values Application Lifecycle Management – LBL Financials Use Cases # 1 Build Pipeline Build, Test, Run Use Cases # 2 Monitor & Adapt to Releases Cycles Use Cases # 3 Release & Builds Management Use Cases # 4 Single Pane of Glass (Cloud, Hybrid) Use Cases # 5 Predictive Alerts and Response Use Cases # 6 Deployment Frequency to Velocity of Code Changes Use Cases # 7 Lead-Time and Reaction to Business Needs Use Cases # 8 Failure Rates Compared to Sprints Use Cases # 9 Backlogs Management & Resource Allocation Use Cases # 10 CI / CD End to End Glass View
- 17. 17 Devops Transformation with Splunk 1 Test Build Code Educate, Communicate and Build Cross Skills by leveraging Splunk as a Platform Evaluate and Rebuild Services with Full Visibility and Understanding Understand your data to predictively find problems before they happen. Change you Application and not your Data. “Scheme on the Fly”
- 18. Show and Tell
- 19. 19 Successful Businesses use Splunk for DevOps 1
- 20. 20 curl -k https://<host>:8088/services/collector -H 'Authorization: Splunk <token>' -d '{"event":"Hello Event Collector"}' Applications IoT Devices Agentless, direct data onboarding via a standard API HTTP Event Collector – Fast Insights for DevOps Scales to Millions of Events/Second 2
- 21. 21 Splunk Logging Driver for Docker 2 • Secure—supports TLS/SSL • Easy data collection and classification • Simple to setup • Scalable—built on top of Splunk HTTP Event Collector
- 22. 22 Puppet Enterprise App for Splunk 2 • Understand health of Puppet environment • Isolate infrastructure and automation issues • Benchmark and understand resource bottlenecks
- 23. 23 Chef App for Splunk 2 • Visibility into metrics for faster troubleshooting – Success and failure rates – Most active users and most active organizations • Real-time insight into errors across infrastructure helps troubleshoot and catch high- impact issues
- 24. 24 My Journey with Devops at Splunk Team Agility with the Splunk Platform Code QA and Management Testing and Framework Automation and Build Frameworks Collaboration & Feedback Bring it all together with Splunk Splunk Blogs Upcoming Posts
- 25. 25 SEPT 26-29, 2016 WALT DISNEY WORLD, ORLANDO SWAN AND DOLPHIN RESORTS • 5000+ IT & Business Professionals • 3 days of technical content • 165+ sessions • 80+ Customer Speakers • 35+ Apps in Splunk Apps Showcase • 75+ Technology Partners • 1:1 networking: Ask The Experts and Security Experts, Birds of a Feather and Chalk Talks • NEW hands-on labs! • Expanded show floor, Dashboards Control Room & Clinic, and MORE! The 7th Annual Splunk Worldwide Users’ Conference PLUS Splunk University • Three days: Sept 24-26, 2016 • Get Splunk Certified for FREE! • Get CPE credits for CISSP, CAP, SSCP • Save thousands on Splunk education!
- 26. Resources • Splunk for DevOps website • Splunk DevOps Ecosystem Apps: splunkbase.splunk.com • Splunk blogs: blogs.splunk.com • Splunk community: www.splunk.com/community
- 27. 2 Thank You
Notas do Editor
- With the advent of the internet, no one could have predicated that we could grow so quickly from the early days of dialup and ISDN lines to the inner connected world of the internet as we see it today. By 2020 we will have over 4 billing people connected sharing and collaboration to a never ending community of people who want to connect in real time. With everything that is going on do you think you can scale with this growth cycle? Think about the possibilities and challenges that you see in your current organizations. Do you have a good handle on the way your team connects ? Do you have a understanding of how to take your data silo environment. Can you predict the next wave of next generation technology ? As we talk through the culture shift that we call devops. We take a look at current environment and breakdown the barriers to help you understand how Splunk can play critical part in helping you get that 360 holistic view of your environment. PROBLEM STATEMENT Time-to-market pressure is driving changes in the application delivery lifecycle, requiring the deployment of many new DevOps tools and automation. The complexity and lack of visibility into this new DevOps tool chain impacts IT and business as follows: Slower rate of releases and updates Applications are released with defects, resulting in efficiency, stability, revenue, satisfaction, and security/audit risk Limited insights into the business impact of new code, slow reaction times Limited visibility into the business impact of applications – which is needed to appropriate budget Lack of reporting on application security and compliance implications
- However, DevOps is complex and consists ‘loosely connected’ tools, especially new solutions for Continuous Integration (CI) and Continuous Delivery (CD), that automate the various aspects of the application lifecycle, from application planning through project management, code management, build automation, test automation, provisioning, configuration, release, and monitoring Similarly in Ops, the environment is becoming much more complex and disjointed, demanding Site Reliability Engineers understand what is happening in a massively complex ecosystem. From on-site and legacy data center systems to cloud and SaaS services, network and storage infrastructures including SDN, SDS, and SDDC, security and compliance posture, and an increasing number of third party and internal services accessed solely through APIs. All the while, Devs, Ops, and the rest of the delivery team are being told they must ‘align with the business’, without having any real visibility, let alone understanding, of how a DevOps-oriented delivery lifecycle directly impacts business goals like user signups, cart fulfillment, customer satisfaction, social sentiment, or revenue.
- Splunk can provide insight across the entire application delivery lifecycle. Developers can search and visualize data from entire build pipeline and production environments without needing to access production machines.
- The Splunk Platform (Splunk Enterprise and Splunk Cloud) improves application delivery velocity, quality and business impact by enabling a continuous DevOps feedback loop. The Splunk Platform helps simplify collaboration and enables rapid iteration by IT and the business, to help drive innovation and achieve better business results.
- Need to check all of them.
- HTTP Event Collector is easy way to send data to Splunk Enterprise. Notably, the EC enables you to send data over HTTP/ HTTPS directly to Splunk Enterprise from your application. The EC was developed with application developers in mind, so that all it takes is a few lines of code added to an app for the app to send data. Also, the EC is token-based, so you never need to hard-code your Splunk Enterprise credentials in your app or supporting files. HTTP Event Collector provides a new way for developers to send application logging and metrics directly to Splunk Enterprise via HTTP in a highly efficient, scalable and secure manner
- Secure - Supports TLS / SSL Support for configurable data collection to simplify data classification and access control index sourcetype source Support for collection of container labels and env keys which can further help with data classification Simple Easy to setup e.g., no need to deploy Splunk Universal Forwarder (UF) and scale it Much easier to collect data in Splunk Cloud deployments Scalable built on top of HTTP Event Collector (HEC) Support encryption via SSL as long as Splunk has a TCP SSL endpoint opened. The difference I would say is that with syslog over SSL there is no auth model other than the cert itself and you can only have one SSL cert for all of Splunk. With HEC you have fine grained control of which servers can send data and which indexes they can access as that can be configured per token. Simplified classification by source and labels, you can do that in syslog driver as well. See labels and env in https://docs.docker.com/engine/admin/logging/overview/ Additional configurations on Splunk logging driver to see “process” field, https://docs.docker.com/engine/admin/logging/log_tags/. Available by default in Syslog. Splunk Cloud: HEC is fully supported in Splunk Cloud. You cannot however arbitrarily open a TCP/UDP port in Splunk Cloud which would be required if you needed to forward Syslog data to a UF running in Splunk Cloud. Need to confirm how to scale HEC in Splunk Cloud. https://docs.docker.com/engine/admin/logging/splunk/
- The new app collects and analyzes performance data from Puppet Enterprise. Customers get visibility into critical services, such as PuppetDB, the Puppet Serve, and console services. The app also helps to reduce troubleshooting times and proactively fix health issues in the Puppet environment, and includes the following insights: Console services response times to benchmark and actively plan console resources The number of request errors by Puppet clients to help recognize potential code or infrastructure issues Role-based access control dashboards to monitor user activity, including authentication errors to help with potential security issues Requests from PuppetDB to identify commonly executed or failed queries—isolating potential infrastructure bottlenecks PuppetDB node deactivation activity for isolation of security or automation issues Commonly submitted PuppetDB commands from client IPs to assist in pinpointing potential security issues Puppet Server compilation metrics that help teams evaluate the health of their automation environment and appropriately assign resource
- The Chef Analytics App for Splunk is available for free on Splunkbase Splunk app marketplace and provides Chef users with visibility into metrics such as success / failure rates, most active users and most active organizations. The Chef Analytics App for Splunk also helps you understand the frequency of the details of errors across infrastructure so that you can catch and troubleshoot high impact issues, like a major bug in a cookbook or an infrastructure issue like network connectivity, in real time More details: https://www.chef.io/blog/2015/04/17/integrating-chef-analytics-with-splunk/
- We’re headed to the East Coast! 2 inspired Keynotes – General Session and Security Keynote + Super Sessions with Splunk Leadership in Cloud, IT Ops, Security and Business Analytics! 165+ Breakout sessions addressing all areas and levels of Operational Intelligence – IT, Business Analytics, Mobile, Cloud, IoT, Security…and MORE! 30+ hours of invaluable networking time with industry thought leaders, technologists, and other Splunk Ninjas and Champions waiting to share their business wins with you! Join the 50%+ of Fortune 100 companies who attended .conf2015 to get hands on with Splunk. You’ll be surrounded by thousands of other like-minded individuals who are ready to share exciting and cutting edge use cases and best practices. You can also deep dive on all things Splunk products together with your favorite Splunkers. Head back to your company with both practical and inspired new uses for Splunk, ready to unlock the unimaginable power of your data! Arrive in Orlando a Splunk user, leave Orlando a Splunk Ninja! REGISTRATION OPENS IN MARCH 2016 – STAY TUNED FOR NEWS ON OUR BEST REGISTRATION RATES – COMING SOON!
- Use Splunk as fast-feedback loop for actionable business insights.