Enviar pesquisa
Carregar
Improving Quality through Continuous Integration - A case study of CollabNet
•
2 gostaram
•
1,374 visualizações
Venkat Janardhanam, MS, MBA
Seguir
Tecnologia
Denunciar
Compartilhar
Denunciar
Compartilhar
1 de 24
Recomendados
Dev ops and safety critical systems
Dev ops and safety critical systems
Len Bass
Functional and Non-functional Test automation
Functional and Non-functional Test automation
Dr Ganesh Iyer
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
Sauce Labs
Devops phase-1
Devops phase-1
G R VISHAL
Scaling Your DevOps with Chef (December 15th 2016)
Scaling Your DevOps with Chef (December 15th 2016)
Anthony Hodson
Continuous Delivery with a PaaS Application
Continuous Delivery with a PaaS Application
Mark Rendell
Continuous Delivery Maturity Model
Continuous Delivery Maturity Model
IBM UrbanCode Products
kishore
kishore
Kishore Chokkalingam
Recomendados
Dev ops and safety critical systems
Dev ops and safety critical systems
Len Bass
Functional and Non-functional Test automation
Functional and Non-functional Test automation
Dr Ganesh Iyer
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
Sauce Labs
Devops phase-1
Devops phase-1
G R VISHAL
Scaling Your DevOps with Chef (December 15th 2016)
Scaling Your DevOps with Chef (December 15th 2016)
Anthony Hodson
Continuous Delivery with a PaaS Application
Continuous Delivery with a PaaS Application
Mark Rendell
Continuous Delivery Maturity Model
Continuous Delivery Maturity Model
IBM UrbanCode Products
kishore
kishore
Kishore Chokkalingam
DevOps and the Case for ROI to Executives
DevOps and the Case for ROI to Executives
IBM UrbanCode Products
Validating Next Generation CPUs
Validating Next Generation CPUs
DVClub
Building Security in Using CI
Building Security in Using CI
Coveros, Inc.
Enabling agility with continuous integration testing
Enabling agility with continuous integration testing
IBM Rational software
Mobile DevOps - Trends and Chellenges
Mobile DevOps - Trends and Chellenges
Sanjeev Sharma
Get Mapped: Using Value Stream Mapping to Create a DevOps Adoption Roadmap
Get Mapped: Using Value Stream Mapping to Create a DevOps Adoption Roadmap
IBM UrbanCode Products
Security Implications for a DevOps Transformation
Security Implications for a DevOps Transformation
Deborah Schalm
Securing deployment pipeline
Securing deployment pipeline
Len Bass
TechTalk 2021: Peran IT Security dalam Penerapan DevOps
TechTalk 2021: Peran IT Security dalam Penerapan DevOps
DicodingEvent
Deployability
Deployability
Len Bass
Leading the Transformation: Applying DevOps and Agile Principles at Scale
Leading the Transformation: Applying DevOps and Agile Principles at Scale
IBM UrbanCode Products
IP Reuse Impact on Design Verification Management Across the Enterprise
IP Reuse Impact on Design Verification Management Across the Enterprise
DVClub
Using DevOps to Improve Software Quality in the Cloud
Using DevOps to Improve Software Quality in the Cloud
TechWell
Engineering DevOps to meet Business Goals
Engineering DevOps to meet Business Goals
Marc Hornbeek
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld
Meet Big Agile: Testing on Large-Scale Projects
Meet Big Agile: Testing on Large-Scale Projects
TechWell
Disruptive Technology Trends - Cloud, Mobile, IoT and Beyond
Disruptive Technology Trends - Cloud, Mobile, IoT and Beyond
Dr Ganesh Iyer
Flight East 2018 Presentation–A DevOps State of Mind: Continuous Security wit...
Flight East 2018 Presentation–A DevOps State of Mind: Continuous Security wit...
Synopsys Software Integrity Group
Packaging tool options
Packaging tool options
Len Bass
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Sanjeev Sharma
Continuous integration testing fundamentals
Continuous integration testing fundamentals
Cygnet Infotech
Old Infrastructure or New IP? Your Choice: The Brocade CIO Survey 2015
Old Infrastructure or New IP? Your Choice: The Brocade CIO Survey 2015
Dawn Morris
Mais conteúdo relacionado
Mais procurados
DevOps and the Case for ROI to Executives
DevOps and the Case for ROI to Executives
IBM UrbanCode Products
Validating Next Generation CPUs
Validating Next Generation CPUs
DVClub
Building Security in Using CI
Building Security in Using CI
Coveros, Inc.
Enabling agility with continuous integration testing
Enabling agility with continuous integration testing
IBM Rational software
Mobile DevOps - Trends and Chellenges
Mobile DevOps - Trends and Chellenges
Sanjeev Sharma
Get Mapped: Using Value Stream Mapping to Create a DevOps Adoption Roadmap
Get Mapped: Using Value Stream Mapping to Create a DevOps Adoption Roadmap
IBM UrbanCode Products
Security Implications for a DevOps Transformation
Security Implications for a DevOps Transformation
Deborah Schalm
Securing deployment pipeline
Securing deployment pipeline
Len Bass
TechTalk 2021: Peran IT Security dalam Penerapan DevOps
TechTalk 2021: Peran IT Security dalam Penerapan DevOps
DicodingEvent
Deployability
Deployability
Len Bass
Leading the Transformation: Applying DevOps and Agile Principles at Scale
Leading the Transformation: Applying DevOps and Agile Principles at Scale
IBM UrbanCode Products
IP Reuse Impact on Design Verification Management Across the Enterprise
IP Reuse Impact on Design Verification Management Across the Enterprise
DVClub
Using DevOps to Improve Software Quality in the Cloud
Using DevOps to Improve Software Quality in the Cloud
TechWell
Engineering DevOps to meet Business Goals
Engineering DevOps to meet Business Goals
Marc Hornbeek
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld
Meet Big Agile: Testing on Large-Scale Projects
Meet Big Agile: Testing on Large-Scale Projects
TechWell
Disruptive Technology Trends - Cloud, Mobile, IoT and Beyond
Disruptive Technology Trends - Cloud, Mobile, IoT and Beyond
Dr Ganesh Iyer
Flight East 2018 Presentation–A DevOps State of Mind: Continuous Security wit...
Flight East 2018 Presentation–A DevOps State of Mind: Continuous Security wit...
Synopsys Software Integrity Group
Packaging tool options
Packaging tool options
Len Bass
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Sanjeev Sharma
Mais procurados
(20)
DevOps and the Case for ROI to Executives
DevOps and the Case for ROI to Executives
Validating Next Generation CPUs
Validating Next Generation CPUs
Building Security in Using CI
Building Security in Using CI
Enabling agility with continuous integration testing
Enabling agility with continuous integration testing
Mobile DevOps - Trends and Chellenges
Mobile DevOps - Trends and Chellenges
Get Mapped: Using Value Stream Mapping to Create a DevOps Adoption Roadmap
Get Mapped: Using Value Stream Mapping to Create a DevOps Adoption Roadmap
Security Implications for a DevOps Transformation
Security Implications for a DevOps Transformation
Securing deployment pipeline
Securing deployment pipeline
TechTalk 2021: Peran IT Security dalam Penerapan DevOps
TechTalk 2021: Peran IT Security dalam Penerapan DevOps
Deployability
Deployability
Leading the Transformation: Applying DevOps and Agile Principles at Scale
Leading the Transformation: Applying DevOps and Agile Principles at Scale
IP Reuse Impact on Design Verification Management Across the Enterprise
IP Reuse Impact on Design Verification Management Across the Enterprise
Using DevOps to Improve Software Quality in the Cloud
Using DevOps to Improve Software Quality in the Cloud
Engineering DevOps to meet Business Goals
Engineering DevOps to meet Business Goals
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
Meet Big Agile: Testing on Large-Scale Projects
Meet Big Agile: Testing on Large-Scale Projects
Disruptive Technology Trends - Cloud, Mobile, IoT and Beyond
Disruptive Technology Trends - Cloud, Mobile, IoT and Beyond
Flight East 2018 Presentation–A DevOps State of Mind: Continuous Security wit...
Flight East 2018 Presentation–A DevOps State of Mind: Continuous Security wit...
Packaging tool options
Packaging tool options
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Destaque
Continuous integration testing fundamentals
Continuous integration testing fundamentals
Cygnet Infotech
Old Infrastructure or New IP? Your Choice: The Brocade CIO Survey 2015
Old Infrastructure or New IP? Your Choice: The Brocade CIO Survey 2015
Dawn Morris
Ship it! Fast Product Development
Ship it! Fast Product Development
BERATUNG JUDITH ANDRESEN
Seit wir Scrum machen ist alles super. NICHT!
Seit wir Scrum machen ist alles super. NICHT!
Tobias Ranft
Schnell liefern!
Schnell liefern!
BERATUNG JUDITH ANDRESEN
Mit Scrum wird alles besser!?
Mit Scrum wird alles besser!?
Tobias Ranft
Alles wird gut - wir machen jetzt Scrum!
Alles wird gut - wir machen jetzt Scrum!
BERATUNG JUDITH ANDRESEN
Echte Innovation liefern
Echte Innovation liefern
BERATUNG JUDITH ANDRESEN
Continuous Integration with Jenkins and ANT
Continuous Integration with Jenkins and ANT
David Berliner
Cloud-powered Continuous Integration and Deployment architectures - Jinesh Varia
Cloud-powered Continuous Integration and Deployment architectures - Jinesh Varia
Amazon Web Services
Continuous Integration (Jenkins/Hudson)
Continuous Integration (Jenkins/Hudson)
Dennys Hsieh
Jenkins - From Continuous Integration to Continuous Delivery
Jenkins - From Continuous Integration to Continuous Delivery
Virendra Bhalothia
CI and CD with Jenkins
CI and CD with Jenkins
Martin Málek
Design in Tech Report 2017
Design in Tech Report 2017
John Maeda
Destaque
(14)
Continuous integration testing fundamentals
Continuous integration testing fundamentals
Old Infrastructure or New IP? Your Choice: The Brocade CIO Survey 2015
Old Infrastructure or New IP? Your Choice: The Brocade CIO Survey 2015
Ship it! Fast Product Development
Ship it! Fast Product Development
Seit wir Scrum machen ist alles super. NICHT!
Seit wir Scrum machen ist alles super. NICHT!
Schnell liefern!
Schnell liefern!
Mit Scrum wird alles besser!?
Mit Scrum wird alles besser!?
Alles wird gut - wir machen jetzt Scrum!
Alles wird gut - wir machen jetzt Scrum!
Echte Innovation liefern
Echte Innovation liefern
Continuous Integration with Jenkins and ANT
Continuous Integration with Jenkins and ANT
Cloud-powered Continuous Integration and Deployment architectures - Jinesh Varia
Cloud-powered Continuous Integration and Deployment architectures - Jinesh Varia
Continuous Integration (Jenkins/Hudson)
Continuous Integration (Jenkins/Hudson)
Jenkins - From Continuous Integration to Continuous Delivery
Jenkins - From Continuous Integration to Continuous Delivery
CI and CD with Jenkins
CI and CD with Jenkins
Design in Tech Report 2017
Design in Tech Report 2017
Semelhante a Improving Quality through Continuous Integration - A case study of CollabNet
Enterprise CI as-a-Service using Jenkins
Enterprise CI as-a-Service using Jenkins
CollabNet
Designing for Testability: Differentiator in a Competitive Market
Designing for Testability: Differentiator in a Competitive Market
TechWell
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Emtec Inc.
Harman deepak v - agile on steriod - dev ops led transformation
Harman deepak v - agile on steriod - dev ops led transformation
Xebia India
Implementing Continuous Integration to Improve Software Quality
Implementing Continuous Integration to Improve Software Quality
Rocket Software
Are your DevOps and Security teams friends or foes?
Are your DevOps and Security teams friends or foes?
Reuven Harrison
Revolutionizing Enterprise Software Development through Continuous Delivery &...
Revolutionizing Enterprise Software Development through Continuous Delivery &...
People10 Technosoft Private Limited
Test automation lessons from WebSphere Application Server
Test automation lessons from WebSphere Application Server
Robbie Minshall
No Devops Without Continuous Testing
No Devops Without Continuous Testing
Parasoft
Developer want change Ops want control - devops
Developer want change Ops want control - devops
Venkat Janardhanam, MS, MBA
Getting to Walk with DevOps
Getting to Walk with DevOps
Eklove Mohan
Journey to the center of DevOps - v6
Journey to the center of DevOps - v6
Venkat Janardhanam, MS, MBA
Training Bootcamp - MainframeDevOps.pptx
Training Bootcamp - MainframeDevOps.pptx
Nashet Ali
10.15.2014 dallas ws_brian_d_dn_live workshop enterpise agility_cust
10.15.2014 dallas ws_brian_d_dn_live workshop enterpise agility_cust
dennisn129
Continuous Performance Testing in DevOps - Lee Barnes
Continuous Performance Testing in DevOps - Lee Barnes
QA or the Highway
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
Dynatrace
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Sauce Labs
Adopting DevOps for 2-Speed IT
Adopting DevOps for 2-Speed IT
IBM UrbanCode Products
Neev QA Offering
Neev QA Offering
Neev Technologies
Neev Independent Testing Services
Neev Independent Testing Services
Neev Technologies
Semelhante a Improving Quality through Continuous Integration - A case study of CollabNet
(20)
Enterprise CI as-a-Service using Jenkins
Enterprise CI as-a-Service using Jenkins
Designing for Testability: Differentiator in a Competitive Market
Designing for Testability: Differentiator in a Competitive Market
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Webinar Presentation: Best Practices in QA Testing - Leveraging Open Source T...
Harman deepak v - agile on steriod - dev ops led transformation
Harman deepak v - agile on steriod - dev ops led transformation
Implementing Continuous Integration to Improve Software Quality
Implementing Continuous Integration to Improve Software Quality
Are your DevOps and Security teams friends or foes?
Are your DevOps and Security teams friends or foes?
Revolutionizing Enterprise Software Development through Continuous Delivery &...
Revolutionizing Enterprise Software Development through Continuous Delivery &...
Test automation lessons from WebSphere Application Server
Test automation lessons from WebSphere Application Server
No Devops Without Continuous Testing
No Devops Without Continuous Testing
Developer want change Ops want control - devops
Developer want change Ops want control - devops
Getting to Walk with DevOps
Getting to Walk with DevOps
Journey to the center of DevOps - v6
Journey to the center of DevOps - v6
Training Bootcamp - MainframeDevOps.pptx
Training Bootcamp - MainframeDevOps.pptx
10.15.2014 dallas ws_brian_d_dn_live workshop enterpise agility_cust
10.15.2014 dallas ws_brian_d_dn_live workshop enterpise agility_cust
Continuous Performance Testing in DevOps - Lee Barnes
Continuous Performance Testing in DevOps - Lee Barnes
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Adopting DevOps for 2-Speed IT
Adopting DevOps for 2-Speed IT
Neev QA Offering
Neev QA Offering
Neev Independent Testing Services
Neev Independent Testing Services
Mais de Venkat Janardhanam, MS, MBA
Test management in Agile Teams
Test management in Agile Teams
Venkat Janardhanam, MS, MBA
Test Management in TeamForge
Test Management in TeamForge
Venkat Janardhanam, MS, MBA
Team forge Test Management with TestLink
Team forge Test Management with TestLink
Venkat Janardhanam, MS, MBA
India agile week chennai - Agile maturity to scale for enterprise & blendin...
India agile week chennai - Agile maturity to scale for enterprise & blendin...
Venkat Janardhanam, MS, MBA
Agile Adoption in Testing 2013 - v2
Agile Adoption in Testing 2013 - v2
Venkat Janardhanam, MS, MBA
Agile developers do it globally - v5
Agile developers do it globally - v5
Venkat Janardhanam, MS, MBA
Agile estimation
Agile estimation
Venkat Janardhanam, MS, MBA
Purpose Of ALM Tool
Purpose Of ALM Tool
Venkat Janardhanam, MS, MBA
Agile ALM Tool Comparison
Agile ALM Tool Comparison
Venkat Janardhanam, MS, MBA
Mais de Venkat Janardhanam, MS, MBA
(9)
Test management in Agile Teams
Test management in Agile Teams
Test Management in TeamForge
Test Management in TeamForge
Team forge Test Management with TestLink
Team forge Test Management with TestLink
India agile week chennai - Agile maturity to scale for enterprise & blendin...
India agile week chennai - Agile maturity to scale for enterprise & blendin...
Agile Adoption in Testing 2013 - v2
Agile Adoption in Testing 2013 - v2
Agile developers do it globally - v5
Agile developers do it globally - v5
Agile estimation
Agile estimation
Purpose Of ALM Tool
Purpose Of ALM Tool
Agile ALM Tool Comparison
Agile ALM Tool Comparison
Último
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
Alan Dix
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
Fwdays
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
ScyllaDB
How to write a Business Continuity Plan
How to write a Business Continuity Plan
Databarracks
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
Sergiu Bodiu
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
Fwdays
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
Florian Wilhelm
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
Fwdays
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
RankYa
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
Slibray Presentation
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
Sri Ambati
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
Hervé Boutemy
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
BookNet Canada
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Precisely
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
Fwdays
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
Alfredo García Lavilla
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
gvaughan
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
Scott Keck-Warren
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
comworks
Último
(20)
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
How to write a Business Continuity Plan
How to write a Business Continuity Plan
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
Improving Quality through Continuous Integration - A case study of CollabNet
1.
1 Copyright ©2014
CollabNet, Inc. All Rights Reserved.ENTERPRISE CLOUD DEVELOPMENT Improving Quality through Continuous Integration A case study of CollabNet best practices Janardhanam Venkat Director Engineering Dr. Dobbs Conference - Pune - April 13th 2014
2.
2 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Overview • Introduction to Basic CI • Chaos in Product Development • Defining CI strategy • Building a CI strategy • Execution cycle feedback • CI Infrastructure • Drill down to Metrics • Measurement & Maturity
3.
3 Copyright ©2014
CollabNet, Inc. All Rights Reserved. CI Packaging CI Server Ping Version Control CI Server Commit - Detailed Test Suite Longer Running Test Light weight Test Basic CI Environment - Unit Test - Check Style
4.
4 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Chaos & Problem Where to start?
5.
5 Copyright ©2014
CollabNet, Inc. All Rights Reserved. • Not sure how much unit test coverage is written for a feature • Not sure if my code is following best practices • No time to test in multiple browsers and their versions • Unable to cope up with installer testing – Combination of OS & database has many permutations to test – Turn around time to test a minor installer fix is 2 weeks or longer Agile Team Problem
6.
6 Copyright ©2014
CollabNet, Inc. All Rights Reserved. • Infrastructure Security Vulnerability – Prior Product release versions in production • Application Security Vulnerability – Cross site scripting, SQL injection • Service Issues – SOAP API breaking • Broken Link in the product – Help contents 404 • Few feature have issue that are browser specific – Not working in IE 9 Customer Problem Reactive (Customer Problem) Proactive (Agile Teams Problem)
7.
7 Copyright ©2014
CollabNet, Inc. All Rights Reserved. • Use provisioning to enable CI • Run parallel tests • Tie code review process with commit tests • Test in clone of Production environment Industry Best Practices
8.
8 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Input to CI Strategy CI Strategy Customer Problem Agile Team Problem Industry Best Practices Roadmap
9.
9 Copyright ©2014
CollabNet, Inc. All Rights Reserved. • Parameters that defines the strategy – What kind of test Coverage? • Certain features may need more coverage – How important is Time to Feedback? • Can team act upon if the feedback takes longer – What is the Cost? • Hardware versus Tester Resource • Pick license or Open Source tool Refining CI strategy Source: Revello Systems, March 2014 You may not get all three parameters right
10.
10 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Building CI strategy Problem Tools Value Infrastructure Security Vulnerability Nessus Identify JDK, Apache, OS vulnerability Application Security Testing Acunetix XSS, SQL injection Installer Automation Home grown Multi platform testing Functional Testing Selenium Reduce time Services Testing SOAP UI Automate Static Code Analysis FindBugs, PMD Code Quality Broken Links Link Checker Identify 404 Code Coverage Cobertura Unit test coverage Performance Testing JMeter Load Testing Browser Compatibility Testing Browsera Multi browser test 508 Compliance Testing WAT
11.
11 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Extending CI Infrastructure Self Provisioning ALM Jenkins CI Infrastructure
12.
12 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Leverage Self Provisioning Environment • Provisioning of boxes – Platform, OS & application configuration – E.g.: Solaris, CentOS, Suse, RHEL, in combination with 32/64 Bit, 2/4/8 core & different storage space – Common Profile for teams Datacenter Distributed Teams SDLC Mgmt. Customer (Early release) Product – Ops 1 Product – QA 1 Product – QA 2 Product – QA 3 Product – Dev 1
13.
13 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Leverage ALM for Traceability
14.
14 Copyright ©2014
CollabNet, Inc. All Rights Reserved. CI Master Nessus Suite Suite 1 Suite 2 … Suite 6 CI Master Detail Test Suite Suite 1 Suite 2 …. Suite 10 Commit Test CI Master Functional Test CI Master SOAP Broken Link CI Master Installer Automation Case 1 Case 2 …… Case 14 FindBug PMD CI Infrastructure – Self Provisioning, ALM & Jenkins Boxes Provisioned in private cloud Master Slave Around 70 Servers ALM
15.
15 Copyright ©2014
CollabNet, Inc. All Rights Reserved. CI Execution Cycle – Feedback Commit Validation SOAP Services Test Static Code Analysis Functional Test Installer Automation Application Security Testing Infra. Security 4 Hr 1 Week10 Min 20 Min 3 Hr 10 Hr1 Hr Detail Unit Test Commit reverted for failed test Defect created for failed test 15 Min0
16.
16 Copyright ©2014
CollabNet, Inc. All Rights Reserved. CI Execution Cycle – Feedback Commit Validation SOAP Services Test Static Code Analysis Functional Test Installer Automation Application Security Testing Infra. Security 4 Hr 1 Week10 Min 20 Min 3 Hr 10 Hr1 Hr Detail Unit Test Commit reverted for failed test Defect created for failed test 15 Min0 598 1327 5601 5287 93 8 0 1000 2000 3000 4000 5000 6000 Commit Validation SOAP Selenium Full Unit Test Load Test Installer Automation #ofTestCases TeamForge Automated Cases
17.
17 Copyright ©2014
CollabNet, Inc. All Rights Reserved. CI Visibility Dashboard Took an year to implement the strategy Started in April 2013
18.
18 Copyright ©2014
CollabNet, Inc. All Rights Reserved. CI Visibility Notification
19.
19 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Metrics - Customer Reported Core Product Defects 17.20 15.13 7.00 0.00 2.00 4.00 6.00 8.00 10.00 12.00 14.00 16.00 18.00 20.00 Jun-12 Dec-12 Jun-13 Dec-13 TeamForge Release Date Customer Defect By Release Ratio
20.
20 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Metrics - Installer Automation • Reduce Installer qualification time to 1 day – Phase I – Total 185 hours to qualify one round of installer testing – After automating 8 installer cases, reduced qualification time to 134 hours Manual, 131 hrs Saved, 51 hrs Actual, 3 hrs. Automated, 54 Installer Automation - 8 of 19 cases done One round manual qualification - Total 185 hours
21.
21 Copyright ©2014
CollabNet, Inc. All Rights Reserved. • CI increases confidence and reduces risk • Defines quality, prevention & reduction of defect • Builds value with faster feedback • Shorten software release time • Results published, increases visibility to agile teams • Challenges Continues – Unable to automate data warehouse ETL testing – Keeping up with tools & maintenance overhead – Large scale refactoring & architecture changes CI Value to Agile Teams
22.
22 Copyright ©2014
CollabNet, Inc. All Rights Reserved. • Infrastructure vulnerability - Setup in prior 3 releases • Broken link - Set up in prior product release • Setting up the same CI infrastructure for 3 branches Additional Refinements
23.
23 Copyright ©2014
CollabNet, Inc. All Rights Reserved. Measure & Mature CI Strategy Basic Find defect after development Manual Deployment Team actions on report Commit Validation Manual Build Intermediate Early detection Partial auto deploy to Test Historical & analysis Code analysis, Functional Test Automated Build & CI Advanced Reduce customer defect Auto deploy to Test /Stage Trending Reports Performance, Security Test Leverage provisioning Optimized Defect prevention Auto deploy to Prod Predictive Modeling Services Test Track CI config changesBuild Test Visibility Deployment Quality
24.
24 Copyright ©2014
CollabNet, Inc. All Rights Reserved.24 Copyright ©2014 CollabNet, Inc. All Rights Reserved. Questions? Janardhanam Venkat [venkatj@collab.net] www.collab.net +1-650-228-2500 +1-888-778-9793 blogs.collab.net twitter.com/collabnet www.facebook.com/collabnet www.linkedin.com/company/collabnet-inc