SlideShare uma empresa Scribd logo
1 de 17
What’s so great about
WebDriver?
Mark Winteringham
@mwtestconsult
linkedin.com/in/markwinteringham
www.mwtestconsultancy.co.uk
• Freelance Technical Tester
• ‘Understanding and testing RESTful Web services’
– London Tester Gathering Workshop - Thursday 4th June
• 8 Years experience
• Broadcasting, publishing, professional audio and public sectors.
Looking for talented, highly experienced people. Interested? Speak to Theresa
Equal Experts’ agile practitioners combine technical excellence and business pragmatism
to deliver simple bespoke software solutions to big business problems.
Customers in the private and public sector, ranging from Camelot and Telefonica to
HMRC and Cabinet office
You don't need to learn
programming to Test... but it helps
Mark Winteringham
Automation: Time to change our models
Iain McCowatt
‘Look at the world through a different pair of lenses every time you have a problem’
www.ministryoftesting.com/2014/05/automation-time-change-models-iain-mccowatt/
Mental models
Jim wants to automate
checking a service validates a
range of payloads correctly
Jim builds a script in
WebDriver via the UI the
service consumes
It results in automation
that’s slow and brittle
Jim continues to tinker with
the script
It’s too hard!
‘Automator Jim’ knows
WebDriver
What if Jim knew about a different tool such as JMeter or SOAPUI?
‘We shape our tools and then our tools shape us’
industryweek.com
Marshall McLuhan
‘Be promiscuous’
What if Jim isn’t even aware that these tools exist
or that he could benefit in learning them in the first place
But..
Learn more models, learn more tools
What if we as a testing community collectively have limited mental models about automation
and are consequently feeding the same limited mental models back to testers like Jim
The question
Automation workshops/talks in
conferences
WebDriver/Seleni
um, 17
Watir, 1
API, 2
Big Data, 2
Unit Testing, 2
BDD, 5
Monitoring, 2
Security Testing, 1
WebDriver/Selenium
Watir
API
Big Data
Unit Testing
BDD
Monitoring
Security Testing
Talks and workshops that explicitly
talk about an automation tool
5 Popular conferences 2012 – 2015
Automation tools in Job specs
67 Jobs roles
Keywords:
• Developer in test
• Automation test engineer
Source: cwjobs.co.uk – 23/1/15
Selenium / WebDriver, 57
Cucumber, 22
*unit, 22
QTP, 12
SoapUI/LoadUI, 9
SQL, 6
JBehave, 5
TestNG, 5
Test Complete, 5
Appium, 4
Calabash, 4
Fitnesse
Jasmine
Karma
JMock
Fitnesse
Capybara
Jmeter
Rational
Watin
Visual Studios
Ranorex
Specflow
LoadRunner
Webload
Siege
BurpSuite
Rspec
Behat
Mink
EasyMock
Espresso
What’s so great about WebDriver?
It offers limited mental models –
Automating through the UI!
WebDriver/Seleniu
m
53%
Watir
3%
API
7%
Big Data
6%
Unit Testing
6%
BDD
16%
Monitoring
6%
Security Testing
3%
http://watirmelon.com/2011/06/10/yet-another-software-testing-pyramid/
=/
Where are the workshops or requirements for skills in:
Monitoring
Deployment
Test data population
Configuration Management
Parsing data
API Testing
Unit testing
So what could we do?
Look further afield to learn new tools Tinker around with other tools
Personal
Community
Demand more diversity in automation training
When writing job roles focus more on the problems that need solving
Think more about the problem you want to solve, is your current model enough?
Detox ourselves from WebDriver… maybe with a bit of Watir
Thank you
Questions?

Mais conteúdo relacionado

Mais procurados

Emerging Trends of Test automation - Talk in Software Testing Conference Nort...
Emerging Trends of Test automation - Talk in Software Testing Conference Nort...Emerging Trends of Test automation - Talk in Software Testing Conference Nort...
Emerging Trends of Test automation - Talk in Software Testing Conference Nort...
Sriram Angajala
 
Integration Testing in Enterprises using TaaS
Integration Testing in Enterprises using TaaSIntegration Testing in Enterprises using TaaS
Integration Testing in Enterprises using TaaS
Anand Bagmar
 
Managing technical debt - Dan Nicola - Florin Cardasim
Managing technical debt - Dan Nicola - Florin CardasimManaging technical debt - Dan Nicola - Florin Cardasim
Managing technical debt - Dan Nicola - Florin Cardasim
Codecamp Romania
 

Mais procurados (19)

Lizards & Pumpkins Catalog Replacement at mm17de
Lizards & Pumpkins Catalog Replacement at mm17deLizards & Pumpkins Catalog Replacement at mm17de
Lizards & Pumpkins Catalog Replacement at mm17de
 
Building stable applications with PHP and 3rd party services
Building stable applications with PHP and 3rd party servicesBuilding stable applications with PHP and 3rd party services
Building stable applications with PHP and 3rd party services
 
Build the "right" regression suite using Behavior Driven Testing (BDT)
Build the "right" regression suite using Behavior Driven Testing (BDT)Build the "right" regression suite using Behavior Driven Testing (BDT)
Build the "right" regression suite using Behavior Driven Testing (BDT)
 
How to scale your Test Automation
How to scale your Test AutomationHow to scale your Test Automation
How to scale your Test Automation
 
Emerging Trends of Test automation - Talk in Software Testing Conference Nort...
Emerging Trends of Test automation - Talk in Software Testing Conference Nort...Emerging Trends of Test automation - Talk in Software Testing Conference Nort...
Emerging Trends of Test automation - Talk in Software Testing Conference Nort...
 
Impact Analysis - LoopConf
Impact Analysis - LoopConfImpact Analysis - LoopConf
Impact Analysis - LoopConf
 
Automating Web Analytics
Automating Web AnalyticsAutomating Web Analytics
Automating Web Analytics
 
Optimizing WordPress eCommerce for Performance & Growth - Chris Wiegman, Sara...
Optimizing WordPress eCommerce for Performance & Growth - Chris Wiegman, Sara...Optimizing WordPress eCommerce for Performance & Growth - Chris Wiegman, Sara...
Optimizing WordPress eCommerce for Performance & Growth - Chris Wiegman, Sara...
 
Integration Testing in Enterprises using TaaS
Integration Testing in Enterprises using TaaSIntegration Testing in Enterprises using TaaS
Integration Testing in Enterprises using TaaS
 
Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Developer @ Atlas...
Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Developer @ Atlas...Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Developer @ Atlas...
Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Developer @ Atlas...
 
Reaching for Your Quality Stretch Goals: Testing at Realtor.com
Reaching for Your Quality Stretch Goals: Testing at Realtor.comReaching for Your Quality Stretch Goals: Testing at Realtor.com
Reaching for Your Quality Stretch Goals: Testing at Realtor.com
 
UI Automation Quirks
UI Automation QuirksUI Automation Quirks
UI Automation Quirks
 
Build the "right" regression suite using Behavior Driven Testing (BDT)
Build the "right" regression suite using Behavior Driven Testing (BDT)Build the "right" regression suite using Behavior Driven Testing (BDT)
Build the "right" regression suite using Behavior Driven Testing (BDT)
 
What is an Automation Framework ?
What is an Automation Framework ?�What is an Automation Framework ?�
What is an Automation Framework ?
 
Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!
 
Role of Automation in Testing
Role of Automation in TestingRole of Automation in Testing
Role of Automation in Testing
 
Managing technical debt - Dan Nicola - Florin Cardasim
Managing technical debt - Dan Nicola - Florin CardasimManaging technical debt - Dan Nicola - Florin Cardasim
Managing technical debt - Dan Nicola - Florin Cardasim
 
Visual Validation - The Missing Tip of the Automation Pyramid
Visual Validation - The Missing Tip of the Automation PyramidVisual Validation - The Missing Tip of the Automation Pyramid
Visual Validation - The Missing Tip of the Automation Pyramid
 
Using Automation to Meet Demands for Performance and Quality
Using Automation to Meet Demands for Performance and QualityUsing Automation to Meet Demands for Performance and Quality
Using Automation to Meet Demands for Performance and Quality
 

Semelhante a What's so great about web driver?

Model-Based Testing for ALM Octane: Better tests, built faster
Model-Based Testing for ALM Octane: Better tests, built faster Model-Based Testing for ALM Octane: Better tests, built faster
Model-Based Testing for ALM Octane: Better tests, built faster
Curiosity Software Ireland
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity Software Ireland
 
11.7 yrs of exp in testing (manual and automation)
11.7 yrs of exp in testing (manual and automation)11.7 yrs of exp in testing (manual and automation)
11.7 yrs of exp in testing (manual and automation)
Vijaya Kumar R
 
Test Automation Strategy
Test Automation StrategyTest Automation Strategy
Test Automation Strategy
Martin Ruddy
 
Automation testing strategy, approach & planning
Automation testing  strategy, approach & planningAutomation testing  strategy, approach & planning
Automation testing strategy, approach & planning
SivaprasanthRentala1975
 

Semelhante a What's so great about web driver? (20)

Model-Based Testing for ALM Octane: Better tests, built faster
Model-Based Testing for ALM Octane: Better tests, built faster Model-Based Testing for ALM Octane: Better tests, built faster
Model-Based Testing for ALM Octane: Better tests, built faster
 
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012
 
Ashish Baraiya
Ashish BaraiyaAshish Baraiya
Ashish Baraiya
 
Integrating AI in software quality in absence of a well-defined requirements
Integrating AI in software quality in absence of a well-defined requirementsIntegrating AI in software quality in absence of a well-defined requirements
Integrating AI in software quality in absence of a well-defined requirements
 
Failure is an Option: Scaling Resilient Feature Delivery
Failure is an Option: Scaling Resilient Feature DeliveryFailure is an Option: Scaling Resilient Feature Delivery
Failure is an Option: Scaling Resilient Feature Delivery
 
Engineering Trust in Your Automated Tests
Engineering Trust in Your Automated TestsEngineering Trust in Your Automated Tests
Engineering Trust in Your Automated Tests
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
 
Building Trust in Automated Tests
Building Trust in Automated TestsBuilding Trust in Automated Tests
Building Trust in Automated Tests
 
Future of QA
Future of QAFuture of QA
Future of QA
 
Futureofqa
FutureofqaFutureofqa
Futureofqa
 
The Tester’s Role: Balancing Technical Acumen and User Advocacy
The Tester’s Role: Balancing Technical Acumen and User AdvocacyThe Tester’s Role: Balancing Technical Acumen and User Advocacy
The Tester’s Role: Balancing Technical Acumen and User Advocacy
 
A Modern Dive into QA Automation and Beyond
A Modern Dive into QA Automation and BeyondA Modern Dive into QA Automation and Beyond
A Modern Dive into QA Automation and Beyond
 
11.7 yrs of exp in testing (manual and automation)
11.7 yrs of exp in testing (manual and automation)11.7 yrs of exp in testing (manual and automation)
11.7 yrs of exp in testing (manual and automation)
 
How to Build a Metrics-optimized Software Delivery Pipeline
How to Build a Metrics-optimized Software Delivery PipelineHow to Build a Metrics-optimized Software Delivery Pipeline
How to Build a Metrics-optimized Software Delivery Pipeline
 
Test Automation Strategy
Test Automation StrategyTest Automation Strategy
Test Automation Strategy
 
Continuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile DevelopmentContinuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile Development
 
SVCC 2011 - 0 - 60: QA Automation @ Box
SVCC 2011 - 0 - 60: QA Automation @ BoxSVCC 2011 - 0 - 60: QA Automation @ Box
SVCC 2011 - 0 - 60: QA Automation @ Box
 
Automation testing strategy, approach & planning
Automation testing  strategy, approach & planningAutomation testing  strategy, approach & planning
Automation testing strategy, approach & planning
 
IBM_Garage_client_deck.pptx
IBM_Garage_client_deck.pptxIBM_Garage_client_deck.pptx
IBM_Garage_client_deck.pptx
 

Último

Último (20)

MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 

What's so great about web driver?

  • 1. What’s so great about WebDriver? Mark Winteringham
  • 2. @mwtestconsult linkedin.com/in/markwinteringham www.mwtestconsultancy.co.uk • Freelance Technical Tester • ‘Understanding and testing RESTful Web services’ – London Tester Gathering Workshop - Thursday 4th June • 8 Years experience • Broadcasting, publishing, professional audio and public sectors.
  • 3. Looking for talented, highly experienced people. Interested? Speak to Theresa Equal Experts’ agile practitioners combine technical excellence and business pragmatism to deliver simple bespoke software solutions to big business problems. Customers in the private and public sector, ranging from Camelot and Telefonica to HMRC and Cabinet office
  • 4. You don't need to learn programming to Test... but it helps Mark Winteringham
  • 5. Automation: Time to change our models Iain McCowatt ‘Look at the world through a different pair of lenses every time you have a problem’ www.ministryoftesting.com/2014/05/automation-time-change-models-iain-mccowatt/ Mental models
  • 6. Jim wants to automate checking a service validates a range of payloads correctly Jim builds a script in WebDriver via the UI the service consumes It results in automation that’s slow and brittle Jim continues to tinker with the script It’s too hard! ‘Automator Jim’ knows WebDriver
  • 7. What if Jim knew about a different tool such as JMeter or SOAPUI? ‘We shape our tools and then our tools shape us’ industryweek.com Marshall McLuhan
  • 8. ‘Be promiscuous’ What if Jim isn’t even aware that these tools exist or that he could benefit in learning them in the first place But.. Learn more models, learn more tools
  • 9. What if we as a testing community collectively have limited mental models about automation and are consequently feeding the same limited mental models back to testers like Jim The question
  • 10. Automation workshops/talks in conferences WebDriver/Seleni um, 17 Watir, 1 API, 2 Big Data, 2 Unit Testing, 2 BDD, 5 Monitoring, 2 Security Testing, 1 WebDriver/Selenium Watir API Big Data Unit Testing BDD Monitoring Security Testing Talks and workshops that explicitly talk about an automation tool 5 Popular conferences 2012 – 2015
  • 11. Automation tools in Job specs 67 Jobs roles Keywords: • Developer in test • Automation test engineer Source: cwjobs.co.uk – 23/1/15 Selenium / WebDriver, 57 Cucumber, 22 *unit, 22 QTP, 12 SoapUI/LoadUI, 9 SQL, 6 JBehave, 5 TestNG, 5 Test Complete, 5 Appium, 4 Calabash, 4 Fitnesse Jasmine Karma JMock Fitnesse Capybara Jmeter Rational Watin Visual Studios Ranorex Specflow LoadRunner Webload Siege BurpSuite Rspec Behat Mink EasyMock Espresso
  • 12. What’s so great about WebDriver? It offers limited mental models – Automating through the UI!
  • 13. WebDriver/Seleniu m 53% Watir 3% API 7% Big Data 6% Unit Testing 6% BDD 16% Monitoring 6% Security Testing 3% http://watirmelon.com/2011/06/10/yet-another-software-testing-pyramid/ =/
  • 14. Where are the workshops or requirements for skills in: Monitoring Deployment Test data population Configuration Management Parsing data API Testing Unit testing
  • 15. So what could we do? Look further afield to learn new tools Tinker around with other tools Personal Community Demand more diversity in automation training When writing job roles focus more on the problems that need solving Think more about the problem you want to solve, is your current model enough?
  • 16. Detox ourselves from WebDriver… maybe with a bit of Watir Thank you

Notas do Editor

  1. For those glass half full people out there this isn’t a talk about why WebDriver is good For those glass half empty people it isn’t a talk about why WebDriver is bad This is a talk about Models, Skillsets and a guy called Jim
  2. To begin with this was going to be my talk It was my intention in this talk to make some remarks about automation and how we can do much more than simply automate checks And in doing so I was going to quote from this talk… <Change talk>
  3. Iain’s talk presents how Testers should have multiple mental models about how you could solve a problem with automation. Or as he puts it ‘Look at the world through a different pair of lenses every time you have a problem’. The more mental models you have and the ease in which you can switch between these models can determine how successful your testing might be. But as I revisited the talk there was a part in which he talked about how ‘Tools shape how you test’. I began to form a questions about our testing community Let me introduce my question with an my interpretation of the above quote <change slide>
  4. He could have created a faster more stable test that would have done a better job He has a limited amount of mental models because he only knows how to use one tool Having knowledge of more tools and models could mean Jim could make better choices
  5. How does he learn about tools that are available to him or even realise he could benefit from learning them He would look at what training there is out there and what other testers are doing to solve similar problems
  6. Are conferences ignoring other workshops for other tools? I don’t think so I believe this is a symptom of supply and demand
  7. All the items listed on the right appear in 2% or less of the job roles
  8. Why is WebDriver skill and training so much more prevalent than other tools? Are we fixated with the thinking that all our automation problems can be solved through the automating UI instead others ways like ‘Automator Jim
  9. Based on the evidence in the previous slides it appears we have a very distorted view of what is important and what is not when it comes to automating and if we continue to follow the same path we will still have testers like ‘Automator Jim’ making the same mistakes again and again
  10. Split into personal and community driven goals