SlideShare uma empresa Scribd logo
1 de 23
What’s in the cloud for testing?
The sky is the limit

Edwin van Loon, Valid

www.eurostarconferences.com

@esconfs
#esconfs
Introduction Edwin van Loon
• ISEB Practitioner

• Lean Six sigma green belt
• Almost 15 years of experience
within different testing roles
• Living in Belgium
• Working in the Netherlands

edwinvanloon
Edloon
Edwin.van.loon@valid.nl
Cloud
Introduction of the Euro coin
Millennium change

Agile manifesto
ISO SQuaRE (25010)
Web based development
Regulatory compliance
Model based testing

Risk based testing
Test Certification
Vote:
What will be the impact of the cloud on our testing profession?

URL: http://piepe.co
Agenda

• The cloud in general
• The cloud and testing
• The cloud and it‟s possibilities
• Testing the cloud
What’s in the cloud for testing
Cloud layers

Applications

Runtime
Security
Databases
Servers
Network
Storage
Hardware
Virtualization

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
Cloud layers

Applications

Runtime
Security
Databases
Servers
Network
Storage
Hardware
Virtualization

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
Cloud layers

Applications

Runtime
Security
Databases
Servers
Network
Storage
Hardware
Virtualization

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
History of the Cloud

16.3% compound
annual growth rate
through

Early SaaS
adaptors

1997

2000

2002

2004

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing

2006

2008

2010

2012 -2015
“In the last 7 years, do you know how many times I have lost any personal
data?  Zero.

Announcement Cloud in 1997

Do you know how many times I have backed up my computer?  Zero…
I have computers at Apple, at NeXT, at Pixar, and at home. I walk up at any
of them and log in as myself, it goes over the network, finds my home
directory on a server, and I got my stuff where ever I am…
Carrying around these non-connected computers or computers with tons of
data and state in them is Byzantine by comparison.”

Triple A: Any time, Any place, Any device, (Any data)
Steve jobs at WWDC 1997 (Apples Worldwide Developers Conference)
(http://www.youtube.com/watch?v=3LEXae1j6EY)

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
Advantages
1. Time to market
2. Scalability
3. Reduction of IT-costs

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
Cloud testing
• a form of software testing in which
web applications use cloud computing
environments to simulate real-world user
traffic.
en.wikipedia.org/wiki/Cloud_testing

• allows you to use simulated web traffic to „load
test‟ a website or web application with a
flexible, scalable and affordable testing
environment.
www.iseb-istqbsoftwaretesting.co.uk/video-introduction-to-cloud-testing

CloudCloud Possibilities
and Testing
Cloud General Testing the Cloud
Cloud test tools
Test tools:
- Functional and
Performance testing
- Cross browser
testing
- Test management
Runtime
Security
Databases
Servers
Network
Storage
Hardware
Virtualization

CloudCloud Possibilities
and Testing
Cloud General Testing the Cloud
History of the Cloud

16.3% compound
annual growth rate
through

Early SaaS
adaptors

1997

2000

2002

2004

CloudCloud Possibilities
and Testing
Cloud General Testing the Cloud

2006

2008

2010

2012 -2015
Advantages cloud test tools
• Accessible at Any place, Any time, Any device
• Scalability
• No infrastructural constraints
• No geographical constraints
• Low time to market
• Temporary contract / low costs
•

No installation

•

Availability

•

Usability

•

Possibilites for endurance testing

•

………

CloudCloud Possibilities
and Testing
Cloud General Testing the Cloud
Demo

CloudCloud Possibilities
and Testing
Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
Cloud General Testing the Cloud
Test layers

Testing as a
Service

Test tools

Test portal
Templates
Standards
KPI‟s
Virtual testmachines
Test servers
Network types
(latency)

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
TaaS (or Quality as a Service)
Customer
Tools

Operational
Data

Software and
Processes

Process
Data

Test
machines

Infrastructure

Test
tools

Test
results

Portal

On Premise
Software

Metrics /
KPI‟s

Test
machines
Test Employees and Processes

Service provider

Off Premise
Software
Test Service Level agreement
• Effort driven:
• Number of test cycles per period (including peak and off-peak)
• Through put time (test execution, test preparation, etc.)
• Test or QA activities in general
• Creation of Reports (operational and tactical)

• Result driven:
• Test coverage (quality level) or effort
• Defect detection percentage (DDP)

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
Testing the cloud
•
•
•
•
•
•
•
•
•

Compliancy statement
Security testing
Availability
Test of cost models
Test of migration
Fixed release dates
Connectivity testing of hybrid clouds.
Juridical aspects of the cloud
Availability of cloud solutions:
• Test of vendors (Cloudsleuth)
• Two internet providers
• Two instances / multi-region

Cloud General Testing the Cloud
CloudCloud Possibilities
and Testing
Resume
• The cloud is a TaaS enabler
• The cloud will change the expectation of users
regarding quality
• Cloud services require different test approach
• Cloud test tools allow test teams to:
• avoid high costs on investments
• execute test global tests
• The cloud allows the test community to cooperate
and connect
The cloud has a already a high impact on
Software Testing
…….. and the impact will become huge
Stay Ahead

Mais conteúdo relacionado

Mais procurados

Ibm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinalIbm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinal
aspyker
 
DockerCon SF 2015: Resilient Routing and Discovery
DockerCon SF 2015: Resilient Routing and DiscoveryDockerCon SF 2015: Resilient Routing and Discovery
DockerCon SF 2015: Resilient Routing and Discovery
Docker, Inc.
 

Mais procurados (20)

European SharePoint Conference - TH3
European SharePoint Conference - TH3European SharePoint Conference - TH3
European SharePoint Conference - TH3
 
My session slides from unityConnect 2016 in Haarlem
My session slides from unityConnect 2016 in HaarlemMy session slides from unityConnect 2016 in Haarlem
My session slides from unityConnect 2016 in Haarlem
 
Datadog- Monitoring In Motion
Datadog- Monitoring In Motion Datadog- Monitoring In Motion
Datadog- Monitoring In Motion
 
56k.cloud intro and pitch deck
56k.cloud intro and pitch deck56k.cloud intro and pitch deck
56k.cloud intro and pitch deck
 
Introduction to Cloudify for OpenStack users
Introduction to Cloudify for OpenStack users Introduction to Cloudify for OpenStack users
Introduction to Cloudify for OpenStack users
 
End-to-end test automation with Endtest.dev
End-to-end test automation with Endtest.devEnd-to-end test automation with Endtest.dev
End-to-end test automation with Endtest.dev
 
Ibm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinalIbm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinal
 
Cloudsolutionday 2016: DevOps workflow with Docker on AWS
Cloudsolutionday 2016: DevOps workflow with Docker on AWSCloudsolutionday 2016: DevOps workflow with Docker on AWS
Cloudsolutionday 2016: DevOps workflow with Docker on AWS
 
Session Slides from DEVintersection Europe
Session Slides from DEVintersection EuropeSession Slides from DEVintersection Europe
Session Slides from DEVintersection Europe
 
DevOps with AWS in 2016
DevOps with AWS in 2016DevOps with AWS in 2016
DevOps with AWS in 2016
 
DevOps environment with OpenStack and NetApp
DevOps environment with OpenStack and NetAppDevOps environment with OpenStack and NetApp
DevOps environment with OpenStack and NetApp
 
NetflixOSS Meetup S6E2 - Spinnaker, Kayenta
NetflixOSS Meetup S6E2 - Spinnaker, KayentaNetflixOSS Meetup S6E2 - Spinnaker, Kayenta
NetflixOSS Meetup S6E2 - Spinnaker, Kayenta
 
Monitoring microservices platform
Monitoring microservices platformMonitoring microservices platform
Monitoring microservices platform
 
Measure and Increase Developer Productivity with Help of Serverless at JCON 2...
Measure and Increase Developer Productivity with Help of Serverless at JCON 2...Measure and Increase Developer Productivity with Help of Serverless at JCON 2...
Measure and Increase Developer Productivity with Help of Serverless at JCON 2...
 
Industrial Light & Magic
Industrial Light & MagicIndustrial Light & Magic
Industrial Light & Magic
 
Microservices architecture pitfalls
Microservices architecture pitfallsMicroservices architecture pitfalls
Microservices architecture pitfalls
 
Is Orchestration the Next Big Thing in DevOps
Is Orchestration the Next Big Thing in DevOpsIs Orchestration the Next Big Thing in DevOps
Is Orchestration the Next Big Thing in DevOps
 
Serverless security - how to protect what you don't see?
Serverless security - how to protect what you don't see?Serverless security - how to protect what you don't see?
Serverless security - how to protect what you don't see?
 
CS80A Foothill College Open Source Talk
CS80A Foothill College Open Source TalkCS80A Foothill College Open Source Talk
CS80A Foothill College Open Source Talk
 
DockerCon SF 2015: Resilient Routing and Discovery
DockerCon SF 2015: Resilient Routing and DiscoveryDockerCon SF 2015: Resilient Routing and Discovery
DockerCon SF 2015: Resilient Routing and Discovery
 

Destaque

David P Brown - Phoenix ATB 2014-11-18
David P Brown - Phoenix ATB 2014-11-18David P Brown - Phoenix ATB 2014-11-18
David P Brown - Phoenix ATB 2014-11-18
David P Brown
 
QA Anchor advocate for quality
QA Anchor advocate for qualityQA Anchor advocate for quality
QA Anchor advocate for quality
Rob Swoboda
 
T12 Exploitation Testing Presentation 1.2
T12   Exploitation Testing   Presentation 1.2T12   Exploitation Testing   Presentation 1.2
T12 Exploitation Testing Presentation 1.2
Edwin Loon, van
 
What do viewers want? A look at viewer behaviors and wants.
What do viewers want? A look at viewer behaviors and wants. What do viewers want? A look at viewer behaviors and wants.
What do viewers want? A look at viewer behaviors and wants.
Matthew Pierce
 
Boost your testing power with Exploration
Boost your testing power with ExplorationBoost your testing power with Exploration
Boost your testing power with Exploration
Huib Schoots
 

Destaque (20)

David P Brown - Phoenix ATB 2014-11-18
David P Brown - Phoenix ATB 2014-11-18David P Brown - Phoenix ATB 2014-11-18
David P Brown - Phoenix ATB 2014-11-18
 
What's Comparable?
What's Comparable?What's Comparable?
What's Comparable?
 
Learning from mistakes with BDD
Learning from mistakes with BDDLearning from mistakes with BDD
Learning from mistakes with BDD
 
A story on failure
A story on failureA story on failure
A story on failure
 
How to Break your App - Workshop - Testbash 2015
How to Break your App - Workshop - Testbash 2015How to Break your App - Workshop - Testbash 2015
How to Break your App - Workshop - Testbash 2015
 
QA Anchor advocate for quality
QA Anchor advocate for qualityQA Anchor advocate for quality
QA Anchor advocate for quality
 
Mobile Testing
Mobile TestingMobile Testing
Mobile Testing
 
T12 Exploitation Testing Presentation 1.2
T12   Exploitation Testing   Presentation 1.2T12   Exploitation Testing   Presentation 1.2
T12 Exploitation Testing Presentation 1.2
 
MIR
MIRMIR
MIR
 
Introduction to ExtJS and its new features
Introduction to ExtJS and its new featuresIntroduction to ExtJS and its new features
Introduction to ExtJS and its new features
 
Synerzip Agile Software Development
Synerzip Agile Software DevelopmentSynerzip Agile Software Development
Synerzip Agile Software Development
 
Develop your inner tester
Develop your inner tester Develop your inner tester
Develop your inner tester
 
One more question... eurostar 2013
One more question...   eurostar 2013One more question...   eurostar 2013
One more question... eurostar 2013
 
What do viewers want? A look at viewer behaviors and wants.
What do viewers want? A look at viewer behaviors and wants. What do viewers want? A look at viewer behaviors and wants.
What do viewers want? A look at viewer behaviors and wants.
 
Startups And Software Testing
Startups And Software TestingStartups And Software Testing
Startups And Software Testing
 
Boost your testing power with Exploration
Boost your testing power with ExplorationBoost your testing power with Exploration
Boost your testing power with Exploration
 
Mike Cottmeyer - How to Get Started with Agile
Mike Cottmeyer - How to Get Started with AgileMike Cottmeyer - How to Get Started with Agile
Mike Cottmeyer - How to Get Started with Agile
 
Remaining relevant - July TMF
Remaining relevant - July TMFRemaining relevant - July TMF
Remaining relevant - July TMF
 
A taste of Exploratory Testing
A taste of Exploratory TestingA taste of Exploratory Testing
A taste of Exploratory Testing
 
50 Tips (Yes 50!) for Video
50 Tips (Yes 50!) for Video50 Tips (Yes 50!) for Video
50 Tips (Yes 50!) for Video
 

Semelhante a EuroSTAR presentation: What's in the cloud for testing, the sky is the limit

Implementing DevOps at Scale Using Dynamic Environments
Implementing DevOps at Scale Using Dynamic EnvironmentsImplementing DevOps at Scale Using Dynamic Environments
Implementing DevOps at Scale Using Dynamic Environments
Sauce Labs
 
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
Vitor Tomaz
 
TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6
Sravanthi N
 

Semelhante a EuroSTAR presentation: What's in the cloud for testing, the sky is the limit (20)

Edwin van Loon - What's in the Cloud for Testing - EuroSTAR 2012
Edwin van Loon - What's in the Cloud for Testing - EuroSTAR 2012Edwin van Loon - What's in the Cloud for Testing - EuroSTAR 2012
Edwin van Loon - What's in the Cloud for Testing - EuroSTAR 2012
 
Testing Applications—For the Cloud and in the Cloud
Testing Applications—For the Cloud and in the CloudTesting Applications—For the Cloud and in the Cloud
Testing Applications—For the Cloud and in the Cloud
 
Modernizing Testing as Apps Re-Architect
Modernizing Testing as Apps Re-ArchitectModernizing Testing as Apps Re-Architect
Modernizing Testing as Apps Re-Architect
 
Cloud Performance Testing with LoadRunner
Cloud Performance Testing with LoadRunnerCloud Performance Testing with LoadRunner
Cloud Performance Testing with LoadRunner
 
[India Merge World Tour] Electric Cloud
[India Merge World Tour] Electric Cloud[India Merge World Tour] Electric Cloud
[India Merge World Tour] Electric Cloud
 
Cloud Testing
Cloud TestingCloud Testing
Cloud Testing
 
LRITC introduction
LRITC introductionLRITC introduction
LRITC introduction
 
implanting DevOps at scale using dynamic test environments
implanting DevOps at scale using dynamic test environmentsimplanting DevOps at scale using dynamic test environments
implanting DevOps at scale using dynamic test environments
 
Implementing DevOps at Scale Using Dynamic Environments
Implementing DevOps at Scale Using Dynamic EnvironmentsImplementing DevOps at Scale Using Dynamic Environments
Implementing DevOps at Scale Using Dynamic Environments
 
Cloud Testing - What is Cloud testing and How to test on the cloud.pdf
Cloud Testing - What is Cloud testing and How to test on the cloud.pdfCloud Testing - What is Cloud testing and How to test on the cloud.pdf
Cloud Testing - What is Cloud testing and How to test on the cloud.pdf
 
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
 
Digital Assurance Center of Excellence
Digital Assurance Center of ExcellenceDigital Assurance Center of Excellence
Digital Assurance Center of Excellence
 
Web Performance Testing
Web Performance TestingWeb Performance Testing
Web Performance Testing
 
Cloud Testing by Suganya M
Cloud Testing by Suganya MCloud Testing by Suganya M
Cloud Testing by Suganya M
 
TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6
 
Continuous Integration with Amazon ECS and Docker
Continuous Integration with Amazon ECS and DockerContinuous Integration with Amazon ECS and Docker
Continuous Integration with Amazon ECS and Docker
 
Apresentação Microsoft Azure no SASPI 5
Apresentação Microsoft Azure no SASPI 5Apresentação Microsoft Azure no SASPI 5
Apresentação Microsoft Azure no SASPI 5
 
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
 Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S... Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
 
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
Frank Cohen - Are We Ready For Cloud Testing - EuroSTAR 2010
 
Cerberus : Framework for Manual and Automated Testing (Web Application)
Cerberus : Framework for Manual and Automated Testing (Web Application)Cerberus : Framework for Manual and Automated Testing (Web Application)
Cerberus : Framework for Manual and Automated Testing (Web Application)
 

Último

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 

EuroSTAR presentation: What's in the cloud for testing, the sky is the limit

  • 1. What’s in the cloud for testing? The sky is the limit Edwin van Loon, Valid www.eurostarconferences.com @esconfs #esconfs
  • 2. Introduction Edwin van Loon • ISEB Practitioner • Lean Six sigma green belt • Almost 15 years of experience within different testing roles • Living in Belgium • Working in the Netherlands edwinvanloon Edloon Edwin.van.loon@valid.nl
  • 3. Cloud Introduction of the Euro coin Millennium change Agile manifesto ISO SQuaRE (25010) Web based development Regulatory compliance Model based testing Risk based testing Test Certification
  • 4. Vote: What will be the impact of the cloud on our testing profession? URL: http://piepe.co
  • 5. Agenda • The cloud in general • The cloud and testing • The cloud and it‟s possibilities • Testing the cloud What’s in the cloud for testing
  • 9. History of the Cloud 16.3% compound annual growth rate through Early SaaS adaptors 1997 2000 2002 2004 Cloud General Testing the Cloud CloudCloud Possibilities and Testing 2006 2008 2010 2012 -2015
  • 10. “In the last 7 years, do you know how many times I have lost any personal data?  Zero. Announcement Cloud in 1997 Do you know how many times I have backed up my computer?  Zero… I have computers at Apple, at NeXT, at Pixar, and at home. I walk up at any of them and log in as myself, it goes over the network, finds my home directory on a server, and I got my stuff where ever I am… Carrying around these non-connected computers or computers with tons of data and state in them is Byzantine by comparison.” Triple A: Any time, Any place, Any device, (Any data) Steve jobs at WWDC 1997 (Apples Worldwide Developers Conference) (http://www.youtube.com/watch?v=3LEXae1j6EY) Cloud General Testing the Cloud CloudCloud Possibilities and Testing
  • 11. Advantages 1. Time to market 2. Scalability 3. Reduction of IT-costs Cloud General Testing the Cloud CloudCloud Possibilities and Testing
  • 12. Cloud testing • a form of software testing in which web applications use cloud computing environments to simulate real-world user traffic. en.wikipedia.org/wiki/Cloud_testing • allows you to use simulated web traffic to „load test‟ a website or web application with a flexible, scalable and affordable testing environment. www.iseb-istqbsoftwaretesting.co.uk/video-introduction-to-cloud-testing CloudCloud Possibilities and Testing Cloud General Testing the Cloud
  • 13. Cloud test tools Test tools: - Functional and Performance testing - Cross browser testing - Test management Runtime Security Databases Servers Network Storage Hardware Virtualization CloudCloud Possibilities and Testing Cloud General Testing the Cloud
  • 14. History of the Cloud 16.3% compound annual growth rate through Early SaaS adaptors 1997 2000 2002 2004 CloudCloud Possibilities and Testing Cloud General Testing the Cloud 2006 2008 2010 2012 -2015
  • 15. Advantages cloud test tools • Accessible at Any place, Any time, Any device • Scalability • No infrastructural constraints • No geographical constraints • Low time to market • Temporary contract / low costs • No installation • Availability • Usability • Possibilites for endurance testing • ……… CloudCloud Possibilities and Testing Cloud General Testing the Cloud
  • 17. CloudCloud Possibilities and Testing Cloud General Testing the Cloud
  • 18. Test layers Testing as a Service Test tools Test portal Templates Standards KPI‟s Virtual testmachines Test servers Network types (latency) Cloud General Testing the Cloud CloudCloud Possibilities and Testing
  • 19. TaaS (or Quality as a Service) Customer Tools Operational Data Software and Processes Process Data Test machines Infrastructure Test tools Test results Portal On Premise Software Metrics / KPI‟s Test machines Test Employees and Processes Service provider Off Premise Software
  • 20. Test Service Level agreement • Effort driven: • Number of test cycles per period (including peak and off-peak) • Through put time (test execution, test preparation, etc.) • Test or QA activities in general • Creation of Reports (operational and tactical) • Result driven: • Test coverage (quality level) or effort • Defect detection percentage (DDP) Cloud General Testing the Cloud CloudCloud Possibilities and Testing
  • 21. Testing the cloud • • • • • • • • • Compliancy statement Security testing Availability Test of cost models Test of migration Fixed release dates Connectivity testing of hybrid clouds. Juridical aspects of the cloud Availability of cloud solutions: • Test of vendors (Cloudsleuth) • Two internet providers • Two instances / multi-region Cloud General Testing the Cloud CloudCloud Possibilities and Testing
  • 22. Resume • The cloud is a TaaS enabler • The cloud will change the expectation of users regarding quality • Cloud services require different test approach • Cloud test tools allow test teams to: • avoid high costs on investments • execute test global tests • The cloud allows the test community to cooperate and connect The cloud has a already a high impact on Software Testing …….. and the impact will become huge

Notas do Editor

  1. Op een laag pitje – At low ebb
  2. Richter magnitude scale representing the energy scale of an earthquake 0 – 6: Micro to Moderate -> Happens often and no or less impact/damageLow impact. Perhaps a small change in specific testing approach, but nothing to worry about.6,1 – 9: Strong -> Happens a few times per year. Damage within a local area. Impact but not killing. High impact. It offers opportunities to optimize our way of testing and our test tooling. Changes will occur but no change in image or fundaments.9,1 – 10: Huge impact, happens a few times in a working-life time. Killing impact on software testing Huge impact. It will change the fundaments and image of the testing profession, like the millennium change did.Regularity -> conformance to standards, policies or law
  3. - What’s the cloud in general – What is the history of the cloud- The cloud and testing – What’s is the cloud currently offering to testing What are the possibilities of the cloud for our testing profession according to me. At last providing some special attention points on testing of cloud solutions.
  4. Layers also called (article Chris Poelker in Computerworld 24 May 2011);Infrastructure cloud (abstracts applications from servers and servers from storage)Content cloud; -> Abstracts data from applicationsInformation cloud ->Abstracts access from clients to data
  5. After the internet bubble Amazon modernized their data centers, because they were only using 10% of the total capacity at any one time.Also triggered by the extending of computer networks to meet the Black Friday peak load.First SaaS solutions were CRM related (like SalesForce.com, Inntact and Salesnet)Amazon S3 (Simple Storage Service)-> first publicly available web serviceGoogle apps (2006 – Gmail) – 2008 site creationMicrosoft Azure (2009) -> SQL Azure Relational Database / Since june 2012 Azure also offers additional services on infrastructural level (like secure site to site network connectitvity)Gartner 2008 ->  "organizations are switching from company-owned hardware and software assets to per-use service-based models" Compound annual growth of number of licenses – average growth over a certain period meaning 2012 – 2015 a real growth of almost 50% (and from 2007 of 400%)
  6. In 1960 John McCarty (an americ computer scientist) opined that computing may someday be organized as public utility
  7. Terremarkdatacenter at Schiphol – 2500 square-meterIBM 576.000 square meter facility Langfang China (6.5 times the size of the RAI building)Yahoo green data center inspired on Chicken Coops - 40 percent less energy than typical data centers- Cost example … about 60 euro per month (2880 euro for 48 months) (Storage, Database, Transactions and Bandwidth …. Average server -> (1500 – 8000 euro) 4500 euro + 2100 euro power for 48 months = 6700 euro
  8. Pricing practitestfrom 15 – 45 dollar per month per userSpiraTest – 260 dollar for 20 concurrent users per monthLoadstorm one load test of 5,000 concurrent users – 199 dollar – 700000 dollar for loadrunner forVuserinhouselicenseand controller for 1 year(In-house Controller and 15K VUD’s = £60k)
  9. Simulation of real conditions—from thousands of local users to millions of concurrent and geographically dispersed users.
  10. Layersalsocalled (article Chris Poelker in Computerworld 24 May 2011);Infrastructturecloud (abstracts applicationsfrom servers and servers from storage)Content cloud; Abstracts data fromapplications)Information cloudl Abstracts access fromclientsto data)
  11. Multi tennent -> Oplossingen voor meerdere klanten.
  12. Windows Azurelaunchedinfrastructureas a Service for support of migrations.Juridical: Patriot: Any data which is housed, stored or processed by a company, which is a U.S. based company or is wholly owned by a U.S. parent company, is vulnerable to interception and inspection by U.S. authorities. Compliancy: Payment Card Industry Data Security Standard (PCI DSS)Good Automated Manufacturing Practice (GAMP) 5SOx (Sarbanes Oxley – after Enron)SAS 70auditing standard