An assessment of a test tool migration for a client that had invested in HP Business Process Testing and QuickTest Professional and were looking at open source alternatives as they sought to improve their cross browser testing capability. Analysis from January 2011.

1. Test Tool
Migration Approach
Systems make it possible …
…People make it happen

2. How to reduce the risk of platform difference defects cost effectively?
• Cross-browser testing
• IE declining in share
• FireFox flat
• Chrome increasing
• Multiple OS combinations
• Windows still dominant
• Mobile technologies
• OSX and Linux
Systems make it possible …
…People make it happen

3. • Leverage existing pack and manually test browser combinations
• Uses existing portal automation investment
• Small scope of manual tests based on navigation
• Costs increase as the pack and browser combination grows
• Implement a multi-platform automation tool
• Focus on new functionality first
• Transition away from QTP as the portal changes
• High test coverage and a single skillset required
• Hybrid automated approach
• Maintain the existing portal pack in the medium term
• New capability delivered using a multi-platform tool
• Create a subset pack for the portal to run across platforms
Systems make it possible …
…People make it happen

4. Automation Effort
3000
2500
2000
Effort / QTP + Manual
1500
Man Days New Tool
Hybrid
QTP*
1000
500
0
6000 8000 10000
* IE and FireFox only
Number of Automated Test Cases
Systems make it possible …
…People make it happen

5. • Platforms
• OS independent
• IE, FireFox, Chrome, Safari
• Mobile support via SDKs e.g. Android
• Developments – release 2.0
• WebDriver and Selenium
• Release 2.0 will bring improvements in robustness
• Object recognition
• AJAX synchonisation improvement
• Concern over IDE changes – technical resources needed
• Awaiting final release date
Systems make it possible …
…People make it happen

6. • Platforms
• OS independent
• IE, FireFox, Chrome, Safari, Opera (any JavaScript-compliant browser)
• Mobile support e.g Android
• Highlights
• Ease of development benefits
• Better support for IE execution speed due to Selenium Xpath issues
• Script robustness benefits around popups and multiple sites
• Small development community
• Development addition of object repository-type functionality
• Used by Indian offshore organisations e.g Accenture, Deloitte
Systems make it possible …
…People make it happen

7. • Platforms
• Windows clients only
• IE and FireFox
• Mobile support with commercial plugins
• Highlights
• Ease of use with productised framework
• Can be used by non-programmers via BPT
• Focused on Windows technologies so cross platform challenges
• Has introduced Xpath usage in QTP 11 but no browser-independent support
• Restricted to VBScript development
• Large user and support community
Systems make it possible …
…People make it happen

8. • Agree browser and OS support strategy for automation
• Collaborate on comparison model
• Agree automation tool approach
• Recommend tools evaluation using Selenium 2.0 and Sahi
• Define automation team structure and skills required
Systems make it possible …
…People make it happen

9. QUESTIONS &
FEEDBACK
?
Systems make it possible …
…People make it happen