Mastering the Art of Mobile Testing by Akshita Puram

1. Mastering the Art of Mobile Testing
Akshita Puram | QAortheHighway 2019
Follow me
@AkshitaDP
Waiting?
What percent of a
watermelon is water?
Go to airhorner.com

2. About Myself
Work |
Education |
Personal |
Today | Automated testing tools and test management
solutions for QA engineers and developers
Dance, indoor rowing, mother of two future mobile testers
@AkshitaDP

3. Go to Menti.com | Enter Code: 78-02-82
78-02-82

4. Go to Menti.com | Enter Code: 78-02-82

5. Mobile is taking over all aspects of our lives.
5
‘Super Apps’
@AkshitaDP

6. Changing Landscape for Mobile Development
What we want from our mobile device?WHAT
HOWHow we consume information from mobile?
Ability to communicate, shop online, order
rides, get food delivery, and pay for
anything
Native app vs. mobile web vs.
progressive web apps, cross-platform
growth
@AkshitaDP

7. Creating Great Software By Balancing the “Iron Triangle”
Cost
@AkshitaDP
Automation / CI-CD /
DevOps
Shifting Team
Dynamics
Product
Complexity
Release Cycles Months ->
Weeks -> Days -> Hours
Proliferation of Devices
Standardization to
Achieve Velocity

8. Mastering the Art of Mobile Testing
Key Mobile Automation Features
Three Mindset Shifts
Test Automation Framework
Mobile Test Automation In Practice
01
02
03
04
8
Automated

9. Go to Menti.com | Enter Code: 78-02-82

10. Integrating test into a continuous process.
10
DeployTestBuild
Testing is in the middle of the storm.
@AkshitaDP

11. Proprietary & Confidential
11
Three Mindset Shifts

12. 12
Mindset Shift #1
Anyone can create and run an automated mobile test.
@AkshitaDP

13. The barriers to automation is high for manual testers.
said they have lack of skills and
experienced test automation
resources
@AkshitaDP
46%
said they don't have the
right automation tools 42%

14. Automation is a must-have skill for mobile testers.
14
@AkshitaDP
Knowledge or experience of
automation test tools,
specifically Selenium, is a PLUS.
Required knowledge
of Appium, Selenium
and Java, Perfecto,
Seetest, Agile.
At least 2 years of experience in
Mobile Automation Testing.
Knowledge or experience of automation
test tools, specifically Selenium, is a PLUS.
Prefer latest release of Appium
being utilized in the
current/most recent project
Should have been worked on Mobile Application
testing using any automation framework (Appium,
Calabash, etc) for the past 4 years.Ability to contribute to test
automation frameworks
Source: LinkedIn Job Descriptions

15. Mind the gap
with scriptless
automation.
15
ResourceCosts
Quantity
Demand for
Automation
Supply of
resources
Gap for
automation
resources
@AkshitaDP

16. Lower the barriers to
entry for automation
16
Scriptless Techniques
@AkshitaDP
Record and Replay
Keyword Driven Testing

17. Lower the barriers to
entry for automation
17
Scriptless Techniques
@AkshitaDP
Record and Replay
Keyword Driven Testing
Test Visualizer

18. Real Devices vs. Emulators
18

19. 19
Mindset Shift #2
Mobile web technologies will overtake native apps.
@AkshitaDP

20. Consumer app fatigue is
on the rise.
People don’t want to
download yet another
app
People are struggling to
manage data storage on
mobile devices
20
@AkshitaDP

21. Mobile web apps will replace native apps.
More mobile web app
monthly visitors than
native apps
@AkshitaDP
2.2x
of consumer-facing apps
replaced with progressive
web apps
50%

22. Progressive Web Apps (PWA) Examples
22
50 kB zipped and loads in less than three
seconds — on 2G networks
only 2.8 MB for core experience
Increased user time by 40 percent and more
user-generated ad revenue
@AkshitaDP

23. Extensive Test Reuse
@AkshitaDP
Code language
dependent on
platform
One codebase to
manage for
cross-platforms

24. 24
Mindset Shift #3
Mobile testing at the UI and API layer is a must.
@AkshitaDP

25. Go to Menti.com | Enter Code: 78-02-82

26. Where Testing Is Going
26
80% of testing
is manually
done today.
Most of it on
the UI.
At least 50% of
testing should be
automated testing
at the API layer.
API
UI
Manual
API
UI
Manual
Now Future
Exploratory testing is
still important!

27. The UI presents “objects” retrieved an automation tool
27
Search bar
PriceProduct Title
Logo Image
https://www.bestbuy.com/site/fitbit-versa-peach-rose-gold/6203312
@AkshitaDP

28. UIs are connected to several APIs to deliver several services
/api/1.0/product/summaries
/api/1.0/pick-up/locations /api/1.0/product/pricing
/api/1.0/account/login
Twitter APIFacebook API
Google Maps API
@AkshitaDP

29. 29
UI 2
Login
Products Pricing
Payment
There are a lot of
connections…
Google
Twitter
Facebook
User
Payment
History
Order
History Location
SummariesImages Recommend 3rd Party A.I.
…that all need to be
tested
@AkshitaDP

30. Increasing Mobile Test Coverage and Reducing Risk
UI Layer
API Layer
• Robust object recognition
• Adapt tests based on device
• Ideal for crucial user workflows
• Access to mobile API calls
• Built-in security testing scans
• Ideal for data testing and minor
workflows
@AkshitaDP
• User Experience
• Layout Errors
• Presentation of
Data In The UI
• Business Logic
• Boundary Errors
• Data Variants
Focus
Focus

31. Knowing the top mobile testing features an
automation tool should have will help you be a
better and faster mobile tester.
New Digital Paradigm:
We are only as good as the robot.
@AkshitaDP

32. Mobile Testing Features Across Devices
Mobile Gestures
Record multi-touch gestureslikeswipe, pinch, drag,
drop,orscroll ononedevice andplay thembackin
theexactsamemanner across multiple devices.
Adapting test to a specific device
• Flexible layouts
• Different hierarchy of objects
• Coordinate-based actions
@AkshitaDP

33. Mobile Testing Features in an IoT World
Geolocation Testing
Simulate GPS sensor values and create mobile tests to
check geolocation applications and verify the
application processes the data correctly.
Data from Sensors
Obtain data of various sensors of your device from
tests and test if your mobile app reacts to updated
sensor data correctly.
@AkshitaDP

34. Test Automation Framework
3
4
@AkshitaDP

35. A Robust, Easy-to-Use UI Test Automation Framework
Desktop Web Mobile
Any UI
Object
Recognition
Test Creation Techniques Maintenance Cross-Platform and DistributedReporting
Developer QA Engineer Manual Tester
Continuous Learning
Continuous Testing
+
+
FastCreation
EasyMaintenance
ScalableExecution
Integrations
• How to create a scriptless test
• What to validate and how
• How to update a
scriptless test visually
without re-recording
• How to view results and
fix checkpoints
• How to share results
Mindset #1 - Anyone can create and run an automated mobile test.
Mindset #2
Mobile web
technologies will
overtake native apps
• How to run API tests
• How to run tests on multiple
devices and applications.
Mindset #3
Mobile testing at the UI
and API layer is a must.
@AkshitaDP

36. A Robust, Easy-to-Use UI Test Automation Framework
Desktop Web Mobile
Any UI
Object
Recognition
Test Creation Techniques Maintenance Cross-Platform and DistributedReporting
Record and Playback
Gherkin (NEW)
Scripting languages
(JavaScript, Python, VBScript)
Snapshots
Detailed Logs
Export Results
Intelligent
Updates
Name
Mapping
Repository
Developer QA Engineer Manual Tester
Continuous Learning
Continuous Testing
+
+
Property-
Based
Recognition
Visual
Recognition
(Image,
AI-OCR)
+
Browser Loop
Device Loop
Virtual Machines
Keyword-Driven
FastCreation
EasyMaintenance
ScalableExecution
Integrations
Data-Driven
@AkshitaDP

37. Mobile Testing Tool Vendors
40
Outsource Vendors
• Applause
• Dynatrace
• Experitest
• Mobile Labs
• Perfecto Mobile
• Syntel
• Tata Consultancy
• Tech Mahindra
• Wipro
Functional Automation
• Adobe
• Calabash
• Dynatrace
• Experitest
• HP
• Perfecto Mobile
• Sauce Labs
• SmartBear Software
• Soasta
• Testplant
• Xamarin (Microsoft)
Performance Testing
• BlazeMeter
• CA Technologies
• Compuware
• Dynatrace
• Experitest
• HPE
• IBM
• Parasoft
• Perfecto Mobile
• SmartBear Software
• Soasta
• TestPlant
• Xamarin (Microsoft)
Device Management
• Applause
• BlazeMeter
• Cigniti Technologies
• DMI
• HCL Technologies
• Infosys
• SmartBear Software
• Soasta
• Testplant
• Xamarin (Microsoft)
Source: Forrester Mobile App Quality 2017

38. Coverage
Scale
Security
Speed
Quality
Cost
Test Automation
Extensive Reuse
API and UI Layers
Business Needs Impact on BusinessOpportunity
Mastering the Art of Mobile Testing
The Iron Triangle ResultThree Mindset Shifts

39. Thank You
SmartBear.com/TestComplete
akshita.puram@smartbear.com
Linkedin.com/in/AkshitaDP
@AkshitaDP
Medium.com/AkshitaDPM

40. Proprietary & Confidential
44