The Google Test Automation Conference (GTAC) is an annual test automation conference hosted by Google. 2016 is 10th GTAC. I'll share the most impressive parts of experience sharing & tool I heard in GTAC 2016 in this slide.
5. Subject #1 - Experience Sharing
● Evolution of Business and Engineering
Productivity
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17. Some granular metrics we track
● Changlist to production Latency
● Code coverage
● Presubmit greenness
● Dashboard development
● Test clusters
● Intelligent selection of release candidate
change list
● Release process...
18.
19.
20.
21. Q &A
Test Self-Driving?
Automated test : Manual test =
Machine learing software is better
test in Production?
How much time was presubmit
phase take?
How do we test the test
themselves?
Not yet.
95% : 5%
It will make sense to kind of test
before it hits production.
It take about 10 days, but I want to
say a good 2 or 3 days in the
pre-submit phase
We are getting assurance from
different ways that your software is
behaving correctly.
31. Test Lab - Robo
● Choose Device/
Simulator
● Let you can
do Login
32. Test Lab - Robo
● Provide crawl report
○ Log
○ Screenshot
○ Flowchart
○ Record
33. Test Lab - Run Script on Devices
● Upload apk
& test apk
● Choose Device/
Simulator
34. ● Provide devices report
○ Cases
○ Log
○ Record
Test Lab - Run Script on Devices
35. Test Lab
● Crawler is not very
smart, suggest to use
your own test script to
test
36.
37.
38.
39.
40.
41.
42.
43.
44.
45.
46.
47.
48.
49.
50.
51.
52. ABOUT ME
Q &A
What should small startup needs to
start instroducing automation?
Firebase support geo/
real purchases/ memory leak tests ?
Firebase support Stress/
Performance/ Security tests?
How to deal with privacy data ?
Keep pre-lauch report for every
version submitted?
if you can unit test, unit test it.
No, stay tuned/ in our roadmap.
Yes, but you need to write those test.
It will look for patterns for privacy
data and scrumb them out.
All tests are fresh install.
No. Because law...
53. ABOUT ME
Q &A
Firebase v.s. Crashlytics, Crittercism
Firebase test with Game app?
再更智能一點嗎?像是撒 seeding
Support Penetration testing?
Support Wi-Fi/ Bluetooth connected
device test?
We have a lot of people who also
continue to use Crashlytics side by
side.
Games has been a very challenging
thing for us.
Under working.
We did a whole bunch of basic
security crawls.
Not yet. We don't have good
hardware solutions.