Are you wondering how to write automated tests for your shiny new iOS application? Is it even possible? Maybe you're sick of manually running the same test scenarios over and over and over… are you developing blisters on your fingertips? In his talk, Dante Briones--Principal Consultant for Cochiva--will give a broad overview of the automated testing tools currently available for iOS, and share some hard-won secrets of iOS app test automation using NativeDriver -- an implementation of the WebDriver API that can drive *native* applications running on iOS or Android. You'll see how to integrate NativeDriver into your iOS app, allowing you to write functional tests in Java. You'll learn how to execute those tests at the command line and how to integrate those tests into a continuous integration tool like Jenkins. You'll hear lots of tips about how to improve your chances for a successful adoption of a functional testing suite.

1. The Restless Are
Getting Native
Lessons Learnt While Automating an iOS App
Dante Briones
Principal Consultant
Cochiva
Friday, March 23, 12

2. What makes a good
automation tool?
Friday, March 23, 12

3. I want tests that:
• are robust
• are easy to maintain
• clearly express intent
• are written in a real programming language
• run in any environment
• run on simulator or real device
Friday, March 23, 12

4. These are important,
but...
Friday, March 23, 12

5. What’s the point of
automated tests?
• To catch regression bugs
• To do so faster and more reliably than a
human
Friday, March 23, 12

6. Developer
Commit
Source
Repo
Build & Deploy
Uses User
Production
Friday, March 23, 12

7. Developer Feedback Tester
Commit
Source
Repo
Build & Deploy
Tests
Build & Deploy
Test
Environment
Uses User
Production
Friday, March 23, 12

8. Developer Feedback Tester
Feedback
Commit
Source
Repo
Build & Deploy
Continuous
Integration
Build & Deploy Environment
Tests
Build & Deploy
Test
Environment
Uses User
Production
Friday, March 23, 12

9. Developer Feedback Tester
Feedback
Commit
Source
Tests Repo
Feedback
Build & Deploy
Continuous
Local Test Integration
Environment Build & Deploy Environment
Tests
Build & Deploy
Test
Environment
Uses User
Production
Friday, March 23, 12

10. What’s the biggest win
of automated tests?
FASTER
FEEDBACK
Friday, March 23, 12

11. Test Environment
Deploy Run
Feedback
Tests
Development Team Automation Team
Friday, March 23, 12

12. Friday, March 23, 12

13. Test Environment
Feedback
Deploy
Run
Tests
Development /
Automation Team
Friday, March 23, 12

14. Something to consider
"If a test fails in Jenkins,
and no one is there who cares about it,
should it still break the build?"
Friday, March 23, 12

15. </digression>
Friday, March 23, 12

16. iOS Automation: Tools
• NativeDriver http://nativedriver.googlecode.com/
• KIF https://github.com/square/KIF
• Frank http://www.testingwithfrank.com/
• MonkeyTalk http://www.gorillalogic.com/
• LessPainful https://www.lesspainful.com/
• iCuke https://github.com/unboxed/icuke
• UISpec http://uispec.googlecode.com/
Friday, March 23, 12

17. iOS Automation:
Architecture
Request / Response
HTTP
Server
Synthesized Events
Test Code Application
State
Query
Device / Simulator
Friday, March 23, 12

18. iOS Automation:
Architecture
Test Code
Application
Device / Simulator
Friday, March 23, 12

19. Why NativeDriver?
Familiar API
Friday, March 23, 12

20. Why NativeDriver?
Java
Friday, March 23, 12

21. Why NativeDriver?
Android
Friday, March 23, 12

22. Why NativeDriver?
“Hybrid”
Apps
Friday, March 23, 12

23. iOS Automation
Toolchain
WebDriver Protocol
HTTP
Server
Synthesized Events
Test Code (Java) Application (Obj-C)
State
Query
Device / Simulator
Friday, March 23, 12

24. NativeDriver
Test Support Code
Friday, March 23, 12

25. NativeDriver
Test Code
Friday, March 23, 12

26. Toolchain: The ugly bits
• How do I build from the command line?
• How do I launch the simulator from the
command line?
• How do I shut down the simulator cleanly?
Friday, March 23, 12

27. Toolchain: The ugly bits
• How do I browse native widgets currently
onscreen?
• How do I browse widgets in a UIWebView?
• How do I solve intermittent test failures?
• What do I do if NativeDriver doesn’t
support an element I need to interact with?
Friday, March 23, 12

28. Challenges
Friday, March 23, 12

29. Cultural Differences
Football Football
Friday, March 23, 12

30. Web Test Automation
• Selenium, Watir, Capybara, HTMLUnit, etc.
• Test automation is commonplace
Friday, March 23, 12

31. iOS Test Automation
Real Developers
Don’t Write Tests
Friday, March 23, 12

32. Challenges:
Language Choice
Friday, March 23, 12

33. Recommendations
Friday, March 23, 12

34. Recommendation:
Show Value Early
Friday, March 23, 12

35. Recommendation:
Surprise and Delight
Friday, March 23, 12

36. Friday, March 23, 12

37. Friday, March 23, 12

38. Recommendation:
Smooth Rough Edges
Friday, March 23, 12

39. Recommendation:
Know Your Limits
Friday, March 23, 12

40. The Future of
NativeDriver
Friday, March 23, 12

41. Friday, March 23, 12

42. The Future of Mobile
Testing...
...is in your hands!
Friday, March 23, 12

43. Thank you!
Dante Briones
dante@cochiva.com
@dantebriones
Friday, March 23, 12