1. ATDD In Practice
A NSN Story
Public
1 © Nokia Siemens Networks

2. Background
Name : XU YI (徐毅)
Title : Consultant, Agile Development
Story
• One release of an radio product’s transport
platform
• Multi-site development, hybrid style (waterfall,
Agile)
• I was Scrum Master / Test Automation Coach
• Continuous integration, ATDD, Scrum, etc.
Public
2 © Nokia Siemens Networks

3. 60,000 people in more than 150 countries
More than 600 Communications Service
Provider customers
World’s second largest telecommunications
supplier
Every second we touch the lives of millions of
individuals.
Public
3 © Nokia Siemens Networks

4. Global presence
- close to key markets and customers
North East
North
America
West & South
Europe
Greater
China
Latin
America
APAC
Middle East
& Africa
R&D in all technology
hotspots in the world. Major
sites in Finland, Germany,
China, India and US.
Public
4 © Nokia Siemens Networks

5. Unit And Acceptance Tests
What is ATDD?
Acceptance Test-Driven Development
Unit And Acceptance Tests
Unit Test : CODE-FACING
 Express expectations that developers have about the code
Acceptance Test : BUSINCESS-FACING
 Express expectations that Product Owners or other business stakeholders
have about externally visible behavior of the software under test
Public
5 © Nokia Siemens Networks

6. Unit TDD ≠ Unit testing
It is a DESIGN practice!
Acceptance TDD is not just testing
It is a
REQUIREMENT ANALYSIS
practice!
Public
6 © Nokia Siemens Networks

7. Acceptance-Test Driven Development (ATDD)
Cycle
Public Elisabeth Hendrickson Slide
7 © Nokia Siemens Networks

8. ATDD: Discuss
Concrete
Tests
Public Elisabeth Hendrickson Slide
8 © Nokia Siemens Networks Xu Yi (徐毅) / 24th October 2009 / Agile Tour Chengdu 2009

9. Requirement Analysis
• i.e. Scrum Backlog Grooming
– Product Owner, Team, Scrum Master
– Clarify User Stories
– Generate Acceptance Tests
Public
9 © Nokia Siemens Networks

10. Case Study : A Simple Web Application
• User could login using correct
username and password
– “Valid Login”
• User can not login using
incorrect username and/or
password
DISCUSS
Public
10 © Nokia Siemens Networks

11. Valid Login
We have two administrators, they must be able to login
• Username : “demo”; password : “mode”.
• Username : “dave”; password : “wibble”.
So we have cases
• Demo Login Successfully
• Dave Login Successfully
DISCUSS
Public
11 © Nokia Siemens Networks

12. Demo Login Successfully
What should “demo” do to login?
Eh, have to go to the login page first
Next, input and confirm the data
Then “demo” should be in the welcome page
DISCUSS DESIGN
Public
12 © Nokia Siemens Networks

13. ATDD: Develop
Public Elisabeth Hendrickson Slide
13 © Nokia Siemens Networks

14. Wibble Login Successfully
How about “wibble” login?
Wait a moment, is this case so similar to “demo” one?
Let’s remove the duplication!
DESIGN
Public
14 © Nokia Siemens Networks

15. The duplication
The only differences :
• Username
• Password
Let’s put them as variables! (in the user keyword)
DESIGN
Public
15 © Nokia Siemens Networks

16. DEVELOP
And more test automation design stuff ……
DESIGN DEVELOP
Public
16 © Nokia Siemens Networks

17. ATDD: Deliver
Public Elisabeth Hendrickson Slide
17 © Nokia Siemens Networks

18. DELIVER – Test Part
Some final clean up…
Ok, here is
And its logs …
DELIVER
Public
18 © Nokia Siemens Networks

19. ATDD Cycle using robotframework
DELIVER
DISCUSS
Automated Acceptance
e
Cod
Test cases (e.g. Robot)
TDD
Cycle
DEVELOP
Public
19 © Nokia Siemens Networks

20. Lessons Learned - Success Factors
• Collaboration
• Consider and integrate effort into whole development cycle
• Reliable and robust tests
• Frequent execution
Public
20 © Nokia Siemens Networks

21. Lessons Learned - Shared Vocabulary
• Discussing, designing and creating keywords for testing, build
a domain-specific language that describes the system under
test.
• The terms are ubiquitous, which creates a shared vocabulary
that everyone on the team has the same understanding of the
words
• On the way, misunderstandings are uncovered and discussed,
different opinions are respected and considered.
Public
21 © Nokia Siemens Networks

22. Environment
Must
• python 2.7
• robotframework 2.5.1
• jre-6u16-windows-i586-s.exe
• robotframework-seleniumlibrary-2.4.win32.exe
Should
• robotide-0.26.1.win32.exe
• wxPython2.8-win32-unicode-2.8.11.0-py27.exe
Could
• rfdoc-0.2.tar.gz
# robotframework website : http://robotframework.org
Public
22 © Nokia Siemens Networks

23. Retrospective
Talk With Your Pair
• MY FAVOURITE …
• MY QUESTION …
• MY SUGGESTION …
DELIVER
DISCUSS
Automated Acceptance
Test cases (e.g. Robot)
Code
TDD
Cycle
DEVELOP
Public
23 © Nokia Siemens Networks

24. Thanks!
Xu Yi
（徐毅）
twitter : kaverjody
t.sina.cn : kaverjody
t.qq.com : kaverjody
mailto:yi.xu@nsn.com
http://blog.sina.com.cn/kaverjody
http://www.linkedin.com/in/kaveri
“Consultant, Agile Development” @ Nokia Siemens Networks
Scrum / Agile Coaching, Testing & Test Automation
Public
24 © Nokia Siemens Networks

25. 关于我
曾任职诺基亚西门子网络公司
全球精益及敏捷转型部门担任精益
及敏捷顾问。
专长于大型组织(>500人)的敏
捷迁徙转变。精通各种风格、类型
的黑盒测试，包括验收性测试驱动
开发、探索性测试、测试自动化等
等。在辅助一个400人的大型组织
搭建、规范化测试自动化系统及实
践之后，选择传授敏捷/Scrum以及
精益的要义，辅导其他组织进行转
变。兴趣广泛，包括但不限于各种
类型测试、敏捷/Scrum及精益。
国内敏捷会议的常客，近期的
有敏捷中国2010，Scrum Gathering
Shanghai 2010，以及2009、2010
年的敏捷全球之旅中国站活动。
更多信息请看LinkedIn主页：
http://cn.linkedin.com/in/kaveri
2 © Copyright 2010 Hewlett-Packard Development Company, L.P.

26. 联系方式
惠普邮箱：mailto:YI.XU@HP.com
mailto:KAVERJODY@GMAIL.com
mailto:KAVERJODY@MSN.com
Skype : KAVERJODY
新浪微博: 徐毅-Kaveri
腾讯QQ : 17376122
http://blog.sina.com.cn/kaverjody
http://kaverjody.wordpress.com
http://cn.linkedin.com/in/kaveri
20 © Copyright 2010 Hewlett-Packard Development Company, L.P.