SlideShare uma empresa Scribd logo
1 de 54
Baixar para ler offline
MB
Full day Tutorial
11/11/2013 8:30 AM

"Requirements Engineering:
A Practicum"
Presented by:
Erik van Veenendaal
Improve IT Services BV

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073
888 268 8770 904 278 0524 sqeinfo@sqe.com www.sqe.com
Erik van Veenendaal
Improve IT Services BV
A leading international consultant, trainer, and recognized expert in
software testing, Erik van Veenendaal (erikvanveenendaal.nl) is the
founder of Improve IT Services BV, a company that specializes in testing,
requirements engineering, and quality management. Erik is the author of a
number of books and papers, one of the core developers of the TMap
testing methodology and the TMMi improvement model, a participant in
working parties of the International Requirements Engineering Board, and
currently on the TMMi Foundation board. He is a frequent speaker at
international testing conferences. For his major contribution to the field of
testing, Erik received the 2007 European Testing Excellence Award.
Requirements Engineering
Quality makes products
which do not return and
customers who do

Erik van Veenendaal
www.erikvanveenendaal.nl

Do not put content
on the brand
signature area

Requirements Engineering: A Practicum
•  08:30 – 09:15 Introduction to Requirements Engineering
09:15 – 10:00 Kick-off Phase
10:00 – 10:15 Requirements Gathering
•  10:30 – 11:15 Requirements Gathering - cont.
11.15 – 12.00 Requirements Specification
•  13.00 – 13.30 Exercise Radio Watch (1)
13.30 – 14.15 Requirements Specification – cont.
14.15 – 14.45 Exercise Radio Watch (2)
•  15:00 – 15:45 Verification and Validation
15.45 – 16.05 Exercise Radio Watch (3)
16.05 – 16.30 IREB, Evaluation and Closure
Improve Quality Services B.V.

2

Do not put content
on the brand
signature area
Learning Objectives
Learning by thinking and doing

!  Understand the importance of requirements
!  Have an overview of requirements engineering
process
!  Learn a structured approach for writing good
requirements in a natural language
!  Provide practical ideas for writing better
requirements
!  Be able to organize and participate in requirements
reviews
!  Note: in Agile requirements come as user stories
Improve Quality Services BV

3

Erik van Veenendaal
www. erikvanveenendaal.nl

!  Founder and major shareholder ImproveQS
!  In testing since 1989 working for many
different clients and in many different roles
!  Author “TMap”, “TMMi”, “ISTQB Foundation”
and many other books and papers
!  Vice-President International Software Testing
Qualifications Board (ISTQB) 2005 - 2008
!  Supporting member IREB board
!  Keynote speaker, e.g., EuroSTAR, STAR
!  Winner of the European Testing Excellence
Award (2007)
Improve Quality Services BV

4
Improve Quality Services BV
www. improveqs.nl

! Service organisation in the area of
Testing, Requirements Engineering and
Quality Management
! Consultancy, Subcontracting and Training
Testing (TMap, TMMi)
Agile Testing (CAT)
Test Process Improvement
Certification (ISTQB)
Inspections / Reviews
Improve Quality Services BV

SW Process Improvement
Quality Level Management
IT-Auditing
Requirements Engineering
& management (IREB)
5

How I got involved?
! Tester:
“Can’t test this, not clear, not unambiguous”
! Requirements engineer:
“What is a good testable requirement?”
! Tester:
“Uuuuhhhh…. SMART”
! Requirements engineer:
“Let’s define ‘what are the requirements for
requirements?’”
Improve Quality Services BV

6
Understanding Requirements

Improve Quality Services B.V.

7

The Challenge
!  To capture the need “completely” and
“unambiguously” without resorting to specialist
jargon, thus understandable by our stakeholders
!  Requirements are the basis for:
- Project (sprint) planning
- Trade-off (priority setting)
- Development
- Acceptance testing

Improve Quality Services B.V.

8
Outsourcing !?

Why?

!  Most significant contributors to project failure relate
to requirements (Standish Group CHAOS report)
!  Most frequently named cause of total project failure
was changing requirements (Study Computer Industry
Daily of 500 IT managers USA &UK)

"  Note: Agile much more capable of managing this

!  Requirements Engineering & Management seen as
biggest problem in software development processes
(EU Survey)

Improve Quality Services B.V.

9

Project Success Factors….
Reliable Estimates

Formal methodology
Standard software
infrastructure

Executive
support

Minimized scope

6% 5%
10%

8%

12%

18%

16%
Experienced
Project Manager

14%
5%

6%

Clear
business
objectives
User
involvement

Firm basic requirements

Other

Source: “Extreme Chaos” The Standish Group. www.standishgroup.com
Improve Quality Services BV

10

44%
More facts and figures
Req.

GD

DD

Impl.

Test

Oper.

!  Investing less than 5% in gathering and processing
requirements will lead to budget overruns of
approximately 80% - 200%
!  50% of the defects reported during system and
acceptance testing can be traced to requirements
engineering
!  Requirements defects are the most important
- defects have the characteristic to multiply themselves
top-down
- cost of rework rise (exponentially)
Improve Quality Services B.V.

11

Importance of Requirements
Different stakeholders

Different objectives

!  User/Customer

# State their needs

!  Agile Team

# Develop sprint planning

!  Project Manager

# Develop budget/schedule

!  System Engineers

# Develop architecture

!  Testers

# Specify test plan & cases

!  Software Engineers # Define work to be done

Improve Quality Services BV

12
What is a Requirement?
A requirement is a condition or capability
to which the system must conform
… a capability needed by the user to solve a
problem or achieve an objective
… a capability that must be met or possessed by a
system to satisfy a contract, specification,
standard or other formally imposed
documentation
… a statement of intent that describes something
the system needs to do for some user
.

Improve Quality Services B.V.

13

Three Types of Requirements
!  Functional requirements are things the product must do
-The product shall produce an updated schedule

- As a <student>, I want <to be able to buy a parking pass> so I can
<get to school quickly>

!  Non-functional requirements (e.g., ISO9126) are the
properties that the product must have
-  The product shall determine ... in less than 0.25 seconds
-  As a <member of the public> I want <the website to adequately cope
with high loads> so I can <purchase a ticket quickly for a highly
subscribed event>

!  A constraint is a restriction on the scope or design of the
product
- The product shall run on the ... platform
Improve Quality Services BV

14
A main principle…….
How much documentation is enough?

"  Requirements process is context dependent
!  User requirements – problem domain
- State what the stakeholders want to achieve through
use of the system. Avoid reference to any particular
solution. “The user shall be able to…..”
!  System requirements – solution domain
- State abstractly how the system will meet the
stakeholder requirements. Avoid reference to any
particular design. “The product shall …..”
!  Agile / V-model / Outsourcing
!  Business / Project / Product / Human factors
Improve Quality Services BV

15

More Definitions….
! Requirements Engineering
- A systematic approach to gathering, organizing,
and documenting the requirements of the system

! Requirements Management
- A process that establishes and maintains
agreement between the customer and the project
on the changing requirements of the system
- Agile: Managing the Backlog by Product Owner
Improve Quality Services BV

16
Requirements Proces (1)
1 2 3 4 5
1.  Kick-off phase
! 

Objective, scope, stakeholders, business case

! 

Check: Are things clear enough to start?

2.  Requirements gathering (quantity-based)
! 

Functional, Non-functional, Constraints

! 

Various gathering / elicitation techniques

3.  Requirements specification (quality-based)
! 

Templates, Rule set

! 

Multiple levels, level of detail needed

Improve Quality Services B.V.

17

Requirements Proces (2)
4.  Verification and Validation

1 2 3 4 5

! 

Checking requirements

! 

Different types (walkthrough, pair-inspection)

! 

Use rules and checklists

5.  Requirements management
! 

Identification and traceability

! 

Use attributes, e.g., source

! 

Change management

! 

Relates to the entire proces

Improve Quality Services B.V.

Note, in Agile
this is not a
lineair process

18
Requirements Engineering: A Practicum
•  08:30 – 09:15 Introduction to Requirements Engineering
09:15 – 10:00 Kick-off Phase
10:00 – 10:15 Requirements Gathering
•  10:30 – 11:30 Requirements Gathering - cont.
11.30 – 12.00 Requirements Specification
•  13.00 – 13.30 Exercise Radio Watch (1)
13.30 – 14.15 Requirements Specification – cont.
14.15 – 14.45 Exercise Radio Watch (2)
•  15:00 – 15:45 Verification and Validation
15.45 – 16.05 Exercise Radio Watch (3)
16.05 – 16.40 IREB, Evaluation and Closure
Improve Quality Services B.V.

19

Kick-off, What is needed?
1.  The purpose of the product
2.  Customers and other stakeholders
3.  Users of the product
4.  Scope of the product (context diagram)
5.  Glossary: naming conventions, abbreviations

and definitions

6.  Relevant facts and assumptions
7.  References

Improve Quality Services BV

20
The purpose of the product
PRINCE-2 “Business Case”
RuP “Vision document”

!  The user problem (no more than 1 page)
- A short description of the situation that triggered the
development effort
- Describe the work that should be improved

!  Goals of the project
- What will the product do? (purpose)
- What is the business advantage?
- How will you measure the advantage?
- Statement of needs on a high-level
Improve Quality Services BV

Get stakeholders commitment on this !!
21

Purpose Example (A’dam Metro)
Purpose: To sell metro tickets more
efficiently (faster) than currently.
Rational: To increase sales and reduce
cueing while buying metro tickets.
Acceptance Criteria: The product will
hand out ticket 30% faster than the
current system. This improvement shall
be achieved on all priority 1 stations at
peak hours.
Improve Quality Services BV

22
Stakeholders
!  A stakeholder is anyone who is interested in the
product
!  Stakeholders may use it, are affected by it, have
specific knowledge on it, or develop the product
" Brainstorm a list of stakeholders
" Document the knowledge area of the
stakeholders (e.g. typical use cases, nonfunctional or other requirements)
" Forgotten stakeholders means forgotten req.’s !!
Improve Quality Services BV

23

Users of the Product
!  The purpose of identifying the users, so that you
can understand the work that they do
and the product you must build for them
!  For the users, describe all the known and
potential users and their attributes
!  The roles (actors) for the user stories (use cases)
to be defined later
" Forgotten users means forgotten req.’s !!

Improve Quality Services BV

24
Context of Use
! 

! 

The functionality and usability of a product is
effected by its context of use
Context is characterized by :
- the users of the product
- the tasks they carry out
- the working environment
-…

!  Tool : Context of Use
checklist MuSIC
Improve Quality Services BV

25

The Scope of the Requirements
!  The context defines the extent of the work
!  … also what is NOT included
!  The context is provided by the services provided
by the work
!  … and the needs of the outside world
!  Defines the scope of the work by showing the
connections to the adjacent systems
!  Includes all desired capabilities

Improve Quality Services BV

26
At system level
adjacent systems

Context diagram
Adjacent
Process

Adjacent
Process
Work to
be studied
(functionalities
and data)

Adjacent
Process
Improve Quality Services BV

Services provided
by the product

Needed by the product
to provide the services
27

Naming conventions/definitions
!  Misunderstood terms cause problems
!  Start a list of important terms used by the
stakeholders
!  This will be enlarged and refined later
!  If your terms invoke the right meaning they save
hours of explanation
!  Check for internal and industry-standards
" Later….”Do all terms have a requirement? “

! Improve Quality Services BV

28
At the end of the Kick-off
!  How much do you know?
!  Enough to start gathering the req.’s?
!  Do you have a measurable purpose?
!  Do you know all the stakeholders and users?
!  Is the scope clearly defined?
!  Should you proceed or ask for more and better
information?

Improve Quality Services BV

29

Discussion Exercise
1.  Become acquainted – introduce yourself
2.  State in keywords the most important
requirements issues in your projects /
organization
3.  How do you start the requirements process
in your organization?
4.  Consider the effect of a poor requirements
“kick-off” – Do you mitigate these risks?

Improve Quality Services BV

30
Requirements Engineering: A Practicum
•  08:30 – 09:15 Introduction to Requirements Engineering
09:15 – 10:00 Kick-off Phase
10:00 – 10:15 Requirements Gathering
•  10:30 – 11:30 Requirements Gathering - cont.
11.30 – 12.00 Requirements Specification
•  13.00 – 13.30 Exercise Radio Watch (1)
13.30 – 14.15 Requirements Specification – cont.
14.15 – 14.45 Exercise Radio Watch (2)
•  15:00 – 15:45 Verification and Validation
15.45 – 16.05 Exercise Radio Watch (3)
16.05 – 16.30 IREB, Evaluation and Closure
Improve Quality Services B.V.

31

Kano model: three categories
Not fulfilled

Basic factors

Must-be quality
Performance factors

Fulfilled

Extremely
dissatisfied

Not dissatisfied

Dissatisfied

Satisfied

Not dissatisfied

Extremely
satisfied

Expected quality
Excitement factors

Attractive quality
Improve Quality Services BV

32
Requirements Gathering (1)
!  Finding conscious, unconscious and subconscious
requirements
!  Approach depends on:
- risk factors
- experience of the req. engineer
- time & budget
- availability stakeholders
-  granularity and the degree of detail needed
-  system context
-  availability of sources, e.g., systems / documentation
-  …

!  All about quantity not quality # building the backlog
Improve Quality Services BV

33

Requirements Gathering (2)
!  Survey techniques

!  Observation techniques

- Interviews, questionnaires

!  Creativity techniques

−  Apprenticing, field
observation

!  Document-centric
techniques

- Brainstorming, change of
perspective, analogies,
role playing

−  System archaeology,
reuse of requirements

Combining different techniques for the best result …

Improve Quality Services BV

34
Interview the stakeholders
!  Not the sole technique !!
- Users don’t know all the requirements….

!  Closed questions start with words like Do.. Is..
Can..Could..Will..Would..Shall..
-These usually get yes/no answers

!  Open questions start with words like
How..Why..When..Where..What..Who
- Are more likely to extract information

!  Use answers from one questions to ask a new
one
Improve Quality Services BV

35

Interview the stakeholders (2)
!  How will you know if you have been successful?
What do you want to achieve?
- Prepare a checklist of topics to be discussed

!  Plan the venue of the interview: ideally the
stakeholder’s workplace
!  Plan the boundary of your interview (and make
this clear at the beginning)
!  Ask yourself: Why should the stakeholder care
about this interview?
!  At the end, of course, thank the stakeholder and
tell what you will do with the information….
Improve Quality Services BV

36
Interview Process
People factors
are critical !!

1.  Getting acquainted
2.  Explain rules
3.  Gather requirements
- check your observations
- record draft requirements

4.  Summary
“have I missed anything?”

5.  Closure
“what can I do better next time?”
Improve Quality Services BV

37

Questionnaire NF-requirements
!  In stakeholders’ (users’) language
!  Business characteristics
- objectives, process, users, software product
- two versions: information systems and technical
automation, e.g. embedded

!  Interview with various stakeholders
-1 hour per interview

!  Answers linked to quality attributes
- two dimensional matrices
-  business characteristics versus ISO 9126

!  Note NF-requirements are often on a system level
Improve Quality Services BV

38
Examples Checklist Items
note, rationale becomes clear as well

!  Objectives
- Higher level of efficiency / productivity
  req.’s on usability and time-behaviour
- Continuity of information services
  req.’s on maintainability and portability

!  Business process
- Primary process with a high risk level
  req.’s on reliability
- Very dynamic process; the process has interrelationships with a
great number of other processes (complex)
  req.’s on maintainability and usability
Improve Quality Services BV

39

Brainstorming
!  Requirements gathering is invention
!  Objective of brainstorming is to be as imaginative
as possible, and so generate as many ideas as
possible
!  List, discuss and group the ideas
- Initially five items and then discuss, next round …

!  Check the ideas with the project scope
!  Later turn them into requirements
!  Think about a facilitator
Improve Quality Services BV

40
Brainstorming: simple rules
!  Wide range of disciplines and experience
!  Start with a well-defined, open ended statement of
the problem (e.g. context diagram)
!  Write every idea down (a piece of paper is never
big enough!), without censoring: any idea is a
good one!
!  Define subgroups to elaborate on a type or
functionality
!  Suspend judgment and evaluation
!  Piggyback on each others’ ideas
!  Use a separate section for project issues & design
Improve Quality Services BV

41

Study the current situation
!  Understanding what we seek to change
!  Current system contains many of the needed
requirements (abstract from technology)
- Often implicit requirements
!  Ask “What is right with this system?”
!  Draw a model of the current system
!  Also include system from competitors
!  Practice apprenticing “Nobody can talk better
about what they do, and why they do it, than they
can while in the middle of doing it”
Improve Quality Services BV

42
Supporting Tools
! Mind mapping
! Prototyping
! Use Case Workshops
! Etc.

Improve Quality Services B.V.

43

Mind maps

www.visual-mind.com
www.freemind.com

!  Mind maps to explore ideas
!  Useful devices to organize your thoughts
!  You see the links between the various aspects of
the product that have been told about
!  Useful during interviewing users /stakeholders
and brainstorming
!  Improve sharing of thoughts and knowledge
!  Some use class diagrams as a basic structure
Improve Quality Services BV

44
Prototypes
!  For information gathering
!  Some requirements are not obvious, or are not
fully elaborated yet
!  Some users have trouble articulating their desires
!  Give users the opportunity to use the requirements
!  Restrict the prototypes to most common tasks
!  Focus on the product, not the prototype
“The truth is almost never in the words”
Improve Quality Services B.V.

45

Especially useful when ..
!  The product did not exist before
!  The users have no experience with the kind of
product
!  The users are stuck in the current way of working
!  The users have trouble stating their req.’s
!  The requirements analyst / developer has trouble
understanding what is required
" Low-fidelity vs. High-fidelity prototypes
46
Use Case Workshops / EPIC
Describing the bigger picture

!  Start with the context diagram
!  Use cases give users a convenient way to
partition the product
!  Describes the bigger picture
!  One or more use cases per business event
•  also consider ‘misuse cases’, e.g., for security req.

!  Six step scenario’s are a great starting point
•  Name

- Actor (user)

•  Short description (‘happy day scenario’)
•  Pre conditions
Improve Quality Services BV

- Post conditions
47

Use Cases

use case

req.

! 

Use case: sequence of transactions in a dialogue
between a user and the product with a specified result

! 

EPIC: a large story that requires some level of
breakdown into smaller stories in order for the work to
be consumed in a single iteration.

! 

The use cases contain functional (and non-functional)
requirements
-  The requirements make up the work done by the use
case

!  Start by identifying the use case per business event
and actor
Improve Quality Services BV

48
Hierarchy and Traceability

Context
diagram
Use
cases

Req.’s

Improve Quality Services BV

EPICs

User
stories

Req.’s

User
stories

49

Use Case Example (A’dam Metro)
Use Case: Traveller buying a ticket.
Actor: Traveller
1.  The traveller offers destination, type of
ticket and payment to the product
2.  The product checks whether the payment
is ok for the chose n destination and type
of tickert
3.  The product checks whether the network
is operational for the chosen destination.
4.  The product submits ticket and if
necessary change.
5.  The product stores the transaction
Improve Quality Services BV

50
Requirements Example (A’dam Metro)
Use Case step 2.: The product checks
whether the payment is ok for the chosen
destination and type of ticket
Requirements:
2.1 The product shall establish that the
payment consists of legally valid money .
2.2 The product shall calcuate the lowest
fare for the destination considering day of
week and time
2.3 The prodyct shall compare the travellers’
payment with the calculated payment
2.4 The product shall provide feedback in
case the payment is not sufficient.
Improve Quality Services BV

51

SWOT analysis Techniques & Tools
Instruction:
Choose two elicitation techniques (or tool)
-  As a team what do you consider to be strong
points / selling items of that technique?
"  When to use!

-  And what do you consider to be problems / draw
backs / weaknesses of that technique?
"  When hard (or not) to use!

Improve Quality Services B.V.

52
Requirements Engineering: A Practicum
•  08:30 – 09:15 Introduction to Requirements Engineering
09:15 – 10:00 Kick-off Phase
10:00 – 10:15 Requirements Gathering
•  10:30 – 11:30 Requirements Gathering - cont.
11.30 – 12.00 Requirements Specification
•  13.00 – 13.30 Exercise Radio Watch (1)
13.30 – 14.15 Requirements Specification – cont.
14.15 – 14.45 Exercise Radio Watch (2)
•  15:00 – 15:45 Verification and Validation
15.45 – 16.05 Exercise Radio Watch (3)
16.05 – 16.30 IREB, Evaluation and Closure
Improve Quality Services B.V.

53

What is needed ….
!  If we could look into each others brains, we
wouldn’t need documentation …
!  Documentation helps us to communicate
Sender
Encodes

Message
Joint code

Receiver
Decodes

!  Be careful, words may not be enough!
- Formal / informal language
- Different interpretations
Improve Quality Services B.V.

54
"I didn't say he killed his wife“
"I didn't say he killed his wife"
"I didn't say he killed his wife"
"I didn't say he killed his wife"
"I didn't say he killed his wife"
"I didn't say he killed his wife"
"I didn't say he killed his wife"
"I didn't say he killed his wife"
Improve Quality Services B.V.

55

What are “good” requirements?
Identify at least five “rules” that determine
whether a requirement is a good
(or “poor”) requirement
Consider !!
!  Individual requirements
!  Requirements attributes

Improve Quality Services B.V.

56
What is a good requirement?

Improve Quality Services B.V.

57

Excercise Radio Watch (1)
•  Study the requirement specification for the
new Radio Watch
•  Make comments (find defects) based on
what you have learned so far
e.g., attributes, rules, guidelines….

+
Improve Quality Services BV

58
Requirements cards
Requirement # :
Requirement Type :
Description :

Priority :
Use case :

Rationale :
Source :
Acceptance Criteria :

Size :
Supporting material : …annotation, conversation…
Improve Quality Services B.V.

59

Requirements attributes (1)
! ID
- To allow traceability

! Requirements Type
- Allows req.’s to be sorted, grouping allows the requirements to be

checked on completeness and for conflicts, e.g., by non-functional,
by business process

! Use case
- For traceability and change control purposes

- Again for grouping etc.

! Description
- The intent of the requirement (may initially be ambiguous) - the

stakeholders’ whishes & needs

Improve Quality Services B.V.

60
Requirements attributes (2)
!  Rationale
- Reason behind the requirement’s existence. Helps to clarify and

understand the requirement and to identify ‘gold plating’ req.’s.

!  Priority
-  Measure of the business value and importance. For negotiation,
but also for risk-based testing

!  Acceptance criteria
- To make the requirement measurable and testable

!  Source
- Name of the person who raised the requirement , or document.

!  Size
- Number of story points
Improve Quality Services B.V.

61

Gold plating …..

“Well, we might as well put it on board – although I’m not sure what use
we’ll have for a box of rusty nails,62broken glas, and throwing darts.”

Improve Quality Services BV
Acceptance Criteria
involve tester here

!  We have to be able to tell whether a solution
completely satisfies, or fits, a requirement
!  To make requirements measurable
!  In practice very important for non-functional
requirements
!  It is usually necessary to negotiate acceptance
criteria with the stakeholder, e.g.,
•  90% of the customers must be able to get the correct ticket from the
product in no more than 25 seconds

Improve Quality Services B.V.

63

Example Acceptance Criteria
Requirement / User Story
- As a student, I want to be able to buy a parking pass so I
can get to school quickly
Acceptance Criteria
-  The student will not receive the parking pass if the
payment is insufficient
-  One can only buy a parking pass to the school parking lot
if the person is a registered student
-  The student can only buy one parking pass per month
-  …..
Improve Quality Services BV

64
Writing Guidelines
To write simple is as difficult as to be good

!  Short and concise sentences and paragraphs
!  One requirement per sentence
- no compound requirements, a single verb

!  Consistent terminology (homonyms)
!  Avoid generalizations
!  Use ‘must’, ‘can’ and similar words carefully
- ‘shall’ is better, ‘can’ indicates options

!  No solutions or design
!  Directive language
!  No pronouns
Improve Quality Services BV

65

Use Templates
www.requirementsengineering.info

!  The <stakeholder> shall be able to <capability>
-  The order clerk shall be able to raise an invoice

!  As a <role>, I want <activity> so that <business value>
- As a job seeker, I want to search for a job, so I can
advance my career

!  The <product> shall be able to <action> <entity>
- The launcher shall be able to launch missiles

!  The <product> shall <function> <object> every
<performance> <unit>
- The coffee machine shall produce a hot drink every 10
seconds
Improve Quality Services B.V.

66
Requirements Rule Set
•  Usefull set of agreements
•  Specify the contents and format
of a requirement (and requirements
document)
•  More objective, less discussion
•  Applied during specification and reviewing
•  Organization specific
•  Rules for tracing, format and content
Improve Quality Services B.V.

67

Examples of Rules (1)
!  Identification
!  Valuable / purpose
All forms of annotation, comments,
notes, suggestions, examples, or
!  Changes
other items not part of the formal
!  Grouping
requirement shall be clearly
indicated as such. This will be
!  Uniqueness
documented by using the attribute
!  Consistency
‘additional information’.
!  Annotation
!  Language
!  Knowledge responsible (source)
Improve Quality Services B.V.

68
Examples of Rules (2)
!  Detail
!  Brief / Small
!  Unambiguous
!  Priority
!  Rationale
!  Compound
!  Independent

Req.’s shall be unambiguous to the
intended readership. Req.’s shall have
only one interpretation. For example the
word shall is used and not the word
should. Words like can shall only be used
when more than one option is available.
Directive language (active voice) shall be
used, e.g., specifies and not can specify.

!  Technically achievable
!  Testable
Improve Quality Services B.V.

69

Interpretation: Unambiguous
!  To be part of the backlog
- The requirements shall be at the level of
unambiguousness to allow product team level decisions
to be taken.

!  To be part of the sprint planning
- The requirements shall be at the level of
unambiguousness to allow for estimation in terms of
effort and time.

!  To be part of the sprint
- The requirements shall provide enough information to
allow for the execution of individual deliverables and
tasks (e.g., detailed design, test design).
Improve Quality Services B.V.

70
Excercise Radio Watch (2)
•  Select the rules that you will adhere too, and
attributes that you will use
•  Select a description template
•  Rewrite some of the requirements for the new
Radio Watch
•  Make concrete improvement suggestions
•  Watch out for fuzzy terms
•  Use the requirements card
Improve Quality Services BV

71

Fuzzy Terms List
Mostly
Might
Appropriate
Graceful
Major
May be of use to
And/or
Various
Interface
Improve Quality Services B.V.

As needed
Make sense
Might make sense
At minimum
Slowly
Including but not limited
Suitable
Clean and stable
Several
72
Prioritizing Requirements
!  Use the priority (business value) attribute
!  If this fails, sort the requirements / use cases
using (MoSCoW):
- Must have in next sprint
- Should have in next sprint
- Could have in next sprint
- Would like if possible
!  Prioritize “Should have” & “Could have” categories
!  Usually highly subjective and many discussions
Improve Quality Services BV

73

Priority Factors from Practice
!  Selling item (marketing)
Customization
needed

!  Usage intensity
!  Business objectives
!  Customer value

Weightings
can be applied

!  Ease of implementation
!  Cost of implementation
!  Time-to-market

PRISMA®

!  Competition
!  External visibility
Improve Quality Services BV

74
Stakeholders Involvement
!  Identify stakeholders (internal and external)
- product owner, end-user, business mgr., marketing,
service department, help-desk, accountant, etc.

!  Ask them to fill in the priority table
- “1 to 5” scale or “0 to 9” for more differentiation

!  Their views will differ
!  Note, this may change as the project progresses

Improve Quality Services BV

75

Stakeholders Involvement (2)
9 : Critical
5 : High
3 : Moderate
1 : Low
0 : None

" Individual scoring
Selling
item
5

Item 2

4
5

Item 3

5
4
2
5

Item 5
Improve Quality Services BV

Item 1

Item 4

they shall
make
choices

1
4
76

Usage ……
intensity
Consensus Meeting
!  Discuss issue list - first defects found !!
!  Result may influence development & test approach
Impact
Selling Item

Usage intensity

…

Priority Number

Item 1

5

4

1

10

Item 2

3

3

1

7

Item n
Improve Quality Services B.V.

77

Achieving Consensus ….
decide / announce before the meeting

! Talking it out
! Use the highest rating
! Use the average rating
! Use the most applied rating
! Defer to one of the team members
- Let the “owner” decide

! Team voting
! Get an experts’ opinion
Improve Quality Services B.V.

78
Or Play the Card Game
!  Poker Planning based …..

'Risk management in agile projects: the PRISMA approach‘
in: Professional Tester (June 2012)
downloadable from www.erikvanveenendaal.nl
Improve Quality Services BV

79

The User Story Matrix
X

X
X

X

X

(Story

X

Size
Points)

X
Relative Business Value
80

X

Improve Quality Services BV
Requirements Two Aspects
!  Needs to be readable
- The structure of the document, how it is organised and
how the flow supports the reader to place individual
requirements in context

!  Needs to be processable
- Qualities of individual requirements, clarity and
preciseness and how they are divided into single
traceable items
-  Word doesn’t provide attributes, identifiers etc. tools do
-  www.methods-tools.com / www.volere.co.uk/tools.htm
Improve Quality Services BV

81

Readability: The Req.’s document
!  Three main sections

Putting together
what we have
gathered so far

- Introduction
- Overall description
•  Constraints

- Specific requirements
•  Functional requirements (grouped)
•  Non-functional requirements

!  Useful Templates - help to identify missing req.’s
- Volere (www.systemsguild.com) – business level
- IEEE 830 Software Requirements Specification
Improve Quality Services BV

82
Requirements Engineering: A Practicum
•  08:30 – 09:15 Introduction to Requirements Engineering
09:15 – 10:00 Kick-off Phase
10:00 – 10:15 Requirements Gathering
•  10:30 – 11:15 Requirements Gathering - cont.
11.15 – 12.00 Requirements Specification
•  13.00 – 13.30 Exercise Radio Watch (1)
13.30 – 14.15 Requirements Specification – cont.
14.15 – 14.45 Exercise Radio Watch (2)
•  15:00 – 15:45 Verification and Validation
15.45 – 16.05 Exercise Radio Watch (3)
16.05 – 16.40 IREB, Evaluation and Closure
Improve Quality Services B.V.

83

Core Agile Practice : Reviews
Communication & Feedback
Customer collaboration
!  Walkthrough / Pair Inspection /
Informal Reviews
!  Priority to the profitable
!  Apply review practices that
make the difference

84
Why Verification and Validation?
! Efficient and effective way to find defects
-

ambiguous, consistency, completeness, compound, ...

! Many defects have already been made
before design has started
-

50% “requirements related”

! Early defects are highly important
-

defects have the characteristic to multiply
themselves top-down

- cost of rework rises (exponentially)
Req.

Improve Quality Services B.V.

Design

Coding

Testing

85

Requirements reviews - types
! Walkthrough (with stakeholders)

Validation

- product owner will guide the group through the
requirements
- common understanding, knowledge sharing,
consensus

! Inspection (with fellow engineers)
- formal check against rules
- individual process to find defects
- using checklists
Improve Quality Services B.V.

86

Verification
Processing Requirements
information gathering
communication
consensus
approval

Walkthrough

Requirements
gathering

Use cases
Brainstorm
Interviewing
Mind mapping

Inspection

Requirements
(user stories)

Improve Quality Services BV

87

Review Process Overview
Kick-Off

Planning

Preparation

Meeting

Improve Quality Services B.V.

Rework

88

Exit
Walkthrough
•  Planning (scrum master): no formal entry criteria
•  Preparation (reading): preparing questions
•  Kick-off at the beginning of the meeting: objective
•  Meeting: author provides explanation
(e.g., scenario’s, prototypes, use cases)
•  Scribe to records findings
•  Scrum master manages the process (chair)

•  Rework/exit: not formal, author continues the work
Improve Quality Services B.V.

89

User Scenarios
! A scenario is a story that illustrates the
action that the product will take for a specific
case
! A scenario might be the generic ‘normal
case’ story, or it would tell a specific story
! Think of “what if scenarios” !!
! Deals with one (or part of an) event / use
case
! Used to discover missing requirements !!
Improve Quality Services B.V.

90
Pair Inspection
•  Planning/Kick-off: requirements, rules, objective
•  Preparation: individual, checking not reading
•  Meeting: defects explained, discussion,
logging? improvement suggestions?
•  Rework: by author, log as a ‘checklist’
•  Follow-up/Exit: check updated requirements
- 1 in10 defects is not addressed is correctly
(Source: Les Hatton)

Improve Quality Services B.V.

91

Check for Conflicts
•  Look for pairs of requirements that are in
conflict with each other
•  Look at existence dependent requirements,
e.g., one product data that the other needs
•  Do any requirements cover the same
subject?
•  Is every use of terminology consistent with
conventions and definitions?
•  Real conflicts identify negotiation points
Improve Quality Services BV

92
Checklist vs. Rules
! Derived from rules - objectives
! Most frequent / important defects
! One page
! Dynamic document, not static
! Question form, “NO” means a defect
! Shall be company specific

Improve Quality Services BV

93

Juran’s F-Test “The Game Rules”
!  Close your slide copies now!
!  No questions! No discussion. Make your best interpretation of the
following rule :
No instances of “F” allowed on the screen.
Standard applies to any type of “F”, so count
even “derivates” (example “f” and “F”)
!  Count all defects for standard F
!  Write down your count of “defects” when the time is up
!  You may move to any position in the room to see better
!  Do not interfere with the view of others
!  You will get 2 minutes to check
Improve Quality Services BV

94
Juran's “F” Test
"FEDERAL FUSES ARE THE RESULTS OF 75 YEARS OF
SCIENTIFIC STUDY COMBINED WITH THE EXPERIENCE OF 14
YEARS."

How many letter F's can you find on
this page?
Write the number down in this box

Improve Quality Services BV

95

Checklist for “F” searching
F1. Do you find the word “OF”?
F2. Do you find large graphic patterns resembling F ?
F3. Did you turn images backwards and all angles?
F4. Did you find all numbers and shapes pronounced “F”
for example 14, 75 and “frames”?
F5.Check “f” sound in apostrophe and hyphen
F6. Did you see the upside-down, backwards letter “t” (= “f”)?
F7. ……...

Improve Quality Services BV

96
Excercise Radio Watch (3)
! You have found defects in the requirements for
the new radio watch and you have re-written
some of them.
! Assignment: As a team, review the
requirements of your colleagues against the
rules (!!) and provide recommendations for
improvement
! “Good enough”?!

Improve Quality Services BV

97

Requirements Engineering: A Practicum
•  08:30 – 09:15 Introduction to Requirements Engineering
09:15 – 10:00 Kick-off Phase
10:00 – 10:15 Requirements Gathering
•  10:30 – 11:15 Requirements Gathering - cont.
11.15 – 12.00 Requirements Specification
•  13.00 – 13.30 Exercise Radio Watch (1)
13.30 – 14.15 Requirements Specification – cont.
14.15 – 14.45 Exercise Radio Watch (2)
•  15:00 – 15:45 Verification and Validation
15.45 – 16.05 Exercise Radio Watch (3)
16.05 – 16.40 IREB, Evaluation and Closure
Improve Quality Services B.V.

98
IREB e.V.
www.certified-re.de

International Requirements Engineering Board
!  A non-profit organization
!  Board members are international recognized
experts, e.g., Suzanne Robertson, Chris Rupp
!  Erik van Veenendaal active as a supporting
member
!  Goal: to improve practices in requirements
engineering and requirements management
!  Based on SWEBOK, ISTQB, IPMA, IEEE
!  iSQI active as examination body
Improve Quality Services B.V.

99

IREB Foundation
!  IREB Foundation Syllabus
!  Defined Educational Objectives and
Levels of Knowledge
!  Three day training course
!  75 minutes exam, 45 questions
- Questions vary in difficulty and different (indicated)
marking accordingly
- At least 60% of possible score needed to pass
-  E-based exam also possible

!  Advanced syllabi also recently became available
Improve Quality Services B.V.

100
IREB activities (Status 01-01-2013)
Finland

Sweden

United Kingdom

Denmark
USA

Hungary
South Korea

Bulgaria

Switzerland

Israel

Spain
Venezuela

Russia

Germany

The Netherlands

China

India

Austria

Malaysia

Ecuador
Sudan

Columbia

Egypt

Singapore
Australia

Brazil
South africa
New Zealand
Improve Quality Services B.V.

101

Things to do tomorrow
From previous groups
!  Introduce requirements attributes (cards)
!  Add rationale early
!  Write use cases/EPIC’s and add requirements
!  Use multiple gathering techniques
!  Write requirements, not (technical) solution
!  Define and use requirements rules
!  Use templates
!  Introduce practical reviews
!  Get the whole team involved
Improve Quality Services B.V.

102
Any questions.....?

Thank you !!
Improve Quality Services B.V.

103

Mais conteúdo relacionado

Mais procurados

Scrum for Global-Scale Development
Scrum for Global-Scale DevelopmentScrum for Global-Scale Development
Scrum for Global-Scale DevelopmentTechWell
 
CV_EN
CV_ENCV_EN
CV_ENBal
 
Real Testing Scenario Strategy - Bringing It All Together For Success
Real Testing Scenario Strategy - Bringing It All Together For SuccessReal Testing Scenario Strategy - Bringing It All Together For Success
Real Testing Scenario Strategy - Bringing It All Together For SuccessAdam Sandman
 
Exploratory Testing Kari Kakkonen BTD 2017
Exploratory Testing Kari Kakkonen BTD 2017Exploratory Testing Kari Kakkonen BTD 2017
Exploratory Testing Kari Kakkonen BTD 2017Kari Kakkonen
 
50+ ways to improve tester - programmer relationship
50+ ways to improve tester - programmer relationship50+ ways to improve tester - programmer relationship
50+ ways to improve tester - programmer relationshipAgile Testing Alliance
 
Quality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT deliveryQuality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT deliveryRik Marselis
 
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...Melissa Luongo
 
Flexible On Demand SoftWare Testing
Flexible On Demand SoftWare TestingFlexible On Demand SoftWare Testing
Flexible On Demand SoftWare Testingraebrand
 
'Quality Engineering: Build It Right The First Time' by Allan Woodcock, Shoba...
'Quality Engineering: Build It Right The First Time' by Allan Woodcock, Shoba...'Quality Engineering: Build It Right The First Time' by Allan Woodcock, Shoba...
'Quality Engineering: Build It Right The First Time' by Allan Woodcock, Shoba...TEST Huddle
 
Automotive SPICE® 3.0 - What is new and what has changed?
Automotive SPICE® 3.0 - What is new and what has changed?Automotive SPICE® 3.0 - What is new and what has changed?
Automotive SPICE® 3.0 - What is new and what has changed?Dominik Strube
 
Ashalatha Nagappa
Ashalatha NagappaAshalatha Nagappa
Ashalatha Nagappaasha latha
 
DevOps maturity models Knowit and DASA
DevOps maturity models Knowit and DASADevOps maturity models Knowit and DASA
DevOps maturity models Knowit and DASAKari Kakkonen
 
Agile, DevOps & Test
Agile, DevOps & TestAgile, DevOps & Test
Agile, DevOps & TestQualitest
 
Abhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar_9.5 Years_Localization TestingAbhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar_9.5 Years_Localization TestingAbhishek Tomar
 

Mais procurados (20)

Scrum for Global-Scale Development
Scrum for Global-Scale DevelopmentScrum for Global-Scale Development
Scrum for Global-Scale Development
 
CMS Computer- Where Technology Begins.
CMS Computer- Where Technology Begins.CMS Computer- Where Technology Begins.
CMS Computer- Where Technology Begins.
 
CV_EN
CV_ENCV_EN
CV_EN
 
Real Testing Scenario Strategy - Bringing It All Together For Success
Real Testing Scenario Strategy - Bringing It All Together For SuccessReal Testing Scenario Strategy - Bringing It All Together For Success
Real Testing Scenario Strategy - Bringing It All Together For Success
 
Exploratory Testing Kari Kakkonen BTD 2017
Exploratory Testing Kari Kakkonen BTD 2017Exploratory Testing Kari Kakkonen BTD 2017
Exploratory Testing Kari Kakkonen BTD 2017
 
Ruchika_Mittal_Resume
Ruchika_Mittal_ResumeRuchika_Mittal_Resume
Ruchika_Mittal_Resume
 
50+ ways to improve tester - programmer relationship
50+ ways to improve tester - programmer relationship50+ ways to improve tester - programmer relationship
50+ ways to improve tester - programmer relationship
 
Quality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT deliveryQuality Engineering and Testing with TMAP in DevOps IT delivery
Quality Engineering and Testing with TMAP in DevOps IT delivery
 
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
Application Lifecycle Transformation...a DevOps Discussion - By David Miller ...
 
SANGEETHA S JADAV
SANGEETHA S JADAVSANGEETHA S JADAV
SANGEETHA S JADAV
 
CERTIFIED DATA CENTRE EXPERT
CERTIFIED DATA CENTRE EXPERTCERTIFIED DATA CENTRE EXPERT
CERTIFIED DATA CENTRE EXPERT
 
Flexible On Demand SoftWare Testing
Flexible On Demand SoftWare TestingFlexible On Demand SoftWare Testing
Flexible On Demand SoftWare Testing
 
'Quality Engineering: Build It Right The First Time' by Allan Woodcock, Shoba...
'Quality Engineering: Build It Right The First Time' by Allan Woodcock, Shoba...'Quality Engineering: Build It Right The First Time' by Allan Woodcock, Shoba...
'Quality Engineering: Build It Right The First Time' by Allan Woodcock, Shoba...
 
Automotive SPICE® 3.0 - What is new and what has changed?
Automotive SPICE® 3.0 - What is new and what has changed?Automotive SPICE® 3.0 - What is new and what has changed?
Automotive SPICE® 3.0 - What is new and what has changed?
 
Arsons informatique
Arsons informatiqueArsons informatique
Arsons informatique
 
Ashalatha Nagappa
Ashalatha NagappaAshalatha Nagappa
Ashalatha Nagappa
 
DevOps maturity models Knowit and DASA
DevOps maturity models Knowit and DASADevOps maturity models Knowit and DASA
DevOps maturity models Knowit and DASA
 
Agile, DevOps & Test
Agile, DevOps & TestAgile, DevOps & Test
Agile, DevOps & Test
 
Agile Journey to agile
Agile   Journey to agileAgile   Journey to agile
Agile Journey to agile
 
Abhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar_9.5 Years_Localization TestingAbhishek Tomar_9.5 Years_Localization Testing
Abhishek Tomar_9.5 Years_Localization Testing
 

Destaque

Building Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design SmarterBuilding Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design SmarterTechWell
 
Agile Estimation and Planning: Scrum, Kanban, and Beyond
Agile Estimation and Planning: Scrum, Kanban, and BeyondAgile Estimation and Planning: Scrum, Kanban, and Beyond
Agile Estimation and Planning: Scrum, Kanban, and BeyondTechWell
 
Agile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective ActionsAgile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective ActionsTechWell
 
Acceptance Test-driven Development: Mastering Agile Testing
Acceptance Test-driven Development: Mastering Agile TestingAcceptance Test-driven Development: Mastering Agile Testing
Acceptance Test-driven Development: Mastering Agile TestingTechWell
 
Find Requirements Defects to Build Better Software
Find Requirements Defects to Build Better SoftwareFind Requirements Defects to Build Better Software
Find Requirements Defects to Build Better SoftwareTechWell
 
Emotional Intelligence in Software Testing
Emotional Intelligence in Software TestingEmotional Intelligence in Software Testing
Emotional Intelligence in Software TestingTechWell
 
Bad Testing Metrics—and What To Do About Them
Bad Testing Metrics—and What To Do About ThemBad Testing Metrics—and What To Do About Them
Bad Testing Metrics—and What To Do About ThemTechWell
 
Automated Performance Profiling with Continuous Integration
Automated Performance Profiling with Continuous IntegrationAutomated Performance Profiling with Continuous Integration
Automated Performance Profiling with Continuous IntegrationTechWell
 
Presenting Test Results with Clarity and Confidence
Presenting Test Results with Clarity and ConfidencePresenting Test Results with Clarity and Confidence
Presenting Test Results with Clarity and ConfidenceTechWell
 
Building an Enterprise Performance and Load Testing Infrastructure
Building an Enterprise Performance and Load Testing InfrastructureBuilding an Enterprise Performance and Load Testing Infrastructure
Building an Enterprise Performance and Load Testing InfrastructureTechWell
 
Usability Testing in a Nutshell
Usability Testing in a NutshellUsability Testing in a Nutshell
Usability Testing in a NutshellTechWell
 
Keynote: Lightning Strikes the Keynotes
Keynote: Lightning Strikes the KeynotesKeynote: Lightning Strikes the Keynotes
Keynote: Lightning Strikes the KeynotesTechWell
 
Continuous Delivery at Ancestry.com
Continuous Delivery at Ancestry.comContinuous Delivery at Ancestry.com
Continuous Delivery at Ancestry.comTechWell
 
Usability Testing: Personas, Scenarios, Use Cases, and Test Cases
Usability Testing: Personas, Scenarios, Use Cases, and Test CasesUsability Testing: Personas, Scenarios, Use Cases, and Test Cases
Usability Testing: Personas, Scenarios, Use Cases, and Test CasesTechWell
 
Agile Release Planning, Metrics, and Retrospectives
Agile Release Planning, Metrics, and RetrospectivesAgile Release Planning, Metrics, and Retrospectives
Agile Release Planning, Metrics, and RetrospectivesTechWell
 
Sprint Reviews that Attract, Engage, and Enlighten Stakeholders
Sprint Reviews that Attract, Engage, and Enlighten StakeholdersSprint Reviews that Attract, Engage, and Enlighten Stakeholders
Sprint Reviews that Attract, Engage, and Enlighten StakeholdersTechWell
 
Leading Change―Even If You’re Not in Charge
Leading Change―Even If You’re Not in ChargeLeading Change―Even If You’re Not in Charge
Leading Change―Even If You’re Not in ChargeTechWell
 
The Business Analyst’s Critical Role in Agile Projects
The Business Analyst’s Critical Role in Agile ProjectsThe Business Analyst’s Critical Role in Agile Projects
The Business Analyst’s Critical Role in Agile ProjectsTechWell
 

Destaque (18)

Building Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design SmarterBuilding Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design Smarter
 
Agile Estimation and Planning: Scrum, Kanban, and Beyond
Agile Estimation and Planning: Scrum, Kanban, and BeyondAgile Estimation and Planning: Scrum, Kanban, and Beyond
Agile Estimation and Planning: Scrum, Kanban, and Beyond
 
Agile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective ActionsAgile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective Actions
 
Acceptance Test-driven Development: Mastering Agile Testing
Acceptance Test-driven Development: Mastering Agile TestingAcceptance Test-driven Development: Mastering Agile Testing
Acceptance Test-driven Development: Mastering Agile Testing
 
Find Requirements Defects to Build Better Software
Find Requirements Defects to Build Better SoftwareFind Requirements Defects to Build Better Software
Find Requirements Defects to Build Better Software
 
Emotional Intelligence in Software Testing
Emotional Intelligence in Software TestingEmotional Intelligence in Software Testing
Emotional Intelligence in Software Testing
 
Bad Testing Metrics—and What To Do About Them
Bad Testing Metrics—and What To Do About ThemBad Testing Metrics—and What To Do About Them
Bad Testing Metrics—and What To Do About Them
 
Automated Performance Profiling with Continuous Integration
Automated Performance Profiling with Continuous IntegrationAutomated Performance Profiling with Continuous Integration
Automated Performance Profiling with Continuous Integration
 
Presenting Test Results with Clarity and Confidence
Presenting Test Results with Clarity and ConfidencePresenting Test Results with Clarity and Confidence
Presenting Test Results with Clarity and Confidence
 
Building an Enterprise Performance and Load Testing Infrastructure
Building an Enterprise Performance and Load Testing InfrastructureBuilding an Enterprise Performance and Load Testing Infrastructure
Building an Enterprise Performance and Load Testing Infrastructure
 
Usability Testing in a Nutshell
Usability Testing in a NutshellUsability Testing in a Nutshell
Usability Testing in a Nutshell
 
Keynote: Lightning Strikes the Keynotes
Keynote: Lightning Strikes the KeynotesKeynote: Lightning Strikes the Keynotes
Keynote: Lightning Strikes the Keynotes
 
Continuous Delivery at Ancestry.com
Continuous Delivery at Ancestry.comContinuous Delivery at Ancestry.com
Continuous Delivery at Ancestry.com
 
Usability Testing: Personas, Scenarios, Use Cases, and Test Cases
Usability Testing: Personas, Scenarios, Use Cases, and Test CasesUsability Testing: Personas, Scenarios, Use Cases, and Test Cases
Usability Testing: Personas, Scenarios, Use Cases, and Test Cases
 
Agile Release Planning, Metrics, and Retrospectives
Agile Release Planning, Metrics, and RetrospectivesAgile Release Planning, Metrics, and Retrospectives
Agile Release Planning, Metrics, and Retrospectives
 
Sprint Reviews that Attract, Engage, and Enlighten Stakeholders
Sprint Reviews that Attract, Engage, and Enlighten StakeholdersSprint Reviews that Attract, Engage, and Enlighten Stakeholders
Sprint Reviews that Attract, Engage, and Enlighten Stakeholders
 
Leading Change―Even If You’re Not in Charge
Leading Change―Even If You’re Not in ChargeLeading Change―Even If You’re Not in Charge
Leading Change―Even If You’re Not in Charge
 
The Business Analyst’s Critical Role in Agile Projects
The Business Analyst’s Critical Role in Agile ProjectsThe Business Analyst’s Critical Role in Agile Projects
The Business Analyst’s Critical Role in Agile Projects
 

Semelhante a Requirements Engineering: A Practicum

Webinar: How to get localization and testing for medical devices done right
Webinar: How to get localization and testing for medical devices done right Webinar: How to get localization and testing for medical devices done right
Webinar: How to get localization and testing for medical devices done right Qualitest
 
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...ESEM 2014
 
Discovering New Product Introduction using Autodesk PLM 360 – Rodney Coffey, ...
Discovering New Product Introduction using Autodesk PLM 360 – Rodney Coffey, ...Discovering New Product Introduction using Autodesk PLM 360 – Rodney Coffey, ...
Discovering New Product Introduction using Autodesk PLM 360 – Rodney Coffey, ...Synergis Engineering Design Solutions
 
Discovering New Product Introduction (NPI) using Autodesk Fusion Lifecycle
Discovering New Product Introduction (NPI) using Autodesk Fusion LifecycleDiscovering New Product Introduction (NPI) using Autodesk Fusion Lifecycle
Discovering New Product Introduction (NPI) using Autodesk Fusion LifecycleRazorleaf Corporation
 
Expand the Business Value of Riverbed Solutions with New Optimize Services
Expand the Business Value of Riverbed Solutions with New Optimize ServicesExpand the Business Value of Riverbed Solutions with New Optimize Services
Expand the Business Value of Riverbed Solutions with New Optimize ServicesRiverbed Technology
 
Software Testing - Defect Metrics & Analysis
Software Testing - Defect Metrics & AnalysisSoftware Testing - Defect Metrics & Analysis
Software Testing - Defect Metrics & AnalysisOAK Systems Pvt Ltd
 
Test Defect Metrics and Analysis
Test Defect Metrics and AnalysisTest Defect Metrics and Analysis
Test Defect Metrics and AnalysisOak Systems
 
Zero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsZero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsTaUB Solutions
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAnanya Pani
 
Narendra tomar (test manager)
Narendra tomar (test manager)Narendra tomar (test manager)
Narendra tomar (test manager)Narendra Tomar
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAnanya Pani
 
Resume for oracle developer
Resume for oracle developerResume for oracle developer
Resume for oracle developerBalaji vinayagam
 
Top Business Benefits of Application Lifecycle Management (ALM)
Top Business Benefits of Application Lifecycle Management (ALM)Top Business Benefits of Application Lifecycle Management (ALM)
Top Business Benefits of Application Lifecycle Management (ALM)Imaginet
 
puneet_pall_resume
puneet_pall_resumepuneet_pall_resume
puneet_pall_resumepuneet pall
 
Reducing timeincreasingvalue0503
Reducing timeincreasingvalue0503Reducing timeincreasingvalue0503
Reducing timeincreasingvalue0503Omnex Inc.
 
PRASAD RESUME_10 years.....
PRASAD RESUME_10 years.....PRASAD RESUME_10 years.....
PRASAD RESUME_10 years.....prasad durga
 
Rohit Oza_CV_2015
Rohit Oza_CV_2015Rohit Oza_CV_2015
Rohit Oza_CV_2015Rohit Oza
 
All About Business Analyst Becoming a successful BA
All About Business Analyst Becoming a successful BAAll About Business Analyst Becoming a successful BA
All About Business Analyst Becoming a successful BAZaranTech LLC
 
Corporate Presentation.pptx
Corporate Presentation.pptxCorporate Presentation.pptx
Corporate Presentation.pptxSreehari761280
 

Semelhante a Requirements Engineering: A Practicum (20)

Webinar: How to get localization and testing for medical devices done right
Webinar: How to get localization and testing for medical devices done right Webinar: How to get localization and testing for medical devices done right
Webinar: How to get localization and testing for medical devices done right
 
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
Keynote 2 - The 20% of software engineering practices that contribute to 80% ...
 
Discovering New Product Introduction using Autodesk PLM 360 – Rodney Coffey, ...
Discovering New Product Introduction using Autodesk PLM 360 – Rodney Coffey, ...Discovering New Product Introduction using Autodesk PLM 360 – Rodney Coffey, ...
Discovering New Product Introduction using Autodesk PLM 360 – Rodney Coffey, ...
 
Discovering New Product Introduction (NPI) using Autodesk Fusion Lifecycle
Discovering New Product Introduction (NPI) using Autodesk Fusion LifecycleDiscovering New Product Introduction (NPI) using Autodesk Fusion Lifecycle
Discovering New Product Introduction (NPI) using Autodesk Fusion Lifecycle
 
Expand the Business Value of Riverbed Solutions with New Optimize Services
Expand the Business Value of Riverbed Solutions with New Optimize ServicesExpand the Business Value of Riverbed Solutions with New Optimize Services
Expand the Business Value of Riverbed Solutions with New Optimize Services
 
Software Testing - Defect Metrics & Analysis
Software Testing - Defect Metrics & AnalysisSoftware Testing - Defect Metrics & Analysis
Software Testing - Defect Metrics & Analysis
 
Test Defect Metrics and Analysis
Test Defect Metrics and AnalysisTest Defect Metrics and Analysis
Test Defect Metrics and Analysis
 
Rohit Kumar
Rohit KumarRohit Kumar
Rohit Kumar
 
Zero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOpsZero touch QA automation platform for DevOps
Zero touch QA automation platform for DevOps
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Narendra tomar (test manager)
Narendra tomar (test manager)Narendra tomar (test manager)
Narendra tomar (test manager)
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Resume for oracle developer
Resume for oracle developerResume for oracle developer
Resume for oracle developer
 
Top Business Benefits of Application Lifecycle Management (ALM)
Top Business Benefits of Application Lifecycle Management (ALM)Top Business Benefits of Application Lifecycle Management (ALM)
Top Business Benefits of Application Lifecycle Management (ALM)
 
puneet_pall_resume
puneet_pall_resumepuneet_pall_resume
puneet_pall_resume
 
Reducing timeincreasingvalue0503
Reducing timeincreasingvalue0503Reducing timeincreasingvalue0503
Reducing timeincreasingvalue0503
 
PRASAD RESUME_10 years.....
PRASAD RESUME_10 years.....PRASAD RESUME_10 years.....
PRASAD RESUME_10 years.....
 
Rohit Oza_CV_2015
Rohit Oza_CV_2015Rohit Oza_CV_2015
Rohit Oza_CV_2015
 
All About Business Analyst Becoming a successful BA
All About Business Analyst Becoming a successful BAAll About Business Analyst Becoming a successful BA
All About Business Analyst Becoming a successful BA
 
Corporate Presentation.pptx
Corporate Presentation.pptxCorporate Presentation.pptx
Corporate Presentation.pptx
 

Mais de TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and RecoveringTechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartTechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyTechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowTechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipTechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsTechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationTechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessTechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateTechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessTechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
 

Mais de TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Último

Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 

Último (20)

Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 

Requirements Engineering: A Practicum

  • 1. MB Full day Tutorial 11/11/2013 8:30 AM "Requirements Engineering: A Practicum" Presented by: Erik van Veenendaal Improve IT Services BV Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888 268 8770 904 278 0524 sqeinfo@sqe.com www.sqe.com
  • 2. Erik van Veenendaal Improve IT Services BV A leading international consultant, trainer, and recognized expert in software testing, Erik van Veenendaal (erikvanveenendaal.nl) is the founder of Improve IT Services BV, a company that specializes in testing, requirements engineering, and quality management. Erik is the author of a number of books and papers, one of the core developers of the TMap testing methodology and the TMMi improvement model, a participant in working parties of the International Requirements Engineering Board, and currently on the TMMi Foundation board. He is a frequent speaker at international testing conferences. For his major contribution to the field of testing, Erik received the 2007 European Testing Excellence Award.
  • 3. Requirements Engineering Quality makes products which do not return and customers who do Erik van Veenendaal www.erikvanveenendaal.nl Do not put content on the brand signature area Requirements Engineering: A Practicum •  08:30 – 09:15 Introduction to Requirements Engineering 09:15 – 10:00 Kick-off Phase 10:00 – 10:15 Requirements Gathering •  10:30 – 11:15 Requirements Gathering - cont. 11.15 – 12.00 Requirements Specification •  13.00 – 13.30 Exercise Radio Watch (1) 13.30 – 14.15 Requirements Specification – cont. 14.15 – 14.45 Exercise Radio Watch (2) •  15:00 – 15:45 Verification and Validation 15.45 – 16.05 Exercise Radio Watch (3) 16.05 – 16.30 IREB, Evaluation and Closure Improve Quality Services B.V. 2 Do not put content on the brand signature area
  • 4. Learning Objectives Learning by thinking and doing !  Understand the importance of requirements !  Have an overview of requirements engineering process !  Learn a structured approach for writing good requirements in a natural language !  Provide practical ideas for writing better requirements !  Be able to organize and participate in requirements reviews !  Note: in Agile requirements come as user stories Improve Quality Services BV 3 Erik van Veenendaal www. erikvanveenendaal.nl !  Founder and major shareholder ImproveQS !  In testing since 1989 working for many different clients and in many different roles !  Author “TMap”, “TMMi”, “ISTQB Foundation” and many other books and papers !  Vice-President International Software Testing Qualifications Board (ISTQB) 2005 - 2008 !  Supporting member IREB board !  Keynote speaker, e.g., EuroSTAR, STAR !  Winner of the European Testing Excellence Award (2007) Improve Quality Services BV 4
  • 5. Improve Quality Services BV www. improveqs.nl ! Service organisation in the area of Testing, Requirements Engineering and Quality Management ! Consultancy, Subcontracting and Training Testing (TMap, TMMi) Agile Testing (CAT) Test Process Improvement Certification (ISTQB) Inspections / Reviews Improve Quality Services BV SW Process Improvement Quality Level Management IT-Auditing Requirements Engineering & management (IREB) 5 How I got involved? ! Tester: “Can’t test this, not clear, not unambiguous” ! Requirements engineer: “What is a good testable requirement?” ! Tester: “Uuuuhhhh…. SMART” ! Requirements engineer: “Let’s define ‘what are the requirements for requirements?’” Improve Quality Services BV 6
  • 6. Understanding Requirements Improve Quality Services B.V. 7 The Challenge !  To capture the need “completely” and “unambiguously” without resorting to specialist jargon, thus understandable by our stakeholders !  Requirements are the basis for: - Project (sprint) planning - Trade-off (priority setting) - Development - Acceptance testing Improve Quality Services B.V. 8
  • 7. Outsourcing !? Why? !  Most significant contributors to project failure relate to requirements (Standish Group CHAOS report) !  Most frequently named cause of total project failure was changing requirements (Study Computer Industry Daily of 500 IT managers USA &UK) "  Note: Agile much more capable of managing this !  Requirements Engineering & Management seen as biggest problem in software development processes (EU Survey) Improve Quality Services B.V. 9 Project Success Factors…. Reliable Estimates Formal methodology Standard software infrastructure Executive support Minimized scope 6% 5% 10% 8% 12% 18% 16% Experienced Project Manager 14% 5% 6% Clear business objectives User involvement Firm basic requirements Other Source: “Extreme Chaos” The Standish Group. www.standishgroup.com Improve Quality Services BV 10 44%
  • 8. More facts and figures Req. GD DD Impl. Test Oper. !  Investing less than 5% in gathering and processing requirements will lead to budget overruns of approximately 80% - 200% !  50% of the defects reported during system and acceptance testing can be traced to requirements engineering !  Requirements defects are the most important - defects have the characteristic to multiply themselves top-down - cost of rework rise (exponentially) Improve Quality Services B.V. 11 Importance of Requirements Different stakeholders Different objectives !  User/Customer # State their needs !  Agile Team # Develop sprint planning !  Project Manager # Develop budget/schedule !  System Engineers # Develop architecture !  Testers # Specify test plan & cases !  Software Engineers # Define work to be done Improve Quality Services BV 12
  • 9. What is a Requirement? A requirement is a condition or capability to which the system must conform … a capability needed by the user to solve a problem or achieve an objective … a capability that must be met or possessed by a system to satisfy a contract, specification, standard or other formally imposed documentation … a statement of intent that describes something the system needs to do for some user . Improve Quality Services B.V. 13 Three Types of Requirements !  Functional requirements are things the product must do -The product shall produce an updated schedule - As a <student>, I want <to be able to buy a parking pass> so I can <get to school quickly> !  Non-functional requirements (e.g., ISO9126) are the properties that the product must have -  The product shall determine ... in less than 0.25 seconds -  As a <member of the public> I want <the website to adequately cope with high loads> so I can <purchase a ticket quickly for a highly subscribed event> !  A constraint is a restriction on the scope or design of the product - The product shall run on the ... platform Improve Quality Services BV 14
  • 10. A main principle……. How much documentation is enough? "  Requirements process is context dependent !  User requirements – problem domain - State what the stakeholders want to achieve through use of the system. Avoid reference to any particular solution. “The user shall be able to…..” !  System requirements – solution domain - State abstractly how the system will meet the stakeholder requirements. Avoid reference to any particular design. “The product shall …..” !  Agile / V-model / Outsourcing !  Business / Project / Product / Human factors Improve Quality Services BV 15 More Definitions…. ! Requirements Engineering - A systematic approach to gathering, organizing, and documenting the requirements of the system ! Requirements Management - A process that establishes and maintains agreement between the customer and the project on the changing requirements of the system - Agile: Managing the Backlog by Product Owner Improve Quality Services BV 16
  • 11. Requirements Proces (1) 1 2 3 4 5 1.  Kick-off phase !  Objective, scope, stakeholders, business case !  Check: Are things clear enough to start? 2.  Requirements gathering (quantity-based) !  Functional, Non-functional, Constraints !  Various gathering / elicitation techniques 3.  Requirements specification (quality-based) !  Templates, Rule set !  Multiple levels, level of detail needed Improve Quality Services B.V. 17 Requirements Proces (2) 4.  Verification and Validation 1 2 3 4 5 !  Checking requirements !  Different types (walkthrough, pair-inspection) !  Use rules and checklists 5.  Requirements management !  Identification and traceability !  Use attributes, e.g., source !  Change management !  Relates to the entire proces Improve Quality Services B.V. Note, in Agile this is not a lineair process 18
  • 12. Requirements Engineering: A Practicum •  08:30 – 09:15 Introduction to Requirements Engineering 09:15 – 10:00 Kick-off Phase 10:00 – 10:15 Requirements Gathering •  10:30 – 11:30 Requirements Gathering - cont. 11.30 – 12.00 Requirements Specification •  13.00 – 13.30 Exercise Radio Watch (1) 13.30 – 14.15 Requirements Specification – cont. 14.15 – 14.45 Exercise Radio Watch (2) •  15:00 – 15:45 Verification and Validation 15.45 – 16.05 Exercise Radio Watch (3) 16.05 – 16.40 IREB, Evaluation and Closure Improve Quality Services B.V. 19 Kick-off, What is needed? 1.  The purpose of the product 2.  Customers and other stakeholders 3.  Users of the product 4.  Scope of the product (context diagram) 5.  Glossary: naming conventions, abbreviations and definitions 6.  Relevant facts and assumptions 7.  References Improve Quality Services BV 20
  • 13. The purpose of the product PRINCE-2 “Business Case” RuP “Vision document” !  The user problem (no more than 1 page) - A short description of the situation that triggered the development effort - Describe the work that should be improved !  Goals of the project - What will the product do? (purpose) - What is the business advantage? - How will you measure the advantage? - Statement of needs on a high-level Improve Quality Services BV Get stakeholders commitment on this !! 21 Purpose Example (A’dam Metro) Purpose: To sell metro tickets more efficiently (faster) than currently. Rational: To increase sales and reduce cueing while buying metro tickets. Acceptance Criteria: The product will hand out ticket 30% faster than the current system. This improvement shall be achieved on all priority 1 stations at peak hours. Improve Quality Services BV 22
  • 14. Stakeholders !  A stakeholder is anyone who is interested in the product !  Stakeholders may use it, are affected by it, have specific knowledge on it, or develop the product " Brainstorm a list of stakeholders " Document the knowledge area of the stakeholders (e.g. typical use cases, nonfunctional or other requirements) " Forgotten stakeholders means forgotten req.’s !! Improve Quality Services BV 23 Users of the Product !  The purpose of identifying the users, so that you can understand the work that they do and the product you must build for them !  For the users, describe all the known and potential users and their attributes !  The roles (actors) for the user stories (use cases) to be defined later " Forgotten users means forgotten req.’s !! Improve Quality Services BV 24
  • 15. Context of Use !  !  The functionality and usability of a product is effected by its context of use Context is characterized by : - the users of the product - the tasks they carry out - the working environment -… !  Tool : Context of Use checklist MuSIC Improve Quality Services BV 25 The Scope of the Requirements !  The context defines the extent of the work !  … also what is NOT included !  The context is provided by the services provided by the work !  … and the needs of the outside world !  Defines the scope of the work by showing the connections to the adjacent systems !  Includes all desired capabilities Improve Quality Services BV 26
  • 16. At system level adjacent systems Context diagram Adjacent Process Adjacent Process Work to be studied (functionalities and data) Adjacent Process Improve Quality Services BV Services provided by the product Needed by the product to provide the services 27 Naming conventions/definitions !  Misunderstood terms cause problems !  Start a list of important terms used by the stakeholders !  This will be enlarged and refined later !  If your terms invoke the right meaning they save hours of explanation !  Check for internal and industry-standards " Later….”Do all terms have a requirement? “ ! Improve Quality Services BV 28
  • 17. At the end of the Kick-off !  How much do you know? !  Enough to start gathering the req.’s? !  Do you have a measurable purpose? !  Do you know all the stakeholders and users? !  Is the scope clearly defined? !  Should you proceed or ask for more and better information? Improve Quality Services BV 29 Discussion Exercise 1.  Become acquainted – introduce yourself 2.  State in keywords the most important requirements issues in your projects / organization 3.  How do you start the requirements process in your organization? 4.  Consider the effect of a poor requirements “kick-off” – Do you mitigate these risks? Improve Quality Services BV 30
  • 18. Requirements Engineering: A Practicum •  08:30 – 09:15 Introduction to Requirements Engineering 09:15 – 10:00 Kick-off Phase 10:00 – 10:15 Requirements Gathering •  10:30 – 11:30 Requirements Gathering - cont. 11.30 – 12.00 Requirements Specification •  13.00 – 13.30 Exercise Radio Watch (1) 13.30 – 14.15 Requirements Specification – cont. 14.15 – 14.45 Exercise Radio Watch (2) •  15:00 – 15:45 Verification and Validation 15.45 – 16.05 Exercise Radio Watch (3) 16.05 – 16.30 IREB, Evaluation and Closure Improve Quality Services B.V. 31 Kano model: three categories Not fulfilled Basic factors Must-be quality Performance factors Fulfilled Extremely dissatisfied Not dissatisfied Dissatisfied Satisfied Not dissatisfied Extremely satisfied Expected quality Excitement factors Attractive quality Improve Quality Services BV 32
  • 19. Requirements Gathering (1) !  Finding conscious, unconscious and subconscious requirements !  Approach depends on: - risk factors - experience of the req. engineer - time & budget - availability stakeholders -  granularity and the degree of detail needed -  system context -  availability of sources, e.g., systems / documentation -  … !  All about quantity not quality # building the backlog Improve Quality Services BV 33 Requirements Gathering (2) !  Survey techniques !  Observation techniques - Interviews, questionnaires !  Creativity techniques −  Apprenticing, field observation !  Document-centric techniques - Brainstorming, change of perspective, analogies, role playing −  System archaeology, reuse of requirements Combining different techniques for the best result … Improve Quality Services BV 34
  • 20. Interview the stakeholders !  Not the sole technique !! - Users don’t know all the requirements…. !  Closed questions start with words like Do.. Is.. Can..Could..Will..Would..Shall.. -These usually get yes/no answers !  Open questions start with words like How..Why..When..Where..What..Who - Are more likely to extract information !  Use answers from one questions to ask a new one Improve Quality Services BV 35 Interview the stakeholders (2) !  How will you know if you have been successful? What do you want to achieve? - Prepare a checklist of topics to be discussed !  Plan the venue of the interview: ideally the stakeholder’s workplace !  Plan the boundary of your interview (and make this clear at the beginning) !  Ask yourself: Why should the stakeholder care about this interview? !  At the end, of course, thank the stakeholder and tell what you will do with the information…. Improve Quality Services BV 36
  • 21. Interview Process People factors are critical !! 1.  Getting acquainted 2.  Explain rules 3.  Gather requirements - check your observations - record draft requirements 4.  Summary “have I missed anything?” 5.  Closure “what can I do better next time?” Improve Quality Services BV 37 Questionnaire NF-requirements !  In stakeholders’ (users’) language !  Business characteristics - objectives, process, users, software product - two versions: information systems and technical automation, e.g. embedded !  Interview with various stakeholders -1 hour per interview !  Answers linked to quality attributes - two dimensional matrices -  business characteristics versus ISO 9126 !  Note NF-requirements are often on a system level Improve Quality Services BV 38
  • 22. Examples Checklist Items note, rationale becomes clear as well !  Objectives - Higher level of efficiency / productivity   req.’s on usability and time-behaviour - Continuity of information services   req.’s on maintainability and portability !  Business process - Primary process with a high risk level   req.’s on reliability - Very dynamic process; the process has interrelationships with a great number of other processes (complex)   req.’s on maintainability and usability Improve Quality Services BV 39 Brainstorming !  Requirements gathering is invention !  Objective of brainstorming is to be as imaginative as possible, and so generate as many ideas as possible !  List, discuss and group the ideas - Initially five items and then discuss, next round … !  Check the ideas with the project scope !  Later turn them into requirements !  Think about a facilitator Improve Quality Services BV 40
  • 23. Brainstorming: simple rules !  Wide range of disciplines and experience !  Start with a well-defined, open ended statement of the problem (e.g. context diagram) !  Write every idea down (a piece of paper is never big enough!), without censoring: any idea is a good one! !  Define subgroups to elaborate on a type or functionality !  Suspend judgment and evaluation !  Piggyback on each others’ ideas !  Use a separate section for project issues & design Improve Quality Services BV 41 Study the current situation !  Understanding what we seek to change !  Current system contains many of the needed requirements (abstract from technology) - Often implicit requirements !  Ask “What is right with this system?” !  Draw a model of the current system !  Also include system from competitors !  Practice apprenticing “Nobody can talk better about what they do, and why they do it, than they can while in the middle of doing it” Improve Quality Services BV 42
  • 24. Supporting Tools ! Mind mapping ! Prototyping ! Use Case Workshops ! Etc. Improve Quality Services B.V. 43 Mind maps www.visual-mind.com www.freemind.com !  Mind maps to explore ideas !  Useful devices to organize your thoughts !  You see the links between the various aspects of the product that have been told about !  Useful during interviewing users /stakeholders and brainstorming !  Improve sharing of thoughts and knowledge !  Some use class diagrams as a basic structure Improve Quality Services BV 44
  • 25. Prototypes !  For information gathering !  Some requirements are not obvious, or are not fully elaborated yet !  Some users have trouble articulating their desires !  Give users the opportunity to use the requirements !  Restrict the prototypes to most common tasks !  Focus on the product, not the prototype “The truth is almost never in the words” Improve Quality Services B.V. 45 Especially useful when .. !  The product did not exist before !  The users have no experience with the kind of product !  The users are stuck in the current way of working !  The users have trouble stating their req.’s !  The requirements analyst / developer has trouble understanding what is required " Low-fidelity vs. High-fidelity prototypes 46
  • 26. Use Case Workshops / EPIC Describing the bigger picture !  Start with the context diagram !  Use cases give users a convenient way to partition the product !  Describes the bigger picture !  One or more use cases per business event •  also consider ‘misuse cases’, e.g., for security req. !  Six step scenario’s are a great starting point •  Name - Actor (user) •  Short description (‘happy day scenario’) •  Pre conditions Improve Quality Services BV - Post conditions 47 Use Cases use case req. !  Use case: sequence of transactions in a dialogue between a user and the product with a specified result !  EPIC: a large story that requires some level of breakdown into smaller stories in order for the work to be consumed in a single iteration. !  The use cases contain functional (and non-functional) requirements -  The requirements make up the work done by the use case !  Start by identifying the use case per business event and actor Improve Quality Services BV 48
  • 27. Hierarchy and Traceability Context diagram Use cases Req.’s Improve Quality Services BV EPICs User stories Req.’s User stories 49 Use Case Example (A’dam Metro) Use Case: Traveller buying a ticket. Actor: Traveller 1.  The traveller offers destination, type of ticket and payment to the product 2.  The product checks whether the payment is ok for the chose n destination and type of tickert 3.  The product checks whether the network is operational for the chosen destination. 4.  The product submits ticket and if necessary change. 5.  The product stores the transaction Improve Quality Services BV 50
  • 28. Requirements Example (A’dam Metro) Use Case step 2.: The product checks whether the payment is ok for the chosen destination and type of ticket Requirements: 2.1 The product shall establish that the payment consists of legally valid money . 2.2 The product shall calcuate the lowest fare for the destination considering day of week and time 2.3 The prodyct shall compare the travellers’ payment with the calculated payment 2.4 The product shall provide feedback in case the payment is not sufficient. Improve Quality Services BV 51 SWOT analysis Techniques & Tools Instruction: Choose two elicitation techniques (or tool) -  As a team what do you consider to be strong points / selling items of that technique? "  When to use! -  And what do you consider to be problems / draw backs / weaknesses of that technique? "  When hard (or not) to use! Improve Quality Services B.V. 52
  • 29. Requirements Engineering: A Practicum •  08:30 – 09:15 Introduction to Requirements Engineering 09:15 – 10:00 Kick-off Phase 10:00 – 10:15 Requirements Gathering •  10:30 – 11:30 Requirements Gathering - cont. 11.30 – 12.00 Requirements Specification •  13.00 – 13.30 Exercise Radio Watch (1) 13.30 – 14.15 Requirements Specification – cont. 14.15 – 14.45 Exercise Radio Watch (2) •  15:00 – 15:45 Verification and Validation 15.45 – 16.05 Exercise Radio Watch (3) 16.05 – 16.30 IREB, Evaluation and Closure Improve Quality Services B.V. 53 What is needed …. !  If we could look into each others brains, we wouldn’t need documentation … !  Documentation helps us to communicate Sender Encodes Message Joint code Receiver Decodes !  Be careful, words may not be enough! - Formal / informal language - Different interpretations Improve Quality Services B.V. 54
  • 30. "I didn't say he killed his wife“ "I didn't say he killed his wife" "I didn't say he killed his wife" "I didn't say he killed his wife" "I didn't say he killed his wife" "I didn't say he killed his wife" "I didn't say he killed his wife" "I didn't say he killed his wife" Improve Quality Services B.V. 55 What are “good” requirements? Identify at least five “rules” that determine whether a requirement is a good (or “poor”) requirement Consider !! !  Individual requirements !  Requirements attributes Improve Quality Services B.V. 56
  • 31. What is a good requirement? Improve Quality Services B.V. 57 Excercise Radio Watch (1) •  Study the requirement specification for the new Radio Watch •  Make comments (find defects) based on what you have learned so far e.g., attributes, rules, guidelines…. + Improve Quality Services BV 58
  • 32. Requirements cards Requirement # : Requirement Type : Description : Priority : Use case : Rationale : Source : Acceptance Criteria : Size : Supporting material : …annotation, conversation… Improve Quality Services B.V. 59 Requirements attributes (1) ! ID - To allow traceability ! Requirements Type - Allows req.’s to be sorted, grouping allows the requirements to be checked on completeness and for conflicts, e.g., by non-functional, by business process ! Use case - For traceability and change control purposes - Again for grouping etc. ! Description - The intent of the requirement (may initially be ambiguous) - the stakeholders’ whishes & needs Improve Quality Services B.V. 60
  • 33. Requirements attributes (2) !  Rationale - Reason behind the requirement’s existence. Helps to clarify and understand the requirement and to identify ‘gold plating’ req.’s. !  Priority -  Measure of the business value and importance. For negotiation, but also for risk-based testing !  Acceptance criteria - To make the requirement measurable and testable !  Source - Name of the person who raised the requirement , or document. !  Size - Number of story points Improve Quality Services B.V. 61 Gold plating ….. “Well, we might as well put it on board – although I’m not sure what use we’ll have for a box of rusty nails,62broken glas, and throwing darts.” Improve Quality Services BV
  • 34. Acceptance Criteria involve tester here !  We have to be able to tell whether a solution completely satisfies, or fits, a requirement !  To make requirements measurable !  In practice very important for non-functional requirements !  It is usually necessary to negotiate acceptance criteria with the stakeholder, e.g., •  90% of the customers must be able to get the correct ticket from the product in no more than 25 seconds Improve Quality Services B.V. 63 Example Acceptance Criteria Requirement / User Story - As a student, I want to be able to buy a parking pass so I can get to school quickly Acceptance Criteria -  The student will not receive the parking pass if the payment is insufficient -  One can only buy a parking pass to the school parking lot if the person is a registered student -  The student can only buy one parking pass per month -  ….. Improve Quality Services BV 64
  • 35. Writing Guidelines To write simple is as difficult as to be good !  Short and concise sentences and paragraphs !  One requirement per sentence - no compound requirements, a single verb !  Consistent terminology (homonyms) !  Avoid generalizations !  Use ‘must’, ‘can’ and similar words carefully - ‘shall’ is better, ‘can’ indicates options !  No solutions or design !  Directive language !  No pronouns Improve Quality Services BV 65 Use Templates www.requirementsengineering.info !  The <stakeholder> shall be able to <capability> -  The order clerk shall be able to raise an invoice !  As a <role>, I want <activity> so that <business value> - As a job seeker, I want to search for a job, so I can advance my career !  The <product> shall be able to <action> <entity> - The launcher shall be able to launch missiles !  The <product> shall <function> <object> every <performance> <unit> - The coffee machine shall produce a hot drink every 10 seconds Improve Quality Services B.V. 66
  • 36. Requirements Rule Set •  Usefull set of agreements •  Specify the contents and format of a requirement (and requirements document) •  More objective, less discussion •  Applied during specification and reviewing •  Organization specific •  Rules for tracing, format and content Improve Quality Services B.V. 67 Examples of Rules (1) !  Identification !  Valuable / purpose All forms of annotation, comments, notes, suggestions, examples, or !  Changes other items not part of the formal !  Grouping requirement shall be clearly indicated as such. This will be !  Uniqueness documented by using the attribute !  Consistency ‘additional information’. !  Annotation !  Language !  Knowledge responsible (source) Improve Quality Services B.V. 68
  • 37. Examples of Rules (2) !  Detail !  Brief / Small !  Unambiguous !  Priority !  Rationale !  Compound !  Independent Req.’s shall be unambiguous to the intended readership. Req.’s shall have only one interpretation. For example the word shall is used and not the word should. Words like can shall only be used when more than one option is available. Directive language (active voice) shall be used, e.g., specifies and not can specify. !  Technically achievable !  Testable Improve Quality Services B.V. 69 Interpretation: Unambiguous !  To be part of the backlog - The requirements shall be at the level of unambiguousness to allow product team level decisions to be taken. !  To be part of the sprint planning - The requirements shall be at the level of unambiguousness to allow for estimation in terms of effort and time. !  To be part of the sprint - The requirements shall provide enough information to allow for the execution of individual deliverables and tasks (e.g., detailed design, test design). Improve Quality Services B.V. 70
  • 38. Excercise Radio Watch (2) •  Select the rules that you will adhere too, and attributes that you will use •  Select a description template •  Rewrite some of the requirements for the new Radio Watch •  Make concrete improvement suggestions •  Watch out for fuzzy terms •  Use the requirements card Improve Quality Services BV 71 Fuzzy Terms List Mostly Might Appropriate Graceful Major May be of use to And/or Various Interface Improve Quality Services B.V. As needed Make sense Might make sense At minimum Slowly Including but not limited Suitable Clean and stable Several 72
  • 39. Prioritizing Requirements !  Use the priority (business value) attribute !  If this fails, sort the requirements / use cases using (MoSCoW): - Must have in next sprint - Should have in next sprint - Could have in next sprint - Would like if possible !  Prioritize “Should have” & “Could have” categories !  Usually highly subjective and many discussions Improve Quality Services BV 73 Priority Factors from Practice !  Selling item (marketing) Customization needed !  Usage intensity !  Business objectives !  Customer value Weightings can be applied !  Ease of implementation !  Cost of implementation !  Time-to-market PRISMA® !  Competition !  External visibility Improve Quality Services BV 74
  • 40. Stakeholders Involvement !  Identify stakeholders (internal and external) - product owner, end-user, business mgr., marketing, service department, help-desk, accountant, etc. !  Ask them to fill in the priority table - “1 to 5” scale or “0 to 9” for more differentiation !  Their views will differ !  Note, this may change as the project progresses Improve Quality Services BV 75 Stakeholders Involvement (2) 9 : Critical 5 : High 3 : Moderate 1 : Low 0 : None " Individual scoring Selling item 5 Item 2 4 5 Item 3 5 4 2 5 Item 5 Improve Quality Services BV Item 1 Item 4 they shall make choices 1 4 76 Usage …… intensity
  • 41. Consensus Meeting !  Discuss issue list - first defects found !! !  Result may influence development & test approach Impact Selling Item Usage intensity … Priority Number Item 1 5 4 1 10 Item 2 3 3 1 7 Item n Improve Quality Services B.V. 77 Achieving Consensus …. decide / announce before the meeting ! Talking it out ! Use the highest rating ! Use the average rating ! Use the most applied rating ! Defer to one of the team members - Let the “owner” decide ! Team voting ! Get an experts’ opinion Improve Quality Services B.V. 78
  • 42. Or Play the Card Game !  Poker Planning based ….. 'Risk management in agile projects: the PRISMA approach‘ in: Professional Tester (June 2012) downloadable from www.erikvanveenendaal.nl Improve Quality Services BV 79 The User Story Matrix X X X X X (Story X Size Points) X Relative Business Value 80 X Improve Quality Services BV
  • 43. Requirements Two Aspects !  Needs to be readable - The structure of the document, how it is organised and how the flow supports the reader to place individual requirements in context !  Needs to be processable - Qualities of individual requirements, clarity and preciseness and how they are divided into single traceable items -  Word doesn’t provide attributes, identifiers etc. tools do -  www.methods-tools.com / www.volere.co.uk/tools.htm Improve Quality Services BV 81 Readability: The Req.’s document !  Three main sections Putting together what we have gathered so far - Introduction - Overall description •  Constraints - Specific requirements •  Functional requirements (grouped) •  Non-functional requirements !  Useful Templates - help to identify missing req.’s - Volere (www.systemsguild.com) – business level - IEEE 830 Software Requirements Specification Improve Quality Services BV 82
  • 44. Requirements Engineering: A Practicum •  08:30 – 09:15 Introduction to Requirements Engineering 09:15 – 10:00 Kick-off Phase 10:00 – 10:15 Requirements Gathering •  10:30 – 11:15 Requirements Gathering - cont. 11.15 – 12.00 Requirements Specification •  13.00 – 13.30 Exercise Radio Watch (1) 13.30 – 14.15 Requirements Specification – cont. 14.15 – 14.45 Exercise Radio Watch (2) •  15:00 – 15:45 Verification and Validation 15.45 – 16.05 Exercise Radio Watch (3) 16.05 – 16.40 IREB, Evaluation and Closure Improve Quality Services B.V. 83 Core Agile Practice : Reviews Communication & Feedback Customer collaboration !  Walkthrough / Pair Inspection / Informal Reviews !  Priority to the profitable !  Apply review practices that make the difference 84
  • 45. Why Verification and Validation? ! Efficient and effective way to find defects - ambiguous, consistency, completeness, compound, ... ! Many defects have already been made before design has started - 50% “requirements related” ! Early defects are highly important - defects have the characteristic to multiply themselves top-down - cost of rework rises (exponentially) Req. Improve Quality Services B.V. Design Coding Testing 85 Requirements reviews - types ! Walkthrough (with stakeholders) Validation - product owner will guide the group through the requirements - common understanding, knowledge sharing, consensus ! Inspection (with fellow engineers) - formal check against rules - individual process to find defects - using checklists Improve Quality Services B.V. 86 Verification
  • 46. Processing Requirements information gathering communication consensus approval Walkthrough Requirements gathering Use cases Brainstorm Interviewing Mind mapping Inspection Requirements (user stories) Improve Quality Services BV 87 Review Process Overview Kick-Off Planning Preparation Meeting Improve Quality Services B.V. Rework 88 Exit
  • 47. Walkthrough •  Planning (scrum master): no formal entry criteria •  Preparation (reading): preparing questions •  Kick-off at the beginning of the meeting: objective •  Meeting: author provides explanation (e.g., scenario’s, prototypes, use cases) •  Scribe to records findings •  Scrum master manages the process (chair) •  Rework/exit: not formal, author continues the work Improve Quality Services B.V. 89 User Scenarios ! A scenario is a story that illustrates the action that the product will take for a specific case ! A scenario might be the generic ‘normal case’ story, or it would tell a specific story ! Think of “what if scenarios” !! ! Deals with one (or part of an) event / use case ! Used to discover missing requirements !! Improve Quality Services B.V. 90
  • 48. Pair Inspection •  Planning/Kick-off: requirements, rules, objective •  Preparation: individual, checking not reading •  Meeting: defects explained, discussion, logging? improvement suggestions? •  Rework: by author, log as a ‘checklist’ •  Follow-up/Exit: check updated requirements - 1 in10 defects is not addressed is correctly (Source: Les Hatton) Improve Quality Services B.V. 91 Check for Conflicts •  Look for pairs of requirements that are in conflict with each other •  Look at existence dependent requirements, e.g., one product data that the other needs •  Do any requirements cover the same subject? •  Is every use of terminology consistent with conventions and definitions? •  Real conflicts identify negotiation points Improve Quality Services BV 92
  • 49. Checklist vs. Rules ! Derived from rules - objectives ! Most frequent / important defects ! One page ! Dynamic document, not static ! Question form, “NO” means a defect ! Shall be company specific Improve Quality Services BV 93 Juran’s F-Test “The Game Rules” !  Close your slide copies now! !  No questions! No discussion. Make your best interpretation of the following rule : No instances of “F” allowed on the screen. Standard applies to any type of “F”, so count even “derivates” (example “f” and “F”) !  Count all defects for standard F !  Write down your count of “defects” when the time is up !  You may move to any position in the room to see better !  Do not interfere with the view of others !  You will get 2 minutes to check Improve Quality Services BV 94
  • 50. Juran's “F” Test "FEDERAL FUSES ARE THE RESULTS OF 75 YEARS OF SCIENTIFIC STUDY COMBINED WITH THE EXPERIENCE OF 14 YEARS." How many letter F's can you find on this page? Write the number down in this box Improve Quality Services BV 95 Checklist for “F” searching F1. Do you find the word “OF”? F2. Do you find large graphic patterns resembling F ? F3. Did you turn images backwards and all angles? F4. Did you find all numbers and shapes pronounced “F” for example 14, 75 and “frames”? F5.Check “f” sound in apostrophe and hyphen F6. Did you see the upside-down, backwards letter “t” (= “f”)? F7. ……... Improve Quality Services BV 96
  • 51. Excercise Radio Watch (3) ! You have found defects in the requirements for the new radio watch and you have re-written some of them. ! Assignment: As a team, review the requirements of your colleagues against the rules (!!) and provide recommendations for improvement ! “Good enough”?! Improve Quality Services BV 97 Requirements Engineering: A Practicum •  08:30 – 09:15 Introduction to Requirements Engineering 09:15 – 10:00 Kick-off Phase 10:00 – 10:15 Requirements Gathering •  10:30 – 11:15 Requirements Gathering - cont. 11.15 – 12.00 Requirements Specification •  13.00 – 13.30 Exercise Radio Watch (1) 13.30 – 14.15 Requirements Specification – cont. 14.15 – 14.45 Exercise Radio Watch (2) •  15:00 – 15:45 Verification and Validation 15.45 – 16.05 Exercise Radio Watch (3) 16.05 – 16.40 IREB, Evaluation and Closure Improve Quality Services B.V. 98
  • 52. IREB e.V. www.certified-re.de International Requirements Engineering Board !  A non-profit organization !  Board members are international recognized experts, e.g., Suzanne Robertson, Chris Rupp !  Erik van Veenendaal active as a supporting member !  Goal: to improve practices in requirements engineering and requirements management !  Based on SWEBOK, ISTQB, IPMA, IEEE !  iSQI active as examination body Improve Quality Services B.V. 99 IREB Foundation !  IREB Foundation Syllabus !  Defined Educational Objectives and Levels of Knowledge !  Three day training course !  75 minutes exam, 45 questions - Questions vary in difficulty and different (indicated) marking accordingly - At least 60% of possible score needed to pass -  E-based exam also possible !  Advanced syllabi also recently became available Improve Quality Services B.V. 100
  • 53. IREB activities (Status 01-01-2013) Finland Sweden United Kingdom Denmark USA Hungary South Korea Bulgaria Switzerland Israel Spain Venezuela Russia Germany The Netherlands China India Austria Malaysia Ecuador Sudan Columbia Egypt Singapore Australia Brazil South africa New Zealand Improve Quality Services B.V. 101 Things to do tomorrow From previous groups !  Introduce requirements attributes (cards) !  Add rationale early !  Write use cases/EPIC’s and add requirements !  Use multiple gathering techniques !  Write requirements, not (technical) solution !  Define and use requirements rules !  Use templates !  Introduce practical reviews !  Get the whole team involved Improve Quality Services B.V. 102
  • 54. Any questions.....? Thank you !! Improve Quality Services B.V. 103