The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
CloudTeams Methodology:
a Roadmap for Customer-Driven
Software Development
Iosif Alvertis
National Technical University of Athens

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
“A Product Manager (PM) is
responsible for making sure that a
team ships a great product.”
Product Management in Software Engineering: from Theory to Practice,
16/2/2017
2
“Cracking the PM Interview: How to Land a
Product Manager Job in Technology.”

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Product Management in Software Engineering: from Theory to Practice,
16/2/2017
3
This one?
“like a mini-CEO of their product.”

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Product Management in Software Engineering: from Theory to Practice,
16/2/2017
4
You can be this!
->Knowledge!!

Reading List
Design
Thinking
Jobs To Be
Done
Sprint
Lean Startup
Lean
Analytics
BullsEye
Framework
Customers’
Development
“It’s all about the design”
“It’s all about the jobs of the customers”
“Prototype in 5 days"
“Learn how to become efficient (lean)”
“Actually become lean”
“Lean Marketing”
“Put everything
together”
The tools

WILL IT BLEND?

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
The Theory: The CloudTeams
Methodology
7
Step IA. Ideation
Step IIA. User
Experience
Step IIIA. System
Backlog Definition/
Update
Step IB. Market
Test
Step IIB. User
Acceptance Testing
Step IIIB.
Regression and
Functional Testing
Software
Authoring
&Testing
Operations
performed using
preferred
services/Tools
Management and
Monitoring through
the CloudTeams
Platform
Operations
performed
using the
CloudTeams
Platform
Product Management in Software Engineering: from Theory to Practice,
16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
The Tool: CloudTeams
Platform
8
Product Management in Software Engineering: from Theory to Practice,
16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
CloudTeams in 60”
9
https://www.youtube.com/watch?v=OpPrR4uXchY&t=2s
Product Management in Software Engineering: from Theory to Practice,
16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
The Manual: The CloudTeams
Playbook
10
+
=
Product Management in Software Engineering: from Theory to Practice,
16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
We need your feedback!
(NOT THIS!)
12
Workshop
Product Management in Software Engineering: from Theory to Practice,
16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
The Workshop Structure
13
Step IA. Ideation
Step IIA. User
Experience
Step IIIA. System
Backlog Definition/
Update
Step IB. Market
Test
Step IIB. User
Acceptance Testing
Step IIIB.
Regression and
Functional Testing
Software Authoring &Testing
Product Management in Software Engineering: from Theory to Practice,
16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
The Methodology Unfolded
14
Ideation
User Experience
System Backlog
Definition/ Update
Market Test
User
Acceptance
Testing (UAT)
Regression &
Functional
Testing
Sprint Backlog
Definition
Design & Visual
Modelling
Coding
Automated
Acceptance
Testing
Continuous
Integration
Testing
Automated Unit
Testing
Software Authoring &Testing
Idea
Validation
Scenarios
Validation
User Stories
Validation
Product Validation
Release Validation
UAT Plan
Build Verification
Testing Plan
Development Cycle (“Sprint”)
AGILE
Validation
Verification
Backlog
Verification
Model
Verification
Code
Verification
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Combining with Methodologies
15
Time
User Validation
Market Validation
Functional
Verification
Build Verification
Product Ideation
Requirements
Development
Product Definition
Lean Waterfall
Agile
(Scrum)
Product Management in Software Engineering: from Theory to Practice,
16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Step 1: Ideation
16
Step1: Ideation
Idea
Validation
Validation
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

BUSINESS MODEL & LEAN CANVAS
BUSINESS
GOALS &
NEEDS
IDEAS
BACKLOG
MARKET SIZING &
COMPETITION
ANALYSIS
DESK RESEARCH
& TECHNICAL
SOLUTIONS
EPIPHANY &
BRAINSTORMING
TEAM MEETING
CUSTOMER
FEEDBACK
10 SLIDES PITCH &
6 PAGER REPORT
MANAGEMENT
APPROVALNO
YES
NO
YES
EXTERNAL
ADVISOR
PERSONAS
LIBRARY
PROBLEM
QUESTIONNAIRES
PROBLEM
INTERVIEWS
BUILD PERSONAS IN
CLOUDTEAMS
FIND CONTACTS FOR INTERVIEWS
DATA ANALYSIS
MEETING
CLARIFY BUSINESS
MODEL
MANAGEMENT
APPROVAL
RATE IDEA ON BUSINESS
CRITERIA
Idea
Validation
BRAINSTORMING MEETING
10 SLIDES PITCH &
6 PAGER REPORT
(UPDATED)
STEP 2

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Step 2: User Experience
18
Step1: Ideation
Step 2: User
Experience
Idea
Validation
Scenarios
Validation
Validation
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

SCENARIO
S
VALIDATION PLANNING MEETING
BRAINSTORMING
MEETING
MANAGEMENT
APPROVAL
IDEAS &
PERSONAS
VIDEOS
VIDEO
UAT PLAN
SOLUTION
INTERVIEWS
LANDING
PAGE
EVALUATE ON CRITERIA
STRATEGY
CROWD-
SOURCING
COLLABORATION
SESSIONS
VOTING
DATA ANALYSIS
AD
CAMPAIGN
2 LANDING
PAGES
A/B
TESTING
MOCKUPS
WIREFRAME
S
QUALITY EVALUATION
MEETING
YES
YES
NO
NO
Scenarios
Validation
STEP 1
STORYBOARD
S
10 SLIDES PITCH &
6 PAGER REPORT
(UPDATED)
STEP 3

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Step 3: System Backlog Definition
20
Step1: Ideation
Step 2: User
Experience
Step 3: System
Backlog
Definition/Update
Idea
Validation
Scenarios
Validation
User Stories
Validation
Validation
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

USAGE
SCENARIOS
IDEA
PERSONA
S
COLLABORATION ROUND 1
USER STORIES*
BUSINESS
MODEL
SCENARIO
S
MEDIA
MATERIAL
TECHNICAL TEAM:
ESTIMATIONS &
CONSULTATION
COLLABORATION ROUND 2
VOTING
PRIORITIZED
USER STORIES
COLLABORATION ROUND 3
USER STORIES
BACKLOG
TECHNICAL
CHARACTERISTICS
USAGE
WORKFLOWS
COLLABORATION
ROUND 4
UPDATED USAGE
WORKFLOWS
CUSTOMERS’
INTERVIEWS
FINAL USER
STORIES BACKLOG
FUNCTIONAL
REQUIREMENT
S
NON-FUNCTIONAL
REQUIREMENTS
PROTOTYPE**
QUESTIONNAIR
E
ANALYSIS
MEETING
User Stories
Validation
STEP 2
+
STEP 4

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
*User Stories Hierarchy
22
22
JOB TO BE DONE
(JTBD) FOR THE WHOLE
OFFERING
HIGH-LEVEL
USER STORIES
FOR PERSONA #1
HIGH-LEVEL
USER STORIES
FOR PERSONA #2
HIGH-LEVEL
USER STORIES
FOR PERSONA #N…
CASE-SPECIFIC
USER STORIES
FOR
STAKEHOLDER#1
CASE-SPECIFIC
USER STORIES
FOR
STAKEHOLDER#2
CASE-SPECIFIC
USER STORIES
FOR
STAKEHOLDER#M
Customer
Segments
Explored &
Unexplored
Markets
Users of the
offering
• “As a user, I want to call the vehicle on the
place I am, so that I don’t have to walk
around to find a taxi”
• “As a user, I want to split the fair with
another passenger, so that we don’t have
to exchange cash after the trip”
• “I want to move from place A to place B fast
and easy”.
Examples for Uber
• “As an asset manager, I want to move from
home to work and back, fast, easy and
inexpensive, so that I make my living”
• “As a college student, I want to return
home safe after a drinking night out, so that
I don’t have to drive and lose my driving
license”
Hierarchy in User StoriesGoal
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
**Prototyping (Vs MVP)
23
Prototype
A primitive model, sample or
version of a product for testing
an idea or a process, or acting
a means of learning
MVP
The product with the highest return
on investment versus risk. It has
those core features that allow the
product to be deployed, and no
more, and allow customers to start
paying for the service and giving
feedback.
It is a version of the product to
maximize customer
with the least effort.
Feasibility test, Controlled sample of users,
Design Thinking
Tests hypotheses, Tries to reach the customer,
Lean Startup
Learn fast your user Learn fast your customer
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Development Cycle (“Sprint”)
Steps 4-9: The “BLACK BOX”
24
Step1: Ideation
Step 2: User
Experience
Step 3: System
Backlog
Definition/Update
Market Test
Step 11: User
Acceptance
Testing (UAT)
Step 10:
Regression &
Functional
Testing
Idea
Validation
Scenarios
Validation
User Stories
Validation
Verification
Step 4: Sprint
Backlog
Definition
Step 5: Design &
Visual Modelling
Step 6: Coding
Step 9:
Automated
Acceptance
Testing
Step 8:
Continuous
Integration Testing
Step 7: Automated
Unit Testing
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Step 10: System Backlog Definition
25
Step1: Ideation
Step 2: User
Experience
Step 3: System
Backlog
Definition/Update
Step 10:
Regression &
Functional
Testing
Idea
Validation
Scenarios
Validation
User Stories
Validation
Verification
Step 4: Sprint
Backlog
Definition
Step 5: Design &
Visual Modelling
Step 6: Coding
Step 9:
Automated
Acceptance
Testing
Step 8:
Continuous
Integration Testing
Step 7: Automated
Unit Testing
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017
Build Verification
Testing Plan

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
UNSUPERVISED
TESTING
SUPERVISED
TESTING
ISSUES
BACKLOG
BUILD
STATUS
TESTING
PLAN
UPDATED
ISSUES BACKLOG
DEBUGGING
FUNCTIONAL
SUITABILITY*
PERFORMANCE
EFFICIENCY
COMPATIBILITY OPERABILITY
RELIABILITY SECURITY MAINTENABILITY PORTABILITY
Step 10: Regression &
Functional Testing
STEP 9
STEP 3
STEP 11
USE CASES
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017
Metrics ISO 25010:2011
Product Quality
Model

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
*Functional Suitability
27
Release
Number
Use Case
ID
Use case
Title
Completed
Without Help
Completed
with Help
Completed
with bugs
Not
Completed
because of
bug
Not
Completed
after help
Useful
(1-5)
Easy
(1-5)
Stakeholder Group Name
CODE.# Title Y/N Y/N Y/N Y/N Y/N
CODE.#
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Step 11: System Backlog Definition
28
Step1: Ideation
Step 2: User
Experience
Step 3: System
Backlog
Definition/Update
Step 11: User
Acceptance
Testing (UAT)
Step 10:
Regression &
Functional
Testing
Idea
Validation
Scenarios
Validation
User Stories
Validation
Validation
Step 4: Sprint
Backlog
Definition
Step 5: Design &
Visual Modelling
Step 6: Coding
Step 9:
Automated
Acceptance
Testing
Step 8:
Continuous
Integration Testing
Step 7: Automated
Unit Testing
Release Validation
UAT Plan
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
UPDATE
METHODOLOGY
TESTING
PLAN
UAT
REPORT
CREATE
QUESTIONNAIRE
COLLECT
RESPONSES
ANALYZE
PREPARE PUBLIC
LAUNCH
Methodology
ISO 25010: Quality
in use model
TAM
HMSAM
CloudTeams VnV
UEQ
Effectiveness
Efficiency
Satisfaction
Usefulness
Trust
Pleasure
Comfort
Safety
Economic damage risk
Privacy harm risk
Usability
Learnability
Flexibility
Accessibility
Content Conformity
Business Value
Clarity
Value
Need Level
Urgency
Need Coverage
Innovation/Uniqueness
Virality
Step 11: User
Acceptance Testing
STEP 10
STEP 2
STEP 12
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Step 12: Market Test
30
Step1: Ideation
Step 2: User
Experience
Step 3: System
Backlog
Definition/Update
Market Test
Step 11: User
Acceptance
Testing (UAT)
Step 10:
Regression &
Functional
Testing
Idea
Validation
Scenarios
Validation
User Stories
Validation
Validation
Step 4: Sprint
Backlog
Definition
Step 5: Design &
Visual Modelling
Step 6: Coding
Step 9:
Automated
Acceptance
Testing
Step 8:
Continuous
Integration Testing
Step 7: Automated
Unit Testing
Product Validation
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
BUSINESS
PLAN
DEFINE
WORKFLOW
CHOOSE PHASE
CHOOSE KEY
METRIC
PERIODIC
REPORT
Pivot Improve
IMPROVE
MARKETING
EFFICIENCY
Step 12: Market Test
Empathy
Stickiness
Virality
Revenue
Scale
E-Commerce
SaaS
Free App/Content
Media Content
UGC
Two-sided Market
STEP 11
STEP 2
STEP 1
STEP 1
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
The CloudTeams Planning…
33
Component
development
Architectural
design
System
requirements
User
requirements
Component
tests
Integration
tests
System tests
User tests /
Pilots
partners develop & refine their components in
parallel with short integration cycles for different subsystems
Year 1 Year 2
multiple
evaluations
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Outcomes (so far)
34
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017

The CloudTeams project has received funding from the European Union's
Horizon 2020 research and innovation programme under grant
agreement No 644617.
Be part of the round-table
discussion!
35
Product Management in Software Engineering: from Theory to Practice,
§16/2/2017
http://bit.ly/cloudteams2017