1.
building
andmeasuring
thedesign
experience.
KimFellmanCohen
DesignOpsSummit2019

2.
problems.

3.
problems.
careerdevelopment

4.
problems.
careerdevelopment
skillbuilding

5.
problems.
careerdevelopment
skillbuilding
teamevents

6.
problems.
careerdevelopment
skillbuilding
teamevents
morale

7.
problems.
careerdevelopment
skillbuilding
teamevents
morale
communications
philanthropy
blogposts
onboarding

8.
whatif?

9.
measurement value resources= =

10.
stayconnectedandlearn

11.
stayconnectedandlearn
defineproblemsandideate

12.
stayconnectedandlearn
defineproblemsandideate
formulaformeasurement

13.
stayconnectedandlearn
defineproblemsandideate
formulaformeasurement
testideaslikeaproduct

14.
stayconnectedandlearn
defineproblemsandideate
formulaformeasurement
testideaslikeaproduct
reportandlookforward

15.
nycnative.wutang
fan.bagelenthusiast.
artist.pinner.forever
huntingfortherightgif
foranemail.

16.
fueledby
ramen
agencies
buzzfeed
hedgefundpr
warnermusic
group
pinterest

17.
PinterestDesign
100people
8disciplines
productdesigners,uxwriters,ux
engineers,creativetechnologists,
designops,systemsdesigners,
researchers,productiondesigners

18.
problems.

19.
10050
53%
I can do my best work every day
43%
There are good career
opportunities for me at Pinterest
55%
I see myself working at Pinterest
in 12 months
59%
I feel like I belong at Pinterest

20.
leadprogram
manager
strategy+roadmap
tacticalcontribution
design
leadership
programmanager
tacticalcontribution
consultants
HR
learning&dev

21.
whyarethese
problemshardto
solveandmeasure?

22.
reactivevs.
proactive
problems.

23.
highriskreactivevs.
proactive
problems.

24.
highrisk
anchoror
gravity
problems
reactivevs.
proactive
problems.

25.
highrisk
anchoror
gravity
problems
vagueor
subjective
reactivevs.
proactive
problems.

26.
highrisk
anchoror
gravity
problems
vagueor
subjective
reactivevs.
proactive
highrateof
change
problems.

27.
enter…
designthinking.

28.
define
problems ideatelisten
designthinking.

29.
define
problems ideate prototype
+testlisten report
designthinking.

30.
it’sallhappening!

31.
stayconnected
andlearn.

32.
frameasetofquestionsthat
helpyoulearnwhatyouwant
toknowandtakethemonthe
road.

33.
frameasetofquestionsthat
helpyoulearnwhatyouwant
toknowandtakethemonthe
road.
Focusgroupsand1:1s
Surveys
Collaborativeboards

34.
learningscan
indicatewhatto
measure.

35.
“IcoulddomybestworkifIhad
fewermeetingsanddedicated
timefordesigningwithother
peopleontheteam.”

36.
“Iwishday-to-dayiterative
workwasperceivedtobeas
valuableasbig,sexyprojects.”

37.
“MymanagerandItalkabout
myperformance,butIcould
usemorehelpfiguringouthowI
shouldgrowinthenextyear.”

38.
taketimeto
definesolvable
problems.

39.
useaproblemcriteria.

40.
useaproblemcriteria.
Isthisproblemtherightscopeandsize?
Doesthisproblemprovideenoughcontextforideas?
Isitbroadenoughtogiveyouroomtoexplore?

41.
definedproblems.

42.
BestWork
How might we create
more collaboration
within the team?
Career
How might we make
career paths and
skills more clear?
How might we help
managers and
reports think about
long-term aspirations
together?
Value
How might we
recognize good work
on the team
regardless of it’s
scope?
problems.

43.
ideatetogether.

44.
brainstormwithadiverse
group.
Mixlevelsofexperience,background,rolesandtenure
brainstormwithadiverse
group.

45.
brainstormwithadiverse
group.
Mixlevelsofexperience,background,rolesandtenure
brainstormwithadiverse
group.
Mixlevelsofexperience,background,rolesandtenure
Peopleexperiencingtheproblems
Expertswithanewperspective
Stakeholderswhoneedtobuyinandempathize

46.
synthesizeusinganidea
criteria.

47.
Couldyouprototypeandtest thisinthenextmonth?
Doyouhavetheresourcestotrythis?
Canyoumeasuretheoutcomeclearly?
synthesizeusinganidea
criteria.

48.
greenlitideas.

49.
BestWork
Hold a weekly, two-
hour block for design
collaboration in one
location.
Career
Define the hard and
soft skills that make
team members
impactful.
Create a career
conversation template
that managers and
reports use to set
goals together.
Value
Set up a slack
channel for peer-to-
peer recognition.
Write a monthly
“user feedback love
letter” that shows
value of iterative
work.
ideas.

50.
definesuccess
withaformula.

51.
wewilldoathing thiswillhappenifthe
thingisworking
weneedathingforsupport

52.
Objective
Improve role
comprehension by
defining skills that
make team members
impactful.
SuccessMetric
5% increase in
career opportunity
question of company
survey
>60% of reports say
they understand
what is expected of
them
Support
Working group
nominees from
design leadership
H218

53.
40% Learn
60% Success
H218

54.
buildandtestyour
ideaslikeaproduct.

55.
don’tbuildalone.

56.
pilottolearnearlyandoften.

57.
failure.

58.
failinglearning.

59.
share
build
test
iterate

60.
reportresultsand
thinkforward.

61.
10050
53%
I can do my best work every day
43%
There are good career
opportunities for me at Pinterest
55%
I see myself working at Pinterest
in 12 months
59%
I feel like I belong at Pinterest

62.
10050
64%
I can do my best work every day
56%
There are good career
opportunities for me at Pinterest
67%
I see myself working at Pinterest
in 12 months
70%
I feel like I belong at Pinterest

63.
“whatwas”and goals
Career
Problem
Supporting
Projects
H22018Goal
There is no clear
path to develop skills
and progress in your
career on the team
Skills mapping
Skills inventory
exercise
1:1 resources
Career conversation
guide
5% increase in
career opportunity
question of company
survey
>60% of reports say
they understand
what is expected of
them

64.
clearlystateresults
Career
Problem
Supporting
Projects
Result
There is no clear
path to develop skills
and progress in your
career on the team
Skills mapping
Skills inventory
exercise
1:1 resources
Career conversation
guide
43% → 56%
13% increase

65.
what’snext?
BestWork
Idea
Supporting
Projects
Support
Support mastery of
craft by using our
skills mapping as a
guide for learning &
development
New manager
training
Skill building team
offsite
Monthly “design
school” classes
$10k for team offsite
$150 supply stipend
for monthly classes
$10k for external
course facilitators

66.
sharesomedetails.
18 Quote
Love notes to team
members from users
and cross-functional
partners
“Love letters are great. They continually
highlight work that improves the product, and
make me feel more connected to Pinners.
Excited to see how these expand to other
work that might be underrepresented!”

67.
howmightwe
shapethefuture?

68.
stayconnected
andlearn.

69.
10050
64% → 80%
I can do my best work every day
56% → 90%
There are good career
opportunities for me at Pinterest
67% → 80%
I see myself working at Pinterest
in 12 months
70% → 90%
I feel like I belong at Pinterest

70.
thatwasalot.

71.
tipsandtakeaways.
Stayconnectedandlearn

72.
Stayconnectedandlearn
Defineproblemsthatallowforlotsofideas
tipsandtakeaways.

73.
Stayconnectedandlearn
Defineproblemsthatallowforlotsofideas
Combinenumbers,opinionsandsupportneededin
yourmeasurement
tipsandtakeaways.

74.
Stayconnectedandlearn
Defineproblemsthatallowforlotsofideas
Combinenumbers,opinionsandsupportneededin
yourmeasurement
Testideaslikeaproductandshareresultsregularly
tipsandtakeaways.

75.
Stayconnectedandlearn
Defineproblemsthatallowforlotsofideas
Combinenumbers,opinionsandsupportneededin
yourmeasurement
Testideaslikeaproductandshareresultsregularly
Reportandthinkforward
tipsandtakeaways.

76.
you’rekindof
abigdeal.

77.
let’stalk
kimfellman@pinterest.com