SlideShare uma empresa Scribd logo
1 de 22
Baixar para ler offline
CHI: evaluatie

#chikul13
Leuven, 19 February 2012




Erik Duval
http://erikduval.wordpress.com
@ErikDuval




                                 1
http://www.slideshare.net/erik.duval




2
Criteria for evaluation:
     what do you think?


• ...             • ...
criteria

• Usability                • Learnability
• Usefulness               • Efficiency
• Meaning                  • Memorability
• (aesthetic) Qualities    • Accuracy

• Sociability              • Satisfaction
                             [Nielsen, 1993]
• formatief
 • tijdens het ontwikkelen
 • om te verbeteren
• summatief
 • op het einde
 • om te bewijzen dat “het (niet) werkt”
http://semanticstudios.com/publications/semantics/000029.php
Criteria
• Time
   • to learn the application
   • to perform task
   • that users remember how and what
• Errors
   • number
   • kind
• Subjective feeling of satisfaction

 Often a compromise - important to make explicit
methods

- questionnaire
- usability engineering
- by experts
- usage tracking
questionnaires




 http://hcibib.org/perlman/question.html
Fhttp://www.cc.gatech.edu/gvu/images/lab/usability-lab.jpg

                         Usability Lab
Usability engineering

•‘Think-aloud protocol‘
 •Video recording with annotation
 •Log, remarks, etc. for analysis
•‘Discount usability engineering’
•Comparative test of user interface
By experts
•in HCI or domain
•very effective
•delicate relation with developers
•target
   •identify problems
   •suggest solutions
•through checklist of guidelines
User tracking


• “attention metadata”
• google analytics
Participants
• representative
 • computer experience, language, task,
    motivation, education, etc.
 • gender, age
• have to know they are not being evaluated
• relationship
 • colleagues, friends, family, ...
they are ... human beings
how many?

                    Text




 http://www.useit.com/alertbox/20000319.html




 http://www.useit.com/alertbox/20000319.html
• every test user finds fraction L of usability
  issues

• independent test users
     n users find fraction 1-(1-L)n

• L=31%      85% for n=5, 99% for n=15
  L=8%       35% for n=5
Factors that influence usability:
       what do you think?



•...              •...
Factoren: Cognitief
•cognitive
 •fatigue, boredom, stress, fear, ...
•personality
 •gender (‘abort’)
•cultural
 •i18n
Trash can in Thailand
?
http://erikduval.wordpress.com/
           @ErikDuval



              22

Mais conteúdo relacionado

Destaque

20130214 les gb2
20130214 les gb220130214 les gb2
20130214 les gb2Erik Duval
 
HCI: evaluation
HCI: evaluationHCI: evaluation
HCI: evaluationErik Duval
 
Learning at KU Leuven in 2025
Learning at KU Leuven in 2025Learning at KU Leuven in 2025
Learning at KU Leuven in 2025Erik Duval
 
Evaluation technique
Evaluation techniqueEvaluation technique
Evaluation techniqueJunaid Ahmed
 
HCI 3e - Ch 11: User support
HCI 3e - Ch 11:  User supportHCI 3e - Ch 11:  User support
HCI 3e - Ch 11: User supportAlan Dix
 
eCloud newspapers
eCloud newspaperseCloud newspapers
eCloud newspapersErik Duval
 
HCI 3e - Ch 9: Evaluation techniques
HCI 3e - Ch 9:  Evaluation techniquesHCI 3e - Ch 9:  Evaluation techniques
HCI 3e - Ch 9: Evaluation techniquesAlan Dix
 

Destaque (7)

20130214 les gb2
20130214 les gb220130214 les gb2
20130214 les gb2
 
HCI: evaluation
HCI: evaluationHCI: evaluation
HCI: evaluation
 
Learning at KU Leuven in 2025
Learning at KU Leuven in 2025Learning at KU Leuven in 2025
Learning at KU Leuven in 2025
 
Evaluation technique
Evaluation techniqueEvaluation technique
Evaluation technique
 
HCI 3e - Ch 11: User support
HCI 3e - Ch 11:  User supportHCI 3e - Ch 11:  User support
HCI 3e - Ch 11: User support
 
eCloud newspapers
eCloud newspaperseCloud newspapers
eCloud newspapers
 
HCI 3e - Ch 9: Evaluation techniques
HCI 3e - Ch 9:  Evaluation techniquesHCI 3e - Ch 9:  Evaluation techniques
HCI 3e - Ch 9: Evaluation techniques
 

Semelhante a 20130219 chi evaluatie

CHI: evaluation
CHI: evaluationCHI: evaluation
CHI: evaluationErik Duval
 
CHI: evaluation
CHI: evaluationCHI: evaluation
CHI: evaluationErik Duval
 
01-Introduction to HCI.pptx
01-Introduction to HCI.pptx01-Introduction to HCI.pptx
01-Introduction to HCI.pptxLe Hung
 
EDGE-NEXT Nagoya "EPIC" keynote
EDGE-NEXT Nagoya "EPIC" keynoteEDGE-NEXT Nagoya "EPIC" keynote
EDGE-NEXT Nagoya "EPIC" keynoteNorris Krueger
 
Learning design toolkit v0.2
Learning design toolkit v0.2Learning design toolkit v0.2
Learning design toolkit v0.2lcallion
 
Methods and techniques-comm (3/6)
Methods and techniques-comm  (3/6)Methods and techniques-comm  (3/6)
Methods and techniques-comm (3/6)Roberta Cuel
 
Methods and techniques (2/6)
Methods and techniques (2/6)Methods and techniques (2/6)
Methods and techniques (2/6)Roberta Cuel
 
Елизавета Скоморохова - Usability Expert Review
Елизавета Скоморохова - Usability Expert ReviewЕлизавета Скоморохова - Usability Expert Review
Елизавета Скоморохова - Usability Expert ReviewDataArt
 
Learning dashboards
Learning dashboardsLearning dashboards
Learning dashboardsErik Duval
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerTao Zhang
 
Essential UX Skills for Technical Communicators (STC Summit 2010)
Essential UX Skills for Technical Communicators (STC Summit 2010)Essential UX Skills for Technical Communicators (STC Summit 2010)
Essential UX Skills for Technical Communicators (STC Summit 2010)Rachel Peters
 
​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...
​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...
​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...Rosenfeld Media
 
User Experience Showcase lightning talks - University of Edinburgh
User Experience Showcase lightning talks - University of EdinburghUser Experience Showcase lightning talks - University of Edinburgh
User Experience Showcase lightning talks - University of EdinburghNeil Allison
 

Semelhante a 20130219 chi evaluatie (20)

CHI: evaluation
CHI: evaluationCHI: evaluation
CHI: evaluation
 
CHI: evaluation
CHI: evaluationCHI: evaluation
CHI: evaluation
 
01-Introduction to HCI.pptx
01-Introduction to HCI.pptx01-Introduction to HCI.pptx
01-Introduction to HCI.pptx
 
EDGE-NEXT Nagoya "EPIC" keynote
EDGE-NEXT Nagoya "EPIC" keynoteEDGE-NEXT Nagoya "EPIC" keynote
EDGE-NEXT Nagoya "EPIC" keynote
 
Learning design toolkit v0.2
Learning design toolkit v0.2Learning design toolkit v0.2
Learning design toolkit v0.2
 
ICS3211_lecture 9_2022.pdf
ICS3211_lecture 9_2022.pdfICS3211_lecture 9_2022.pdf
ICS3211_lecture 9_2022.pdf
 
Methods and techniques-comm (3/6)
Methods and techniques-comm  (3/6)Methods and techniques-comm  (3/6)
Methods and techniques-comm (3/6)
 
Methods and techniques (2/6)
Methods and techniques (2/6)Methods and techniques (2/6)
Methods and techniques (2/6)
 
ICS3211 Lecture 9
ICS3211 Lecture 9ICS3211 Lecture 9
ICS3211 Lecture 9
 
Елизавета Скоморохова - Usability Expert Review
Елизавета Скоморохова - Usability Expert ReviewЕлизавета Скоморохова - Usability Expert Review
Елизавета Скоморохова - Usability Expert Review
 
Learning dashboards
Learning dashboardsLearning dashboards
Learning dashboards
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian Primer
 
ICS3211 lecture 10
ICS3211 lecture 10ICS3211 lecture 10
ICS3211 lecture 10
 
Essential UX Skills for Technical Communicators (STC Summit 2010)
Essential UX Skills for Technical Communicators (STC Summit 2010)Essential UX Skills for Technical Communicators (STC Summit 2010)
Essential UX Skills for Technical Communicators (STC Summit 2010)
 
Lak12 jlsantos-v2
Lak12 jlsantos-v2Lak12 jlsantos-v2
Lak12 jlsantos-v2
 
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
 
Heuristic evaluation
Heuristic evaluationHeuristic evaluation
Heuristic evaluation
 
When Qual Met UX
When Qual Met UXWhen Qual Met UX
When Qual Met UX
 
​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...
​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...
​ Insight Types That Influence Enterprise Decision Makers (Christian Rohrer a...
 
User Experience Showcase lightning talks - University of Edinburgh
User Experience Showcase lightning talks - University of EdinburghUser Experience Showcase lightning talks - University of Edinburgh
User Experience Showcase lightning talks - University of Edinburgh
 

Mais de Erik Duval

InfoVis1415: slides sessie 12, 18 mei 2015
InfoVis1415: slides sessie 12, 18 mei 2015InfoVis1415: slides sessie 12, 18 mei 2015
InfoVis1415: slides sessie 12, 18 mei 2015Erik Duval
 
InfoVis1415: slides sessie 11, 11 mei 2015
InfoVis1415: slides sessie 11, 11 mei 2015InfoVis1415: slides sessie 11, 11 mei 2015
InfoVis1415: slides sessie 11, 11 mei 2015Erik Duval
 
InfoVis1415: slides sessie 10, 4 mei 2015
InfoVis1415: slides sessie 10, 4 mei 2015InfoVis1415: slides sessie 10, 4 mei 2015
InfoVis1415: slides sessie 10, 4 mei 2015Erik Duval
 
Evaluation
 of information visualisation
Evaluation
 of information visualisationEvaluation
 of information visualisation
Evaluation
 of information visualisationErik Duval
 
InfoVis1415: slides sessie 9, 27 april 2015
InfoVis1415: slides sessie 9, 27 april 2015InfoVis1415: slides sessie 9, 27 april 2015
InfoVis1415: slides sessie 9, 27 april 2015Erik Duval
 
Social Media and Science a wedding made in Heaven...
 or in Hell?
Social Media and Science a wedding made in Heaven...
 or in Hell?Social Media and Science a wedding made in Heaven...
 or in Hell?
Social Media and Science a wedding made in Heaven...
 or in Hell?Erik Duval
 
Information visualisation: 
Data ink design principles
Information visualisation: 
Data ink design principlesInformation visualisation: 
Data ink design principles
Information visualisation: 
Data ink design principlesErik Duval
 
InfoVis1415: slides sessie 8, 20 april 2015
InfoVis1415: slides sessie 8, 20 april 2015InfoVis1415: slides sessie 8, 20 april 2015
InfoVis1415: slides sessie 8, 20 april 2015Erik Duval
 
A short history (and even shorter future)
 of information visualisation
A short history (and even shorter future)
 of information visualisationA short history (and even shorter future)
 of information visualisation
A short history (and even shorter future)
 of information visualisationErik Duval
 
InfoVis1415: slides sessie 7, 30 March 2015
InfoVis1415: slides sessie 7, 30 March 2015InfoVis1415: slides sessie 7, 30 March 2015
InfoVis1415: slides sessie 7, 30 March 2015Erik Duval
 
InfoVis1415: slides sessie 6, 23 March 2015
InfoVis1415: slides sessie 6, 23 March 2015InfoVis1415: slides sessie 6, 23 March 2015
InfoVis1415: slides sessie 6, 23 March 2015Erik Duval
 
History of Human Computer Interaction
History of Human Computer InteractionHistory of Human Computer Interaction
History of Human Computer InteractionErik Duval
 
InfoVis1415: slides sessie 5, 9 March 2015
InfoVis1415: slides sessie 5, 9 March 2015InfoVis1415: slides sessie 5, 9 March 2015
InfoVis1415: slides sessie 5, 9 March 2015Erik Duval
 
InfoVis1415: slides sessie 4, 2 March 2015
InfoVis1415: slides sessie 4, 2 March 2015InfoVis1415: slides sessie 4, 2 March 2015
InfoVis1415: slides sessie 4, 2 March 2015Erik Duval
 
InfoVis1415: slides sessie 3, 23 Feb 2015
InfoVis1415: slides sessie 3, 23 Feb 2015InfoVis1415: slides sessie 3, 23 Feb 2015
InfoVis1415: slides sessie 3, 23 Feb 2015Erik Duval
 
InfoVis1415: slides sessie 2, 16 Feb 2015
InfoVis1415: slides sessie 2, 16 Feb 2015InfoVis1415: slides sessie 2, 16 Feb 2015
InfoVis1415: slides sessie 2, 16 Feb 2015Erik Duval
 
Technology that makes HUMANS smarter
Technology that makes HUMANS smarterTechnology that makes HUMANS smarter
Technology that makes HUMANS smarterErik Duval
 
InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015Erik Duval
 
201502010 pen ocw_les1_erik
201502010 pen ocw_les1_erik201502010 pen ocw_les1_erik
201502010 pen ocw_les1_erikErik Duval
 
Inleiding Human Computer Interaction
Inleiding Human Computer InteractionInleiding Human Computer Interaction
Inleiding Human Computer InteractionErik Duval
 

Mais de Erik Duval (20)

InfoVis1415: slides sessie 12, 18 mei 2015
InfoVis1415: slides sessie 12, 18 mei 2015InfoVis1415: slides sessie 12, 18 mei 2015
InfoVis1415: slides sessie 12, 18 mei 2015
 
InfoVis1415: slides sessie 11, 11 mei 2015
InfoVis1415: slides sessie 11, 11 mei 2015InfoVis1415: slides sessie 11, 11 mei 2015
InfoVis1415: slides sessie 11, 11 mei 2015
 
InfoVis1415: slides sessie 10, 4 mei 2015
InfoVis1415: slides sessie 10, 4 mei 2015InfoVis1415: slides sessie 10, 4 mei 2015
InfoVis1415: slides sessie 10, 4 mei 2015
 
Evaluation
 of information visualisation
Evaluation
 of information visualisationEvaluation
 of information visualisation
Evaluation
 of information visualisation
 
InfoVis1415: slides sessie 9, 27 april 2015
InfoVis1415: slides sessie 9, 27 april 2015InfoVis1415: slides sessie 9, 27 april 2015
InfoVis1415: slides sessie 9, 27 april 2015
 
Social Media and Science a wedding made in Heaven...
 or in Hell?
Social Media and Science a wedding made in Heaven...
 or in Hell?Social Media and Science a wedding made in Heaven...
 or in Hell?
Social Media and Science a wedding made in Heaven...
 or in Hell?
 
Information visualisation: 
Data ink design principles
Information visualisation: 
Data ink design principlesInformation visualisation: 
Data ink design principles
Information visualisation: 
Data ink design principles
 
InfoVis1415: slides sessie 8, 20 april 2015
InfoVis1415: slides sessie 8, 20 april 2015InfoVis1415: slides sessie 8, 20 april 2015
InfoVis1415: slides sessie 8, 20 april 2015
 
A short history (and even shorter future)
 of information visualisation
A short history (and even shorter future)
 of information visualisationA short history (and even shorter future)
 of information visualisation
A short history (and even shorter future)
 of information visualisation
 
InfoVis1415: slides sessie 7, 30 March 2015
InfoVis1415: slides sessie 7, 30 March 2015InfoVis1415: slides sessie 7, 30 March 2015
InfoVis1415: slides sessie 7, 30 March 2015
 
InfoVis1415: slides sessie 6, 23 March 2015
InfoVis1415: slides sessie 6, 23 March 2015InfoVis1415: slides sessie 6, 23 March 2015
InfoVis1415: slides sessie 6, 23 March 2015
 
History of Human Computer Interaction
History of Human Computer InteractionHistory of Human Computer Interaction
History of Human Computer Interaction
 
InfoVis1415: slides sessie 5, 9 March 2015
InfoVis1415: slides sessie 5, 9 March 2015InfoVis1415: slides sessie 5, 9 March 2015
InfoVis1415: slides sessie 5, 9 March 2015
 
InfoVis1415: slides sessie 4, 2 March 2015
InfoVis1415: slides sessie 4, 2 March 2015InfoVis1415: slides sessie 4, 2 March 2015
InfoVis1415: slides sessie 4, 2 March 2015
 
InfoVis1415: slides sessie 3, 23 Feb 2015
InfoVis1415: slides sessie 3, 23 Feb 2015InfoVis1415: slides sessie 3, 23 Feb 2015
InfoVis1415: slides sessie 3, 23 Feb 2015
 
InfoVis1415: slides sessie 2, 16 Feb 2015
InfoVis1415: slides sessie 2, 16 Feb 2015InfoVis1415: slides sessie 2, 16 Feb 2015
InfoVis1415: slides sessie 2, 16 Feb 2015
 
Technology that makes HUMANS smarter
Technology that makes HUMANS smarterTechnology that makes HUMANS smarter
Technology that makes HUMANS smarter
 
InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015
 
201502010 pen ocw_les1_erik
201502010 pen ocw_les1_erik201502010 pen ocw_les1_erik
201502010 pen ocw_les1_erik
 
Inleiding Human Computer Interaction
Inleiding Human Computer InteractionInleiding Human Computer Interaction
Inleiding Human Computer Interaction
 

20130219 chi evaluatie