SlideShare uma empresa Scribd logo
1 de 14
The relevance of UX models and measures I-UxSED 2010 Asbjørn Følstad SINTEF Can simple rating scales and commenting mechanisms improve the relevance of UX measurement?
Some usability components of the early 90’s Efficiency Helpfulness Affect Control Learnability Satisfaction Memorability Error rate Effectiveness Usability component examples from J. Nielsen (Usbility engineering) and SUMI
Complex subjective usability measures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],SUMI questionnaire:  http://sumi.ucc.ie/en/
A consequence of complex models and measures? [T]he measurement of satisfaction seems in a state of disarray […] The diversity of words used in five-point or seven point semantic differentials or Likert-type rating scales is simply astonishing […] Of the 112 studies that measure satisfaction […] only twelve studies employ standardized questionnaires.
Could the same happen to UX models and measures? Flow Engagement Motivation Trust Beauty Goodness Hedonic quality Pragmatic quality Affect (The growing number of proposed UX components may suggest so)
” UX-measures” in the real world Data on users’ experience collected through a  rating scale  and a  free text field
” UX-measures” in the real world Data on users’ experience collected through a  rating scale  and a  free text field
” UX-measures” in the real world Data on users’ experience collected through a  rating scale  and a  free text field
Suggestion: Maybe HCI researchers could study and use ... Simple UX measures and ad-hoc models Rate (single scale) Users:  Usability professional:  Explain (free text) Analyze Ad-hoc model with key aspects
Case example: User feedback on concepts through a simple rating scale and a free text field Design brief: New concepts for textbased communication on mobile phones Concepts by J.O. Eikenes, L.M. Vedeler andT. Tveterås, the Oslo School of Architecture and Design
Case example: User feedback on concepts through a simple rating scale and a free text field Design brief: New concepts for textbased communication on mobile phones Concepts by J.O. Eikenes, L.M. Vedeler andT. Tveterås, the Oslo School of Architecture and Design MESSAGES AT LOCATIONS
Case example: User feedback on concepts through a simple rating scale and a free text field ,[object Object],[object Object],[object Object],[object Object],[object Object]
Theoretical implications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Could UX be seen as concrete and singular? (The spread of single-item measures in the real world may indicate so) And could ad-hoc UX model components be seen as the user’s rationalization of their UX? (Thereby indicating relevant issues for redesign)
So – what is your UX of this presentation? What do you like / dislike? Submit

Mais conteúdo relacionado

Mais procurados

How does poll everywhere.com work
How does poll everywhere.com workHow does poll everywhere.com work
How does poll everywhere.com workFtoOmRose
 
The Gap Between Academic Research and Industrial Practice in Software Testing
The Gap Between Academic Research and Industrial Practice in Software TestingThe Gap Between Academic Research and Industrial Practice in Software Testing
The Gap Between Academic Research and Industrial Practice in Software TestingZoltan Micskei
 
Comparative Analysis of Model Based Testing and Formal Based Testing - A Review
Comparative Analysis of Model Based Testing and Formal Based Testing - A ReviewComparative Analysis of Model Based Testing and Formal Based Testing - A Review
Comparative Analysis of Model Based Testing and Formal Based Testing - A ReviewIJERA Editor
 
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEEMEMTECHSTUDENTPROJECTS
 
Accessibility, Usability and User Centred Design (Usability workshop)
Accessibility, Usability and User Centred Design (Usability workshop)Accessibility, Usability and User Centred Design (Usability workshop)
Accessibility, Usability and User Centred Design (Usability workshop)David Lamas
 
Handling missing Social Network data
Handling missing Social Network dataHandling missing Social Network data
Handling missing Social Network dataChristina Manteli
 
ch5 Issues based metrics
ch5  Issues based metricsch5  Issues based metrics
ch5 Issues based metricsjessie52182
 
The General Ontology Evaluation Framework (GOEF) & the I-Choose Use Case A ...
The General Ontology Evaluation Framework (GOEF) & the I-Choose Use CaseA ...The General Ontology Evaluation Framework (GOEF) & the I-Choose Use CaseA ...
The General Ontology Evaluation Framework (GOEF) & the I-Choose Use Case A ...Joanne Luciano
 

Mais procurados (14)

How does poll everywhere.com work
How does poll everywhere.com workHow does poll everywhere.com work
How does poll everywhere.com work
 
The Gap Between Academic Research and Industrial Practice in Software Testing
The Gap Between Academic Research and Industrial Practice in Software TestingThe Gap Between Academic Research and Industrial Practice in Software Testing
The Gap Between Academic Research and Industrial Practice in Software Testing
 
Roadmap Composite Simulation - Summary 2015
Roadmap Composite Simulation - Summary 2015Roadmap Composite Simulation - Summary 2015
Roadmap Composite Simulation - Summary 2015
 
Comparative Analysis of Model Based Testing and Formal Based Testing - A Review
Comparative Analysis of Model Based Testing and Formal Based Testing - A ReviewComparative Analysis of Model Based Testing and Formal Based Testing - A Review
Comparative Analysis of Model Based Testing and Formal Based Testing - A Review
 
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
IEEE 2014 DOTNET DATA MINING PROJECTS Product aspect-ranking-and--its-applica...
 
Evaluation of eLearning
Evaluation of eLearningEvaluation of eLearning
Evaluation of eLearning
 
Early Software Prototyping for Usability tests using low cost tools for tea...
Early Software Prototyping for Usability tests using low cost tools for tea...Early Software Prototyping for Usability tests using low cost tools for tea...
Early Software Prototyping for Usability tests using low cost tools for tea...
 
G325 past question
G325 past questionG325 past question
G325 past question
 
Introduction to Survey Data Quality
Introduction to Survey Data Quality  Introduction to Survey Data Quality
Introduction to Survey Data Quality
 
Accessibility, Usability and User Centred Design (Usability workshop)
Accessibility, Usability and User Centred Design (Usability workshop)Accessibility, Usability and User Centred Design (Usability workshop)
Accessibility, Usability and User Centred Design (Usability workshop)
 
PSI e-infrastructures evaluation
PSI e-infrastructures evaluationPSI e-infrastructures evaluation
PSI e-infrastructures evaluation
 
Handling missing Social Network data
Handling missing Social Network dataHandling missing Social Network data
Handling missing Social Network data
 
ch5 Issues based metrics
ch5  Issues based metricsch5  Issues based metrics
ch5 Issues based metrics
 
The General Ontology Evaluation Framework (GOEF) & the I-Choose Use Case A ...
The General Ontology Evaluation Framework (GOEF) & the I-Choose Use CaseA ...The General Ontology Evaluation Framework (GOEF) & the I-Choose Use CaseA ...
The General Ontology Evaluation Framework (GOEF) & the I-Choose Use Case A ...
 

Destaque

Q A R (question answer relationship) Sort
Q A R (question answer relationship)  SortQ A R (question answer relationship)  Sort
Q A R (question answer relationship) SortJC Sawyer Dolphins
 
Sosiale medier i offentlig sektor
Sosiale medier i offentlig sektorSosiale medier i offentlig sektor
Sosiale medier i offentlig sektorAsbjørn Følstad
 

Destaque (6)

Q A R (question answer relationship) Sort
Q A R (question answer relationship)  SortQ A R (question answer relationship)  Sort
Q A R (question answer relationship) Sort
 
Grace F Measurement Project
Grace F Measurement ProjectGrace F Measurement Project
Grace F Measurement Project
 
Sosiale medier i offentlig sektor
Sosiale medier i offentlig sektorSosiale medier i offentlig sektor
Sosiale medier i offentlig sektor
 
Byråkratrollen i endring
Byråkratrollen i endringByråkratrollen i endring
Byråkratrollen i endring
 
February 18th presentation
February 18th presentationFebruary 18th presentation
February 18th presentation
 
February 18th presentation
February 18th presentationFebruary 18th presentation
February 18th presentation
 

Semelhante a The relevance of UX models and measures

Uid formative evaluation
Uid formative evaluationUid formative evaluation
Uid formative evaluationPen Lister
 
Mit301– object oriented analysis and design
Mit301– object oriented analysis and designMit301– object oriented analysis and design
Mit301– object oriented analysis and designsmumbahelp
 
The relevance of UX models and measures
The relevance of UX models and measuresThe relevance of UX models and measures
The relevance of UX models and measuresAsbjørn Følstad
 
2015-11-11 research seminar
2015-11-11 research seminar2015-11-11 research seminar
2015-11-11 research seminarifi8106tlu
 
Experimenting with eXtreme Design (EKAW2010)
Experimenting with eXtreme Design (EKAW2010)Experimenting with eXtreme Design (EKAW2010)
Experimenting with eXtreme Design (EKAW2010)evabl444
 
Communicating Usability Problems
Communicating  Usability  ProblemsCommunicating  Usability  Problems
Communicating Usability Problemsbolk
 
Literature_Review_CA2_N00147768
Literature_Review_CA2_N00147768Literature_Review_CA2_N00147768
Literature_Review_CA2_N00147768Stephen Norman
 
Positive developments but challenges still ahead a survey study on ux profe...
Positive developments but challenges still ahead   a survey study on ux profe...Positive developments but challenges still ahead   a survey study on ux profe...
Positive developments but challenges still ahead a survey study on ux profe...Journal Papers
 
HCI for Recommender Systems - The past, present and future
HCI for Recommender Systems - The past, present and futureHCI for Recommender Systems - The past, present and future
HCI for Recommender Systems - The past, present and futureAndré Calero Valdez
 
CHI2007: Meta-analysis of correlations among usability measurs
CHI2007: Meta-analysis of correlations among usability measursCHI2007: Meta-analysis of correlations among usability measurs
CHI2007: Meta-analysis of correlations among usability measurskasperhornbaek
 
[2015/2016] RESEARCH in software engineering
[2015/2016] RESEARCH in software engineering[2015/2016] RESEARCH in software engineering
[2015/2016] RESEARCH in software engineeringIvano Malavolta
 
Usability Evaluation in Educational Technology
Usability Evaluation in Educational Technology Usability Evaluation in Educational Technology
Usability Evaluation in Educational Technology Alaa Sadik
 
QuESo: a Quality Model for Open Source Software Ecosystems
QuESo: a Quality Model for Open Source Software EcosystemsQuESo: a Quality Model for Open Source Software Ecosystems
QuESo: a Quality Model for Open Source Software EcosystemsGESSI UPC
 
7. evalution of interactive system
7. evalution of interactive system7. evalution of interactive system
7. evalution of interactive systemKh Ravy
 
Usability For Business Analysts - 24 June 2009
Usability For Business Analysts -  24 June 2009Usability For Business Analysts -  24 June 2009
Usability For Business Analysts - 24 June 2009Optimal Usability
 
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...Waqas Tariq
 
Evaluation of Web Applications based on UX Parameters
Evaluation of Web Applications based on UX ParametersEvaluation of Web Applications based on UX Parameters
Evaluation of Web Applications based on UX ParametersIJECEIAES
 

Semelhante a The relevance of UX models and measures (20)

A brief overview of ux research
A brief overview of ux researchA brief overview of ux research
A brief overview of ux research
 
Uid formative evaluation
Uid formative evaluationUid formative evaluation
Uid formative evaluation
 
Mit301– object oriented analysis and design
Mit301– object oriented analysis and designMit301– object oriented analysis and design
Mit301– object oriented analysis and design
 
The relevance of UX models and measures
The relevance of UX models and measuresThe relevance of UX models and measures
The relevance of UX models and measures
 
2015-11-11 research seminar
2015-11-11 research seminar2015-11-11 research seminar
2015-11-11 research seminar
 
Experimenting with eXtreme Design (EKAW2010)
Experimenting with eXtreme Design (EKAW2010)Experimenting with eXtreme Design (EKAW2010)
Experimenting with eXtreme Design (EKAW2010)
 
Communicating Usability Problems
Communicating  Usability  ProblemsCommunicating  Usability  Problems
Communicating Usability Problems
 
Literature_Review_CA2_N00147768
Literature_Review_CA2_N00147768Literature_Review_CA2_N00147768
Literature_Review_CA2_N00147768
 
Positive developments but challenges still ahead a survey study on ux profe...
Positive developments but challenges still ahead   a survey study on ux profe...Positive developments but challenges still ahead   a survey study on ux profe...
Positive developments but challenges still ahead a survey study on ux profe...
 
HCI for Recommender Systems - The past, present and future
HCI for Recommender Systems - The past, present and futureHCI for Recommender Systems - The past, present and future
HCI for Recommender Systems - The past, present and future
 
CHI2007: Meta-analysis of correlations among usability measurs
CHI2007: Meta-analysis of correlations among usability measursCHI2007: Meta-analysis of correlations among usability measurs
CHI2007: Meta-analysis of correlations among usability measurs
 
[2015/2016] RESEARCH in software engineering
[2015/2016] RESEARCH in software engineering[2015/2016] RESEARCH in software engineering
[2015/2016] RESEARCH in software engineering
 
Usability
UsabilityUsability
Usability
 
Usability Evaluation in Educational Technology
Usability Evaluation in Educational Technology Usability Evaluation in Educational Technology
Usability Evaluation in Educational Technology
 
Summ11 useinterx
Summ11 useinterxSumm11 useinterx
Summ11 useinterx
 
QuESo: a Quality Model for Open Source Software Ecosystems
QuESo: a Quality Model for Open Source Software EcosystemsQuESo: a Quality Model for Open Source Software Ecosystems
QuESo: a Quality Model for Open Source Software Ecosystems
 
7. evalution of interactive system
7. evalution of interactive system7. evalution of interactive system
7. evalution of interactive system
 
Usability For Business Analysts - 24 June 2009
Usability For Business Analysts -  24 June 2009Usability For Business Analysts -  24 June 2009
Usability For Business Analysts - 24 June 2009
 
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
Generating a Domain Specific Inspection Evaluation Method through an Adaptive...
 
Evaluation of Web Applications based on UX Parameters
Evaluation of Web Applications based on UX ParametersEvaluation of Web Applications based on UX Parameters
Evaluation of Web Applications based on UX Parameters
 

Mais de Asbjørn Følstad

Social media in public sector innovation
Social media in public sector innovationSocial media in public sector innovation
Social media in public sector innovationAsbjørn Følstad
 
Sosiale medier og innovasjon i offentlig sektor web
Sosiale medier og innovasjon i offentlig sektor webSosiale medier og innovasjon i offentlig sektor web
Sosiale medier og innovasjon i offentlig sektor webAsbjørn Følstad
 
Chi2012 analysis in practical usability evaluation web
Chi2012 analysis in practical usability evaluation webChi2012 analysis in practical usability evaluation web
Chi2012 analysis in practical usability evaluation webAsbjørn Følstad
 
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-webNettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-webAsbjørn Følstad
 
Analysis in usability evaluation: Questionnaire
Analysis in usability evaluation: QuestionnaireAnalysis in usability evaluation: Questionnaire
Analysis in usability evaluation: QuestionnaireAsbjørn Følstad
 
Usability evaluation in exclusive domains
Usability evaluation in exclusive domainsUsability evaluation in exclusive domains
Usability evaluation in exclusive domainsAsbjørn Følstad
 
Participatory design 2.0 - brukerinvolvering gjennom sosiale medier
Participatory design 2.0 - brukerinvolvering gjennom sosiale medierParticipatory design 2.0 - brukerinvolvering gjennom sosiale medier
Participatory design 2.0 - brukerinvolvering gjennom sosiale medierAsbjørn Følstad
 
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medier
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medierBedre offentlige tjenester ved å engasjere brukerne i sosiale medier
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medierAsbjørn Følstad
 
Sosial tilbakemelding på design
Sosial tilbakemelding på designSosial tilbakemelding på design
Sosial tilbakemelding på designAsbjørn Følstad
 

Mais de Asbjørn Følstad (12)

Politisk debatt på nett
Politisk debatt på nettPolitisk debatt på nett
Politisk debatt på nett
 
Social media in public sector innovation
Social media in public sector innovationSocial media in public sector innovation
Social media in public sector innovation
 
Single-user problems
Single-user problemsSingle-user problems
Single-user problems
 
Sosiale medier og innovasjon i offentlig sektor web
Sosiale medier og innovasjon i offentlig sektor webSosiale medier og innovasjon i offentlig sektor web
Sosiale medier og innovasjon i offentlig sektor web
 
Chi2012 analysis in practical usability evaluation web
Chi2012 analysis in practical usability evaluation webChi2012 analysis in practical usability evaluation web
Chi2012 analysis in practical usability evaluation web
 
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-webNettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
Nettet som kanal for brukerinvolvering - erfaringer fra living lab 20120620-web
 
Analysis in usability evaluation: Questionnaire
Analysis in usability evaluation: QuestionnaireAnalysis in usability evaluation: Questionnaire
Analysis in usability evaluation: Questionnaire
 
Usability evaluation in exclusive domains
Usability evaluation in exclusive domainsUsability evaluation in exclusive domains
Usability evaluation in exclusive domains
 
Participatory design 2.0 - brukerinvolvering gjennom sosiale medier
Participatory design 2.0 - brukerinvolvering gjennom sosiale medierParticipatory design 2.0 - brukerinvolvering gjennom sosiale medier
Participatory design 2.0 - brukerinvolvering gjennom sosiale medier
 
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medier
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medierBedre offentlige tjenester ved å engasjere brukerne i sosiale medier
Bedre offentlige tjenester ved å engasjere brukerne i sosiale medier
 
Sosial tilbakemelding på design
Sosial tilbakemelding på designSosial tilbakemelding på design
Sosial tilbakemelding på design
 
Wud2009 Folstad Til Web
Wud2009 Folstad Til WebWud2009 Folstad Til Web
Wud2009 Folstad Til Web
 

The relevance of UX models and measures

  • 1. The relevance of UX models and measures I-UxSED 2010 Asbjørn Følstad SINTEF Can simple rating scales and commenting mechanisms improve the relevance of UX measurement?
  • 2. Some usability components of the early 90’s Efficiency Helpfulness Affect Control Learnability Satisfaction Memorability Error rate Effectiveness Usability component examples from J. Nielsen (Usbility engineering) and SUMI
  • 3.
  • 4. A consequence of complex models and measures? [T]he measurement of satisfaction seems in a state of disarray […] The diversity of words used in five-point or seven point semantic differentials or Likert-type rating scales is simply astonishing […] Of the 112 studies that measure satisfaction […] only twelve studies employ standardized questionnaires.
  • 5. Could the same happen to UX models and measures? Flow Engagement Motivation Trust Beauty Goodness Hedonic quality Pragmatic quality Affect (The growing number of proposed UX components may suggest so)
  • 6. ” UX-measures” in the real world Data on users’ experience collected through a rating scale and a free text field
  • 7. ” UX-measures” in the real world Data on users’ experience collected through a rating scale and a free text field
  • 8. ” UX-measures” in the real world Data on users’ experience collected through a rating scale and a free text field
  • 9. Suggestion: Maybe HCI researchers could study and use ... Simple UX measures and ad-hoc models Rate (single scale) Users: Usability professional: Explain (free text) Analyze Ad-hoc model with key aspects
  • 10. Case example: User feedback on concepts through a simple rating scale and a free text field Design brief: New concepts for textbased communication on mobile phones Concepts by J.O. Eikenes, L.M. Vedeler andT. Tveterås, the Oslo School of Architecture and Design
  • 11. Case example: User feedback on concepts through a simple rating scale and a free text field Design brief: New concepts for textbased communication on mobile phones Concepts by J.O. Eikenes, L.M. Vedeler andT. Tveterås, the Oslo School of Architecture and Design MESSAGES AT LOCATIONS
  • 12.
  • 13.
  • 14. So – what is your UX of this presentation? What do you like / dislike? Submit

Notas do Editor

  1. Components from Niesens Usability Engineering and SUMI
  2. Hornbæk2006: Another indication of the disarray is in the limited use of standardized questionnaires and the few studies that use measures that directly build upon earlier work. Of the 112 studies that measure satisfaction, 29 (26%) refer to previous work as a source for the questions. Among those, only twelve studies employ standardized questionnaires for measuring some kind of satisfaction.
  3. Alle termer unntatt trust hentet fra IwC special issue on UX measurements and models Pragmatic quality, hedonic quality, beatury, goodness (editorial – Law/Shaik) Flow (Nacke et al) Engagement (O’Brien) Affect (mediating variable – Hassenzahl et al) Trust (ikke i special issue, men andre steder)
  4. Bergkvist and Rossiter (2007) the predictive validity of multiple-item versus single-item measures of the same constructs. Journal of marketing research.