SlideShare a Scribd company logo
1 of 13
Evaluating InfoVis in Large Company Settings.   Challenges, Experiences and Recommendations . Michael Sedlmair 1/3 , Petra Isenberg 2 , Dominikus Baur 3 , Andreas Butz 3 . 1 BMW Group Research and Technology,  2 INRIA,  3 University of Munich.
Researcher.
Large Company.
Evaluating InfoVis in Large Companies
[object Object],[object Object],[object Object],[object Object],Evaluating InfoVis in Large Companies.   Why should we care?
Evaluating InfoVis in Large Companies.   Why do I care?
Challenges. Study/Appl. Design Participants Data Collection Results
Recommendations. Study/Appl. Design Participants Data Collection Results
Example. Study/Appl. Design
Example. An early visualization prototype. Study/Appl. Design
Example. A recent visualization prototype. Study/Appl. Design
Evaluating InfoVis in Large Company Settings.   An Opportunity!
Thank you very much. We can (only) learn by real field studies with real users in real environments!? Evaluating InfoVis in Large Company Settings.   Challenges, Experiences and Recommendations . Michael Sedlmair 1/3 , Petra Isenberg 2 , Dominikus Baur 3 , Andreas Butz 3 . 1 BMW Group Research and Technology,  2 INRIA,  3 University of Munich.

More Related Content

Similar to Evaluating Information Visualization in Large Companies: Challenges, Experiences and Recommendations.

EDF2012 Andreas Both - From data-driven startup to large company in a decade
EDF2012  Andreas Both - From data-driven startup to large company in a decadeEDF2012  Andreas Both - From data-driven startup to large company in a decade
EDF2012 Andreas Both - From data-driven startup to large company in a decadeEuropean Data Forum
 
Carlo Colicchio: Big Data for business
Carlo Colicchio: Big Data for businessCarlo Colicchio: Big Data for business
Carlo Colicchio: Big Data for businessCarlo Vaccari
 
Quarterly ideenwerkstatt 11_2013_eng
Quarterly ideenwerkstatt 11_2013_engQuarterly ideenwerkstatt 11_2013_eng
Quarterly ideenwerkstatt 11_2013_engICV_eV
 
AI Product Manager
AI Product Manager AI Product Manager
AI Product Manager Datentreiber
 
2012 IBM Tech Trends Report: Fast track to the future
2012 IBM Tech Trends Report: Fast track to the future2012 IBM Tech Trends Report: Fast track to the future
2012 IBM Tech Trends Report: Fast track to the futureSusanne Hupfer, Ph.D.
 
KEY CHALLENGES FOR MONETIZING BIG DATA POWERED AI: AN OVERVIEW
KEY CHALLENGES FOR MONETIZING BIG DATA POWERED AI: AN OVERVIEWKEY CHALLENGES FOR MONETIZING BIG DATA POWERED AI: AN OVERVIEW
KEY CHALLENGES FOR MONETIZING BIG DATA POWERED AI: AN OVERVIEWTyrone Systems
 
Product School talk: Expanding the Product Management Universe
Product School talk: Expanding the Product Management UniverseProduct School talk: Expanding the Product Management Universe
Product School talk: Expanding the Product Management UniverseDaniel C. Liem
 
EDF2014: Stefan Wrobel, Institute Director, Fraunhofer IAIS / Member of the b...
EDF2014: Stefan Wrobel, Institute Director, Fraunhofer IAIS / Member of the b...EDF2014: Stefan Wrobel, Institute Director, Fraunhofer IAIS / Member of the b...
EDF2014: Stefan Wrobel, Institute Director, Fraunhofer IAIS / Member of the b...European Data Forum
 
Entrepreneurship & business modelling workshop
Entrepreneurship & business modelling  workshopEntrepreneurship & business modelling  workshop
Entrepreneurship & business modelling workshophgomersall
 
FinishedProject
FinishedProjectFinishedProject
FinishedProjectHappyjuice
 
What makes a Strong Engineering Culture
What makes a Strong Engineering Culture What makes a Strong Engineering Culture
What makes a Strong Engineering Culture Michael Kalika
 
Robert Lecklin - BigData is making a difference
Robert Lecklin - BigData is making a differenceRobert Lecklin - BigData is making a difference
Robert Lecklin - BigData is making a differenceIBM Sverige
 
BIG DATA IN BUSINESS Implement and use Big Data to your organization’s advantage
BIG DATA IN BUSINESS Implement and use Big Data to your organization’s advantageBIG DATA IN BUSINESS Implement and use Big Data to your organization’s advantage
BIG DATA IN BUSINESS Implement and use Big Data to your organization’s advantageAurélie Pols
 
Why analytics projects fail
Why analytics projects failWhy analytics projects fail
Why analytics projects failDr. Bülent Dal
 
WHY DO SO MANY ANALYTICS PROJECTS STILL FAIL?
WHY DO SO MANY ANALYTICS PROJECTS STILL FAIL?WHY DO SO MANY ANALYTICS PROJECTS STILL FAIL?
WHY DO SO MANY ANALYTICS PROJECTS STILL FAIL?Haluk Demirkan
 
IE Big Data for Business - Brochure
IE Big Data for Business - BrochureIE Big Data for Business - Brochure
IE Big Data for Business - BrochureSokho TRINH
 
Big data trendsdirections nimführ.ppt
Big data trendsdirections nimführ.pptBig data trendsdirections nimführ.ppt
Big data trendsdirections nimführ.pptAravindharamanan S
 
DIY Tools for Market Research by Scott Worthge, uSamp
DIY Tools for Market Research by Scott Worthge, uSampDIY Tools for Market Research by Scott Worthge, uSamp
DIY Tools for Market Research by Scott Worthge, uSampNorthWest MRA
 

Similar to Evaluating Information Visualization in Large Companies: Challenges, Experiences and Recommendations. (20)

EDF2012 Andreas Both - From data-driven startup to large company in a decade
EDF2012  Andreas Both - From data-driven startup to large company in a decadeEDF2012  Andreas Both - From data-driven startup to large company in a decade
EDF2012 Andreas Both - From data-driven startup to large company in a decade
 
Carlo Colicchio: Big Data for business
Carlo Colicchio: Big Data for businessCarlo Colicchio: Big Data for business
Carlo Colicchio: Big Data for business
 
Wipro
WiproWipro
Wipro
 
Quarterly ideenwerkstatt 11_2013_eng
Quarterly ideenwerkstatt 11_2013_engQuarterly ideenwerkstatt 11_2013_eng
Quarterly ideenwerkstatt 11_2013_eng
 
AI Product Manager
AI Product Manager AI Product Manager
AI Product Manager
 
2012 IBM Tech Trends Report: Fast track to the future
2012 IBM Tech Trends Report: Fast track to the future2012 IBM Tech Trends Report: Fast track to the future
2012 IBM Tech Trends Report: Fast track to the future
 
KEY CHALLENGES FOR MONETIZING BIG DATA POWERED AI: AN OVERVIEW
KEY CHALLENGES FOR MONETIZING BIG DATA POWERED AI: AN OVERVIEWKEY CHALLENGES FOR MONETIZING BIG DATA POWERED AI: AN OVERVIEW
KEY CHALLENGES FOR MONETIZING BIG DATA POWERED AI: AN OVERVIEW
 
Product School talk: Expanding the Product Management Universe
Product School talk: Expanding the Product Management UniverseProduct School talk: Expanding the Product Management Universe
Product School talk: Expanding the Product Management Universe
 
EDF2014: Stefan Wrobel, Institute Director, Fraunhofer IAIS / Member of the b...
EDF2014: Stefan Wrobel, Institute Director, Fraunhofer IAIS / Member of the b...EDF2014: Stefan Wrobel, Institute Director, Fraunhofer IAIS / Member of the b...
EDF2014: Stefan Wrobel, Institute Director, Fraunhofer IAIS / Member of the b...
 
Entrepreneurship & business modelling workshop
Entrepreneurship & business modelling  workshopEntrepreneurship & business modelling  workshop
Entrepreneurship & business modelling workshop
 
FinishedProject
FinishedProjectFinishedProject
FinishedProject
 
Data science - An Introduction
Data science - An IntroductionData science - An Introduction
Data science - An Introduction
 
What makes a Strong Engineering Culture
What makes a Strong Engineering Culture What makes a Strong Engineering Culture
What makes a Strong Engineering Culture
 
Robert Lecklin - BigData is making a difference
Robert Lecklin - BigData is making a differenceRobert Lecklin - BigData is making a difference
Robert Lecklin - BigData is making a difference
 
BIG DATA IN BUSINESS Implement and use Big Data to your organization’s advantage
BIG DATA IN BUSINESS Implement and use Big Data to your organization’s advantageBIG DATA IN BUSINESS Implement and use Big Data to your organization’s advantage
BIG DATA IN BUSINESS Implement and use Big Data to your organization’s advantage
 
Why analytics projects fail
Why analytics projects failWhy analytics projects fail
Why analytics projects fail
 
WHY DO SO MANY ANALYTICS PROJECTS STILL FAIL?
WHY DO SO MANY ANALYTICS PROJECTS STILL FAIL?WHY DO SO MANY ANALYTICS PROJECTS STILL FAIL?
WHY DO SO MANY ANALYTICS PROJECTS STILL FAIL?
 
IE Big Data for Business - Brochure
IE Big Data for Business - BrochureIE Big Data for Business - Brochure
IE Big Data for Business - Brochure
 
Big data trendsdirections nimführ.ppt
Big data trendsdirections nimführ.pptBig data trendsdirections nimführ.ppt
Big data trendsdirections nimführ.ppt
 
DIY Tools for Market Research by Scott Worthge, uSamp
DIY Tools for Market Research by Scott Worthge, uSampDIY Tools for Market Research by Scott Worthge, uSamp
DIY Tools for Market Research by Scott Worthge, uSamp
 

More from BELIV Workshop

Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.BELIV Workshop
 
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.BELIV Workshop
 
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.BELIV Workshop
 
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...BELIV Workshop
 
Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...BELIV Workshop
 
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...BELIV Workshop
 
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...BELIV Workshop
 
A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.BELIV Workshop
 
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.BELIV Workshop
 
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.BELIV Workshop
 
Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.BELIV Workshop
 
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz EvaluationsBELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz EvaluationsBELIV Workshop
 

More from BELIV Workshop (12)

Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
 
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.
 
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.Proposed Working Memory Measures for Evaluating Information Visualization Tools.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
 
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...How is a graphic like pumpkin pie? A framework for analysis and critique of v...
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
 
Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...Implications of Individual Differences on Evaluating Information Visualizatio...
Implications of Individual Differences on Evaluating Information Visualizatio...
 
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
 
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
 
A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.A Descriptive Model of Visual Scanning.
A Descriptive Model of Visual Scanning.
 
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
 
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
 
Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.Learning-Based Evaluation of Visual Analytic Systems.
Learning-Based Evaluation of Visual Analytic Systems.
 
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz EvaluationsBELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
 

Evaluating Information Visualization in Large Companies: Challenges, Experiences and Recommendations.

Editor's Notes

  1. 29 x real-world in proceedings
  2. Indications, some evidence