SlideShare uma empresa Scribd logo
1 de 31
The Pragmatic Evaluation of Tool System Interoperability Aldo de Moor   CommunitySense CS-TIW, July 2007
Once upon a time...
Those days are gone!
Tool systems  ,[object Object],[object Object],[object Object],[object Object]
Technical comparison is not enough
The “orchestra metaphor” ,[object Object],[object Object],[object Object],[object Object]
Tool system interoperability  ,[object Object],[object Object],[object Object],[object Object]
Pragmatic evaluation  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Questions  ,[object Object],[object Object],[object Object]
Goals  ,[object Object],[object Object],[object Object],[object Object]
Case: co-authoring a call for papers  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Co-authoring tool system v1  Author 1 Author 2 Version Author 2 Version Author 1 Version Author 3 Author 3
Co-authoring tool system v2  Author 1 Author 2 Version Author 2 Version Author 1 Version Author 3 Author 3 Conference
Co-authoring tool system v3  Author 3 / Editor Author 1 Author 2 Conference Agreed lines (Modified) paragraphs Chat Version Author 1 Version Author 1 Version Author 1 Version-in Progress
A conceptual model of the tool system  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Example
A conceptual model of the usage context  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Usage context: goals  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Usage context: actors  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Actor role typologies  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Usage context: domain  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The pragmatic evaluation process
The scoring process  ,[object Object],[object Object],[object Object],[object Object],[object Object]
A practical method for courseware evaluation  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Goal and functionality scores  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Experiment: group assignments  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Activity scores
Functionality scores
Evaluation ++  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Evaluating virtual worlds
Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Mais conteúdo relacionado

Mais procurados

Two Brains are Better than One: User Control in Adaptive Information Access
Two Brains are Better than One: User Control in Adaptive Information AccessTwo Brains are Better than One: User Control in Adaptive Information Access
Two Brains are Better than One: User Control in Adaptive Information Access
Peter Brusilovsky
 
Paper11_PenuelRielSabelli
Paper11_PenuelRielSabelliPaper11_PenuelRielSabelli
Paper11_PenuelRielSabelli
webuploader
 
Research presentation - vijal doshi
Research presentation - vijal doshiResearch presentation - vijal doshi
Research presentation - vijal doshi
vijald
 
Model-based Development and Evolution of Information Systems - Introduction
Model-based Development and Evolution of Information Systems - IntroductionModel-based Development and Evolution of Information Systems - Introduction
Model-based Development and Evolution of Information Systems - Introduction
John Krogstie
 
mic06-jay-prezentacija
mic06-jay-prezentacijamic06-jay-prezentacija
mic06-jay-prezentacija
webuploader
 

Mais procurados (20)

STUDY OF AGENT ASSISTED METHODOLOGIES FOR DEVELOPMENT OF A SYSTEM
STUDY OF AGENT ASSISTED METHODOLOGIES FOR DEVELOPMENT OF A SYSTEMSTUDY OF AGENT ASSISTED METHODOLOGIES FOR DEVELOPMENT OF A SYSTEM
STUDY OF AGENT ASSISTED METHODOLOGIES FOR DEVELOPMENT OF A SYSTEM
 
Interfaces for User-Controlled and Transparent Recommendations
Interfaces for User-Controlled and Transparent RecommendationsInterfaces for User-Controlled and Transparent Recommendations
Interfaces for User-Controlled and Transparent Recommendations
 
Two Brains are Better than One: User Control in Adaptive Information Access
Two Brains are Better than One: User Control in Adaptive Information AccessTwo Brains are Better than One: User Control in Adaptive Information Access
Two Brains are Better than One: User Control in Adaptive Information Access
 
SN_for_CI
SN_for_CISN_for_CI
SN_for_CI
 
The Evaluation of Generic Architecture for Information Availability (GAIA) an...
The Evaluation of Generic Architecture for Information Availability (GAIA) an...The Evaluation of Generic Architecture for Information Availability (GAIA) an...
The Evaluation of Generic Architecture for Information Availability (GAIA) an...
 
Considering users' behaviours in improving the responses of an informacion base
Considering users' behaviours in improving the responses of an informacion baseConsidering users' behaviours in improving the responses of an informacion base
Considering users' behaviours in improving the responses of an informacion base
 
Paper11_PenuelRielSabelli
Paper11_PenuelRielSabelliPaper11_PenuelRielSabelli
Paper11_PenuelRielSabelli
 
On data-driven systems analyzing, supporting and enhancing users’ interaction...
On data-driven systems analyzing, supporting and enhancing users’ interaction...On data-driven systems analyzing, supporting and enhancing users’ interaction...
On data-driven systems analyzing, supporting and enhancing users’ interaction...
 
Requirement analysis for mobile information exchange in the police using a ti...
Requirement analysis for mobile information exchange in the police using a ti...Requirement analysis for mobile information exchange in the police using a ti...
Requirement analysis for mobile information exchange in the police using a ti...
 
Research presentation - vijal doshi
Research presentation - vijal doshiResearch presentation - vijal doshi
Research presentation - vijal doshi
 
Use Cases in the Fluid Project
Use Cases in the Fluid ProjectUse Cases in the Fluid Project
Use Cases in the Fluid Project
 
Basic principles of interaction for learning in web based environment
Basic principles of interaction for learning in web based environmentBasic principles of interaction for learning in web based environment
Basic principles of interaction for learning in web based environment
 
Model-based Development and Evolution of Information Systems - Introduction
Model-based Development and Evolution of Information Systems - IntroductionModel-based Development and Evolution of Information Systems - Introduction
Model-based Development and Evolution of Information Systems - Introduction
 
Effects of Developers’ Training on User-Developer Interactions in Information...
Effects of Developers’ Training on User-Developer Interactions in Information...Effects of Developers’ Training on User-Developer Interactions in Information...
Effects of Developers’ Training on User-Developer Interactions in Information...
 
Coordination Dynamics in Free/Libre and Open Source Software
Coordination Dynamics in Free/Libre and Open Source SoftwareCoordination Dynamics in Free/Libre and Open Source Software
Coordination Dynamics in Free/Libre and Open Source Software
 
COLLABORA: A COLLABORATIVE ARCHITECTURE FOR EVALUATING INDIVIDUALS PARTICIPAT...
COLLABORA: A COLLABORATIVE ARCHITECTURE FOR EVALUATING INDIVIDUALS PARTICIPAT...COLLABORA: A COLLABORATIVE ARCHITECTURE FOR EVALUATING INDIVIDUALS PARTICIPAT...
COLLABORA: A COLLABORATIVE ARCHITECTURE FOR EVALUATING INDIVIDUALS PARTICIPAT...
 
mic06-jay-prezentacija
mic06-jay-prezentacijamic06-jay-prezentacija
mic06-jay-prezentacija
 
Alt I Lab 2005 Ep Services
Alt I Lab 2005 Ep ServicesAlt I Lab 2005 Ep Services
Alt I Lab 2005 Ep Services
 
A location based movie recommender system
A location based movie recommender systemA location based movie recommender system
A location based movie recommender system
 
ahuja
ahujaahuja
ahuja
 

Destaque (7)

ICPW2007.deMoor
ICPW2007.deMoorICPW2007.deMoor
ICPW2007.deMoor
 
Orientation on Open Courseware Framework @ Don Bosco
Orientation on Open Courseware Framework @ Don BoscoOrientation on Open Courseware Framework @ Don Bosco
Orientation on Open Courseware Framework @ Don Bosco
 
Courseware(KPT5033)
Courseware(KPT5033)Courseware(KPT5033)
Courseware(KPT5033)
 
Sample courseware development
Sample courseware developmentSample courseware development
Sample courseware development
 
courseware and storyboard
courseware and storyboardcourseware and storyboard
courseware and storyboard
 
Courseware
CoursewareCourseware
Courseware
 
How to make courseware for schools interesting
How to make courseware for schools interestingHow to make courseware for schools interesting
How to make courseware for schools interesting
 

Semelhante a The Pragmatic Evaluation of Tool System Interoperability

Goal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to ImplementationGoal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to Implementation
Amjad Adib
 
Object oriented software engineering
Object oriented software engineeringObject oriented software engineering
Object oriented software engineering
Varsha Ajith
 
Evaluation of the TOIA project
Evaluation of the TOIA projectEvaluation of the TOIA project
Evaluation of the TOIA project
grainne
 
Designing systems for managing dynamic collaborative research processes
Designing systems for managing dynamic collaborative research processesDesigning systems for managing dynamic collaborative research processes
Designing systems for managing dynamic collaborative research processes
scottw
 
JISC LADIE project Learning Design In Education
JISC LADIE project Learning Design In EducationJISC LADIE project Learning Design In Education
JISC LADIE project Learning Design In Education
grainne
 
Personal Competence Development in Learning Networks
Personal Competence Development in Learning NetworksPersonal Competence Development in Learning Networks
Personal Competence Development in Learning Networks
telss09
 
Ui Design And Usability For Everybody
Ui Design And Usability For EverybodyUi Design And Usability For Everybody
Ui Design And Usability For Everybody
Empatika
 

Semelhante a The Pragmatic Evaluation of Tool System Interoperability (20)

Activating Research Collaboratories with Collaboration Patterns
Activating Research Collaboratories with Collaboration PatternsActivating Research Collaboratories with Collaboration Patterns
Activating Research Collaboratories with Collaboration Patterns
 
Goal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to ImplementationGoal Dynamics_From System Dynamics to Implementation
Goal Dynamics_From System Dynamics to Implementation
 
Object oriented software engineering
Object oriented software engineeringObject oriented software engineering
Object oriented software engineering
 
Making ESSENCE Work
Making ESSENCE WorkMaking ESSENCE Work
Making ESSENCE Work
 
Evaluation of the TOIA project
Evaluation of the TOIA projectEvaluation of the TOIA project
Evaluation of the TOIA project
 
Designing systems for managing dynamic collaborative research processes
Designing systems for managing dynamic collaborative research processesDesigning systems for managing dynamic collaborative research processes
Designing systems for managing dynamic collaborative research processes
 
Chapter 7 agent-oriented software engineering ch7-agent methodology-agent met...
Chapter 7 agent-oriented software engineering ch7-agent methodology-agent met...Chapter 7 agent-oriented software engineering ch7-agent methodology-agent met...
Chapter 7 agent-oriented software engineering ch7-agent methodology-agent met...
 
JISC LADIE project Learning Design In Education
JISC LADIE project Learning Design In EducationJISC LADIE project Learning Design In Education
JISC LADIE project Learning Design In Education
 
A brief overview of ux research
A brief overview of ux researchA brief overview of ux research
A brief overview of ux research
 
Personal Competence Development in Learning Networks
Personal Competence Development in Learning NetworksPersonal Competence Development in Learning Networks
Personal Competence Development in Learning Networks
 
Evaluation of Interactive Systems Design or Prototype or Product
Evaluation of Interactive Systems Design or Prototype or ProductEvaluation of Interactive Systems Design or Prototype or Product
Evaluation of Interactive Systems Design or Prototype or Product
 
Ui Design And Usability For Everybody
Ui Design And Usability For EverybodyUi Design And Usability For Everybody
Ui Design And Usability For Everybody
 
REQUIREMENTS FOR PERSONAL KNOWLEDGE MANAGEMENT TOOLS
REQUIREMENTS FOR PERSONAL KNOWLEDGE MANAGEMENT TOOLSREQUIREMENTS FOR PERSONAL KNOWLEDGE MANAGEMENT TOOLS
REQUIREMENTS FOR PERSONAL KNOWLEDGE MANAGEMENT TOOLS
 
Data-Driven Learning Strategy
Data-Driven Learning StrategyData-Driven Learning Strategy
Data-Driven Learning Strategy
 
Experimenting with eXtreme Design (EKAW2010)
Experimenting with eXtreme Design (EKAW2010)Experimenting with eXtreme Design (EKAW2010)
Experimenting with eXtreme Design (EKAW2010)
 
A Practical Method for Courseware Evaluation
A Practical Method for Courseware EvaluationA Practical Method for Courseware Evaluation
A Practical Method for Courseware Evaluation
 
Tenc Winterschool09 Davinia Slideshare
Tenc Winterschool09 Davinia SlideshareTenc Winterschool09 Davinia Slideshare
Tenc Winterschool09 Davinia Slideshare
 
Interoperability: Scientific Foundations
Interoperability: Scientific FoundationsInteroperability: Scientific Foundations
Interoperability: Scientific Foundations
 
Collaborative Knowledge Management E Learning The Wiki Way
Collaborative Knowledge Management E Learning The Wiki WayCollaborative Knowledge Management E Learning The Wiki Way
Collaborative Knowledge Management E Learning The Wiki Way
 
Web-Based Self- and Peer-Assessment of Teachers’ Educational Technology Compe...
Web-Based Self- and Peer-Assessment of Teachers’ Educational Technology Compe...Web-Based Self- and Peer-Assessment of Teachers’ Educational Technology Compe...
Web-Based Self- and Peer-Assessment of Teachers’ Educational Technology Compe...
 

Mais de CommunitySense

Mais de CommunitySense (14)

Knowledge Weaving for Social Innovation: Laying the First Strand
Knowledge Weaving for Social Innovation: Laying the First StrandKnowledge Weaving for Social Innovation: Laying the First Strand
Knowledge Weaving for Social Innovation: Laying the First Strand
 
Making Community Mapping Work: The Tilburg Urban Farming Community Case
Making Community Mapping Work: The Tilburg Urban Farming Community CaseMaking Community Mapping Work: The Tilburg Urban Farming Community Case
Making Community Mapping Work: The Tilburg Urban Farming Community Case
 
Towards a participatory community mapping method: the Tilburg urban farming c...
Towards a participatory community mapping method: the Tilburg urban farming c...Towards a participatory community mapping method: the Tilburg urban farming c...
Towards a participatory community mapping method: the Tilburg urban farming c...
 
Knowledge Sharing for Social Innovation: The Dutch Tilburg Regional Case
Knowledge Sharing for Social Innovation: The Dutch Tilburg Regional CaseKnowledge Sharing for Social Innovation: The Dutch Tilburg Regional Case
Knowledge Sharing for Social Innovation: The Dutch Tilburg Regional Case
 
Creativity Meets Rationale - Collaboration Patterns for Social Innovation
Creativity Meets Rationale - Collaboration Patterns for Social InnovationCreativity Meets Rationale - Collaboration Patterns for Social Innovation
Creativity Meets Rationale - Collaboration Patterns for Social Innovation
 
Expanding the Academic Research Community: Building Bridges into Society with...
Expanding the Academic Research Community: Building Bridges into Society with...Expanding the Academic Research Community: Building Bridges into Society with...
Expanding the Academic Research Community: Building Bridges into Society with...
 
Research Communities 2.0
Research Communities 2.0Research Communities 2.0
Research Communities 2.0
 
"It's the Conversation, Stupid!" - Social media systems design for open innov...
"It's the Conversation, Stupid!" - Social media systems design for open innov..."It's the Conversation, Stupid!" - Social media systems design for open innov...
"It's the Conversation, Stupid!" - Social media systems design for open innov...
 
Using Collaboration Patterms for Contextualizing Roles in Community Systems ...
Using Collaboration Patterms for Contextualizing Roles in Community  Systems ...Using Collaboration Patterms for Contextualizing Roles in Community  Systems ...
Using Collaboration Patterms for Contextualizing Roles in Community Systems ...
 
What's up with the Pragmatic Web?
What's up with the Pragmatic Web?What's up with the Pragmatic Web?
What's up with the Pragmatic Web?
 
Conversations in Context: A Twitter Case for Social Media Systems Design
Conversations in Context: A Twitter Case for Social Media Systems DesignConversations in Context: A Twitter Case for Social Media Systems Design
Conversations in Context: A Twitter Case for Social Media Systems Design
 
Collaboration Patterns as Building Blocks for Community Informatics
Collaboration Patterns as Building Blocks for Community InformaticsCollaboration Patterns as Building Blocks for Community Informatics
Collaboration Patterns as Building Blocks for Community Informatics
 
Research Consultancy: Taking the Plunge?
Research Consultancy: Taking the Plunge?Research Consultancy: Taking the Plunge?
Research Consultancy: Taking the Plunge?
 
From Inspiration to Activation: Making Online Collaborative Communities Work
From Inspiration to Activation: Making Online Collaborative Communities WorkFrom Inspiration to Activation: Making Online Collaborative Communities Work
From Inspiration to Activation: Making Online Collaborative Communities Work
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Último (20)

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 

The Pragmatic Evaluation of Tool System Interoperability