SlideShare uma empresa Scribd logo
1 de 20
Interactivity and feedback
         Gene Golovchinsky
       FX Palo Alto Laboratory
           @HCIR_GeneG


    Thanks to Tony Dunnigan for the drawings
A half-assed analogy

    A trivial taxonomy

Some self-serving examples
What I mean by “task”
 Information            Multiple               Evolving
seeking occurs        interactions           information
  over time          with the system            needs




             Human                     Computer
Two kinds of feedback
Person System
     Person trains system to find documents


System  Person
     System indicates possibilities to guide
     person
Person  System
People don’t use relevance feedback, right?


They do when suitably motivated.

Two examples:

  Ancestry.com
  Predictive coding
Relevance feedback at Ancestry.com
Search
  People find historical records about specific individuals
  Facts from records are saved to individuals in family trees

Relevance feedback
  Saved facts are automatically incorporated into subsequent
  queries
  Relevance feedback is inferred from saved records

Many motivated users
  Hundreds of hours of system use
  Lots of interaction

                                                  Person  System
Relevance Feedback in
                Predictive Coding

Predictive coding is a technique for training a classifier to find
relevant documents

Used in e-discovery to increase accuracy and reduce costs

Machine learning algorithm is trained through hundreds of
relevance judgments; applied to millions of documents

Big (and getting bigger) business

                                                      Person  System
System  Person
System provides hints about potential actions
  Information scent
  Which documents are new
  Which terms are effective
  Ways to expand/reformulate the query

Examples
     Facets indicating numbers of matching documents
     Previously-saved or viewed documents
     History of queries, related queries
     Previews, hints, etc.
Interacting with the past



Previously
saved
records for
this person




                       Ancestry.com
                                      System  Person
Interacting with the past



                               Newly-
                               retrieved




                               Re-retrieved




         Querium
                      System  Person
Interacting with the present
                                                   mspace




Commerical faceted browsing UI
                                 RelationBrowser
Interacting with the future




                       System  Person
Interacting with the future
Query preview                 Query nudges
As searcher types, shows      As searcher types, changes
distribution of new vs. re-   halo color to encourage longer
retrieved documents in a      queries
search session




                                                               7
                                                               6
                                                               5
                                       Number of Query Terms

                                                               4
                                                               3
                                                               2
                                                                             No instr.
                                                               1
                                                               0             Instruction




                                                                   No halo       System  Person
                                                                                              Halo
Design Challenges

How do we get people to use
relevance feedback?
How do we help people discover
which queries will be effective?
How do we help people plan?

Mais conteúdo relacionado

Semelhante a Interactivity and feedback

Content Analyst - Conceptualizing LSI Based Text Analytics White Paper
Content Analyst - Conceptualizing LSI Based Text Analytics White PaperContent Analyst - Conceptualizing LSI Based Text Analytics White Paper
Content Analyst - Conceptualizing LSI Based Text Analytics White Paper
John Felahi
 
Ontology Based Approach for Semantic Information Retrieval System
Ontology Based Approach for Semantic Information Retrieval SystemOntology Based Approach for Semantic Information Retrieval System
Ontology Based Approach for Semantic Information Retrieval System
IJTET Journal
 
Query formulation process
Query formulation processQuery formulation process
Query formulation process
malathimurugan
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
ijceronline
 
Bryan Bell Presentation
Bryan Bell PresentationBryan Bell Presentation
Bryan Bell Presentation
Mediabistro
 

Semelhante a Interactivity and feedback (20)

A Topic map-based ontology IR system versus Clustering-based IR System: A Com...
A Topic map-based ontology IR system versus Clustering-based IR System: A Com...A Topic map-based ontology IR system versus Clustering-based IR System: A Com...
A Topic map-based ontology IR system versus Clustering-based IR System: A Com...
 
Content Analyst - Conceptualizing LSI Based Text Analytics White Paper
Content Analyst - Conceptualizing LSI Based Text Analytics White PaperContent Analyst - Conceptualizing LSI Based Text Analytics White Paper
Content Analyst - Conceptualizing LSI Based Text Analytics White Paper
 
Sentiment analysis
Sentiment analysisSentiment analysis
Sentiment analysis
 
Empowering Search Through 3RDi Semantic Enrichment
Empowering Search Through 3RDi Semantic EnrichmentEmpowering Search Through 3RDi Semantic Enrichment
Empowering Search Through 3RDi Semantic Enrichment
 
The Awkward Teenager of Testing
The Awkward Teenager of TestingThe Awkward Teenager of Testing
The Awkward Teenager of Testing
 
INTELLIGENT INFORMATION RETRIEVAL WITHIN DIGITAL LIBRARY USING DOMAIN ONTOLOGY
INTELLIGENT INFORMATION RETRIEVAL WITHIN DIGITAL LIBRARY USING DOMAIN ONTOLOGYINTELLIGENT INFORMATION RETRIEVAL WITHIN DIGITAL LIBRARY USING DOMAIN ONTOLOGY
INTELLIGENT INFORMATION RETRIEVAL WITHIN DIGITAL LIBRARY USING DOMAIN ONTOLOGY
 
Ontology Based Approach for Semantic Information Retrieval System
Ontology Based Approach for Semantic Information Retrieval SystemOntology Based Approach for Semantic Information Retrieval System
Ontology Based Approach for Semantic Information Retrieval System
 
Query formulation process
Query formulation processQuery formulation process
Query formulation process
 
QUESTION ANSWERING SYSTEM USING ONTOLOGY IN MARATHI LANGUAGE
QUESTION ANSWERING SYSTEM USING ONTOLOGY IN MARATHI LANGUAGEQUESTION ANSWERING SYSTEM USING ONTOLOGY IN MARATHI LANGUAGE
QUESTION ANSWERING SYSTEM USING ONTOLOGY IN MARATHI LANGUAGE
 
How to be Successful with Search in YOUR Organization
How to be Successful with Search in YOUR OrganizationHow to be Successful with Search in YOUR Organization
How to be Successful with Search in YOUR Organization
 
Have Your Essay Written. Online assignment writing service.
Have Your Essay Written. Online assignment writing service.Have Your Essay Written. Online assignment writing service.
Have Your Essay Written. Online assignment writing service.
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
 
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...
Information Seeking with Social Signals: Anatomy of a Social Tag-based Explor...
 
Bryan Bell Presentation
Bryan Bell PresentationBryan Bell Presentation
Bryan Bell Presentation
 
AI, Search, and the Disruption of Knowledge Management
AI, Search, and the Disruption of Knowledge ManagementAI, Search, and the Disruption of Knowledge Management
AI, Search, and the Disruption of Knowledge Management
 
Ontology Search: An Empirical Evaluation
Ontology Search: An Empirical EvaluationOntology Search: An Empirical Evaluation
Ontology Search: An Empirical Evaluation
 
Phrase Based Indexing
Phrase Based IndexingPhrase Based Indexing
Phrase Based Indexing
 
Phrase Based Indexing and Information Retrivel
Phrase Based Indexing and Information RetrivelPhrase Based Indexing and Information Retrivel
Phrase Based Indexing and Information Retrivel
 
Haystacks slides
Haystacks slidesHaystacks slides
Haystacks slides
 
From Knowledge Bases to Knowledge Infrastructures for Intelligent Systems
From Knowledge Bases to Knowledge Infrastructures for Intelligent SystemsFrom Knowledge Bases to Knowledge Infrastructures for Intelligent Systems
From Knowledge Bases to Knowledge Infrastructures for Intelligent Systems
 

Mais de Gene Golovchinsky

Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshopMaking Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Gene Golovchinsky
 

Mais de Gene Golovchinsky (6)

Does History Matter?
Does History Matter?Does History Matter?
Does History Matter?
 
Exploring session search
Exploring session searchExploring session search
Exploring session search
 
Reverted Indexing for Expansion and Feedback
Reverted Indexing for Expansion and FeedbackReverted Indexing for Expansion and Feedback
Reverted Indexing for Expansion and Feedback
 
Interactive Information Seeking via Selective Application of Contextual Knowl...
Interactive Information Seeking via Selective Application of Contextual Knowl...Interactive Information Seeking via Selective Application of Contextual Knowl...
Interactive Information Seeking via Selective Application of Contextual Knowl...
 
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshopMaking Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
 
A Model Of Collaborative Search
A Model Of Collaborative SearchA Model Of Collaborative Search
A Model Of Collaborative Search
 

Último

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Último (20)

presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 

Interactivity and feedback

  • 1. Interactivity and feedback Gene Golovchinsky FX Palo Alto Laboratory @HCIR_GeneG Thanks to Tony Dunnigan for the drawings
  • 2. A half-assed analogy A trivial taxonomy Some self-serving examples
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9. What I mean by “task” Information Multiple Evolving seeking occurs interactions information over time with the system needs Human Computer
  • 10. Two kinds of feedback Person System Person trains system to find documents System  Person System indicates possibilities to guide person
  • 11. Person  System People don’t use relevance feedback, right? They do when suitably motivated. Two examples: Ancestry.com Predictive coding
  • 12. Relevance feedback at Ancestry.com Search People find historical records about specific individuals Facts from records are saved to individuals in family trees Relevance feedback Saved facts are automatically incorporated into subsequent queries Relevance feedback is inferred from saved records Many motivated users Hundreds of hours of system use Lots of interaction Person  System
  • 13. Relevance Feedback in Predictive Coding Predictive coding is a technique for training a classifier to find relevant documents Used in e-discovery to increase accuracy and reduce costs Machine learning algorithm is trained through hundreds of relevance judgments; applied to millions of documents Big (and getting bigger) business Person  System
  • 14. System  Person System provides hints about potential actions Information scent Which documents are new Which terms are effective Ways to expand/reformulate the query Examples Facets indicating numbers of matching documents Previously-saved or viewed documents History of queries, related queries Previews, hints, etc.
  • 15. Interacting with the past Previously saved records for this person Ancestry.com System  Person
  • 16. Interacting with the past Newly- retrieved Re-retrieved Querium System  Person
  • 17. Interacting with the present mspace Commerical faceted browsing UI RelationBrowser
  • 18. Interacting with the future System  Person
  • 19. Interacting with the future Query preview Query nudges As searcher types, shows As searcher types, changes distribution of new vs. re- halo color to encourage longer retrieved documents in a queries search session 7 6 5 Number of Query Terms 4 3 2 No instr. 1 0 Instruction No halo System  Person Halo
  • 20. Design Challenges How do we get people to use relevance feedback? How do we help people discover which queries will be effective? How do we help people plan?