SlideShare uma empresa Scribd logo
1 de 41
Baixar para ler offline
Future Trends
                    in
Search User Interfaces




                  Dr. Marti Hearst
                      UC Berkeley

          i-Know Conference Keynote
                       Sept 1, 2010
In some cases,
    blended and                  Primarily search text
    context-sensitive




Fast response time      Search           Support for
                                         related queries
                        Interfaces       and documents
                        today?


     Navigation and             Tailored to keyword
     organization               queries and iterating
     support from               on the information
     faceted metadata


                                                           3
Forecasting the Future

   First: What are the larger trends?

            In technology?
              In society?
    Next: Project out from these.
Wide adoption of touch-
    Latent preferences                 activated devices with
    for audio and video                excellent UI design


Wide adoption of
social media and
user-generated                                 Increasingly
                          Natural              available rich,
                                               integrated data
                          Interfaces           sources




     Improvements in                   Wide adoption of
     NLP, speech                       mobile devices with
     recognition via
     huge data sets


                                                                 3
Wide adoption of touch-
    Latent preferences                 activated devices with
    for audio and video                excellent UI design


Wide adoption of
social media and
user-generated                                 Increasingly
                          Natural              available rich,
                                               integrated data
                          Interfaces           sources




     Improvements in                   Wide adoption of
     NLP, speech                       mobile devices with
     recognition via
     huge data sets


                                                                 3
Wide adoption of touch-
    Latent preferences                 activated devices with
    for audio and video                excellent UI design


Wide adoption of
social media and
user-generated                                 Increasingly
                          Natural              available rich,
                                               integrated data
                          Interfaces           sources




     Improvements in                   Wide adoption of
     NLP, speech                       mobile devices with
     recognition via
     huge data sets


                                                                 3
Wide adoption of touch-
    Latent preferences                 activated devices with
    for audio and video                excellent UI design


Wide adoption of
social media and
user-generated                                 Increasingly
                          Natural              available rich,
                                               integrated data
                          Interfaces           sources




     Improvements in                   Wide adoption of
     NLP, speech                       mobile devices with
     recognition via
     huge data sets


                                                                 3
Wide adoption of touch-
    Latent preferences                 activated devices with
    for audio and video                excellent UI design


Wide adoption of
social media and
user-generated                                 Increasingly
                          Natural              available rich,
                                               integrated data
                          Interfaces           sources




     Improvements in                   Wide adoption of
     NLP, speech                       mobile devices with
     recognition via
     huge data sets


                                                                 3
Wide adoption of touch-
    Latent preferences                 activated devices with
    for audio and video                excellent UI design


Wide adoption of
social media and
user-generated                                 Increasingly
                          Natural              available rich,
                                               integrated data
                          Interfaces           sources




     Improvements in                   Wide adoption of
     NLP, speech                       mobile devices with
     recognition via
     huge data sets


                                                                 3
Wide adoption of touch-
    Latent preferences                 activated devices with
    for audio and video                excellent UI design


Wide adoption of
social media and
user-generated                                 Increasingly
                          Natural              available rich,
                                               integrated data
                          Interfaces           sources




     Improvements in                   Wide adoption of
     NLP, speech                       mobile devices with
     recognition via
     huge data sets


                                                                 3
Trend: Natural Interfaces
What does this mean for Search UIs?




                                      4
Trend: Natural Interfaces
What does this mean for Search UIs?

• Longer, more natural queries

• Search that is as social as people are

• Deep integration of audio and video

• Dialogue and conversational (farther out)


                                              4
Trend:
More Natural Queries
Trend: Longer, more natural queries

• The research suggests people prefer to state their
  information need rather than use keywords.
  • But after first using a search engine they quickly learned that
    full questions resulted in failure.


• Average query length continues to increase
  • Major search engines are now handling long queries well.


• Information worded as questions is increasing on the
  web.
  • From social question-answering sites and forums.




                                                                      6
A recent example: keywords failed




                                    7
Instead, ask as a question




                             8
And: find an answer




                      9
Advanced user interface design




                                 10
Trend: More Natural Queries

  • Blend two ideas:
    • “sloppy commands”
    • predictions based on user behavior data


  • This behavior is subtly and steadily
    increasing in sophistication across many
    interfaces.




                                                11
Sloppy Commands

• Like command languages, but
 • the user has a lot of flexibility in expression
 • so memorization is not required
   • “time graz” “what time is it in graz” “graz time now”




                                                             12
Sloppy Commands + Visual Feedback

• Can include rich visual feedback
 • Quicksilver in Apple




 • Inky by Miller et al.




                                     13
Sloppy Commands + Rich Data

• Combine Mozilla’s Ubiquity and Freebase to
  make a flexible predictive query engine
 •   By spencerwaterbed: http://vimeo.com/13992710




                                                     14
Sloppy Commands + Rich Data

• Combine Mozilla’s Ubiquity and Freebase to
  make a flexible predictive query engine
 •   By spencerwaterbed: http://vimeo.com/13992710




                                                     15
Far Future Trend: Dialogue

• We’re still far away.
• SIRI is promising as a
  move forward; based on
  state-of-the-art research.




                               16
Trend: Social Search

  People are Social; Computers are Lonely.
   Don’t Personalize Search, Socialize it!
Social Search

    Implicit: Suggestions generated as
    a side-effect of search activity.

              Asking: Communicating
              directly with others.


        Explicit: knowledge accumulating via
        the deliberate contributions of many.


                 Collaborative: Working with
                 other people on a search task.


                                                  18
Trend: Social Search

• Socially motivated ranking of search results
 • Explicitly recommended
   • Digg, StumbleUpon
   • Delicious, Furl
   • Google’s SearchWiki


 • Implicitly recommended
   • Click-through
   • People who bought…
   • Yahoo’s MyWeb (now Google Social Search)




                                                 19
Social Search: Implicit Suggestions
• Human-generated suggestions (augmented
  with statistics) still beat purely machine-
  generated ones.

 • Spelling suggestions
 • Query term suggestions (“search as you type”)
 • Recommendations (books, movies, etc)
 • Ranking (using clickthrough statistics)




                                                   20
Social Search: Asking for Answers

 What do people ask of their social networks?
               Type        %                                     Example

                                 Building a new playlist – any ideas for good running songs?
 Recommendation            29%


                                 I am wondering if I should buy the Kitchen-Aid ice cream maker?
 Opinion                   22%


                                 Anyone know a way to put Excel charts into LaTeX?
 Factual                   17%


 Rhetorical                14%   Why are men so stupid?

 Invitation                9%    Who wants to go to Navya Lounge this evening?

                                 Need a babysitter in a big way tonight… anyone??
 Favor                     4%

                                 I am hiring in my team. Do you know anyone who would be interested?
 Social connection         3%


 Offer                     1%    Could any of my friends use boys size 4 jeans?

 Morris et al., CHI 2010                                                                               21
Social Search: Explicit Help via
 Question-Answering Sites

• Content is produced in a manner amenable to
  searching for answers to questions.
• Search tends to work well on these sites and
  on the internet leading to these sites
 • Like an FAQ but
   • with many authors, and
   • with the questions that the audience really wants the
     answers to, and
   • written in the language the audience wants to use.




                                                             22
Social Search:
Seeing info that people you know have seen

• Yahoo MyWeb, Google Social Search




                                             23
Social Search: Explicit Suggestions
 Building Knowledge

• Social knowledge management tools seem promising
• Utilize the best of social networks, tagging, blogging,
  web page creation, wikis, and search.




Millen et al., CHI 2006                                     24
Social Search: People Collaborating
Tools to help with this are only just beginning.




Pickens et al., SIGIR 2008                         25
Social Search: People Collaborating
Tools to help with this are only just beginning.




Pickens et al., SIGIR 2008                         25
Future Trend: The Decline of Text

 • Or: the rise of audio/video

 • The “cultural heavy lifting” (in America at
   least)is moving from text to audio and
   video.




                       (Full essay at http://edge.org/q2009/q09_9.html#hearst)   26
Future Trend: The Decline of Text
 • Or: the rise of audio/video
   • Video and audio are now easy to produce and share.
     • Pew: Use of video sharing sites doubled from
         2006-2009
     • YouTube: Video “responses” apparently arose
         spontaneously
     • Videos for presidential debates were mundane.
     • Millions of video views; no where near this
         number for article readings
   • Pew: Marketing emails with podcasts 20% more likely
      to be opened.
   • Movies with subtitles do poorly in the U.S.
   • Newspaper web sites are starting to look like TV.

                           (Full essay at http://edge.org/q2009/q09_9.html#hearst)   26
Future Trend:
The Decline of Text and Rise of Audio/Video

• What is currently solved:
  • Ease of creating and sharing videos
• What needs improvement:
  • Editing tools
• The main impediments to more fully replacing text are:
  • The need for better search and scanning of audio and video
  • A means for silent audio input
• What about the popularity of texting?
  • An interesting counter-trend
  • Especially popular among youth
    •   Cheap
    •   Can be done surreptitiously


                                      (Full essay at http://edge.org/q2009/q09_9.html#hearst)   28
Future Trend:
The Decline of Text and Rise of Audio/Video

• Other advantages
 • Doesn’t require literacy (but can serve as a bridge)
 • Robust video devices to teach agricultural techniques


• What about the popularity of texting?
 • An interesting counter-trend
 • Especially popular among youth
   • Cheap
   • Can be done surreptitiously




                                   (Full essay at http://edge.org/q2009/q09_9.html#hearst)   27
Future Trends … not so much?

• Personalization

• Visualization … some breakthroughs are
  needed.




                                           29
Summary

As algorithms get more sophisticated, we can
build search interfaces that allow people to
interact more naturally:
 • More language-like queries
 • Speaking & hearing rather than typing & reading
 • Interacting with other people while doing search
   tasks
 • Leveraging the knowledge in peoples’ heads.




                                                      30
Thank you!



                   Marti Hearst
                      UC Berkeley


  Book full text freely available at:
  http://searchuserinterfaces.com

Mais conteúdo relacionado

Mais procurados

Classterms
ClasstermsClassterms
Classtermslindy23
 
Classterms
ClasstermsClassterms
Classtermslindy23
 
Jornada CÚbicS: Social TV: People, Devices and Networks - Marie-José Montpetit
Jornada CÚbicS: Social TV: People, Devices and Networks - Marie-José MontpetitJornada CÚbicS: Social TV: People, Devices and Networks - Marie-José Montpetit
Jornada CÚbicS: Social TV: People, Devices and Networks - Marie-José MontpetitCREA CCMA
 
Simmons College - Fluency with Information Technology
Simmons College - Fluency with Information TechnologySimmons College - Fluency with Information Technology
Simmons College - Fluency with Information TechnologyGail Matthews-DeNatale
 
Govcert2011 - Context-enhanced Authorization
Govcert2011 - Context-enhanced AuthorizationGovcert2011 - Context-enhanced Authorization
Govcert2011 - Context-enhanced AuthorizationMartijn Oostdijk
 
Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...
Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...
Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...trappenl
 
Interpreting the Mobile Audience – Case Study from the US' - Zokem (MoInterpr...
Interpreting the Mobile Audience – Case Study from the US' - Zokem (MoInterpr...Interpreting the Mobile Audience – Case Study from the US' - Zokem (MoInterpr...
Interpreting the Mobile Audience – Case Study from the US' - Zokem (MoInterpr...QuestBack AG
 
Review 1 부분3
Review 1 부분3Review 1 부분3
Review 1 부분3희범 구
 
System Support for Integrated Desktop Video Conferencing
System Support for Integrated Desktop Video ConferencingSystem Support for Integrated Desktop Video Conferencing
System Support for Integrated Desktop Video ConferencingVideoguy
 
Review 1 부분4
Review 1 부분4Review 1 부분4
Review 1 부분4희범 구
 
Communications and Networks
Communications and NetworksCommunications and Networks
Communications and NetworksSamudin Kassan
 
20100625 gov2.0 cmrs
20100625 gov2.0 cmrs20100625 gov2.0 cmrs
20100625 gov2.0 cmrsPolyU
 
A Context Aware Mobile Social Web
A Context Aware Mobile Social WebA Context Aware Mobile Social Web
A Context Aware Mobile Social Webwasvel
 
Connecting To Congress
Connecting To CongressConnecting To Congress
Connecting To CongressInes Mergel
 

Mais procurados (19)

Classterms
ClasstermsClassterms
Classterms
 
Classterms
ClasstermsClassterms
Classterms
 
Jornada CÚbicS: Social TV: People, Devices and Networks - Marie-José Montpetit
Jornada CÚbicS: Social TV: People, Devices and Networks - Marie-José MontpetitJornada CÚbicS: Social TV: People, Devices and Networks - Marie-José Montpetit
Jornada CÚbicS: Social TV: People, Devices and Networks - Marie-José Montpetit
 
Simmons College - Fluency with Information Technology
Simmons College - Fluency with Information TechnologySimmons College - Fluency with Information Technology
Simmons College - Fluency with Information Technology
 
Govcert2011 - Context-enhanced Authorization
Govcert2011 - Context-enhanced AuthorizationGovcert2011 - Context-enhanced Authorization
Govcert2011 - Context-enhanced Authorization
 
Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...
Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...
Towards Abundant Do-it-Yourself (DiY) Service Creativity in the Internet-of-T...
 
Interpreting the Mobile Audience – Case Study from the US' - Zokem (MoInterpr...
Interpreting the Mobile Audience – Case Study from the US' - Zokem (MoInterpr...Interpreting the Mobile Audience – Case Study from the US' - Zokem (MoInterpr...
Interpreting the Mobile Audience – Case Study from the US' - Zokem (MoInterpr...
 
Review 1 부분3
Review 1 부분3Review 1 부분3
Review 1 부분3
 
PRN PPT
PRN PPTPRN PPT
PRN PPT
 
System Support for Integrated Desktop Video Conferencing
System Support for Integrated Desktop Video ConferencingSystem Support for Integrated Desktop Video Conferencing
System Support for Integrated Desktop Video Conferencing
 
Review 1 부분4
Review 1 부분4Review 1 부분4
Review 1 부분4
 
Communications and Networks
Communications and NetworksCommunications and Networks
Communications and Networks
 
Bluevibe presentation v2.2
Bluevibe presentation v2.2Bluevibe presentation v2.2
Bluevibe presentation v2.2
 
20100625 gov2.0 cmrs
20100625 gov2.0 cmrs20100625 gov2.0 cmrs
20100625 gov2.0 cmrs
 
Cyber and influence
Cyber and influenceCyber and influence
Cyber and influence
 
Maya
MayaMaya
Maya
 
Digital Library
Digital LibraryDigital Library
Digital Library
 
A Context Aware Mobile Social Web
A Context Aware Mobile Social WebA Context Aware Mobile Social Web
A Context Aware Mobile Social Web
 
Connecting To Congress
Connecting To CongressConnecting To Congress
Connecting To Congress
 

Semelhante a The Future of Search (Keynote at I-Know 2010)

Empowering the Intelligent Enterprise
Empowering the Intelligent EnterpriseEmpowering the Intelligent Enterprise
Empowering the Intelligent EnterpriseChristine Connors
 
Powering the Intelligent Enterprise
Powering the Intelligent EnterprisePowering the Intelligent Enterprise
Powering the Intelligent EnterpriseChristine Connors
 
BI Forum 2010 - Mobile Business Intelligence
BI Forum 2010 - Mobile Business IntelligenceBI Forum 2010 - Mobile Business Intelligence
BI Forum 2010 - Mobile Business IntelligenceOKsystem
 
The Future of Accessible Digital Media
The Future of Accessible Digital MediaThe Future of Accessible Digital Media
The Future of Accessible Digital Mediacobbers
 
Ross Rubin's Presentation
Ross Rubin's PresentationRoss Rubin's Presentation
Ross Rubin's PresentationMediabistro
 
Mobsens -Journal paper
Mobsens -Journal paperMobsens -Journal paper
Mobsens -Journal paperEman Kanjo
 
Circuit short roadmap
Circuit short roadmap Circuit short roadmap
Circuit short roadmap Darin Walker
 
Mobile Access to Licensed Databases in Medicine and Other Subject Areas
Mobile Access to Licensed Databases in Medicine and Other Subject AreasMobile Access to Licensed Databases in Medicine and Other Subject Areas
Mobile Access to Licensed Databases in Medicine and Other Subject AreasBohyun Kim
 
A SURVEY ON AI POWERED PERSONAL ASSISTANT
A SURVEY ON AI POWERED PERSONAL ASSISTANTA SURVEY ON AI POWERED PERSONAL ASSISTANT
A SURVEY ON AI POWERED PERSONAL ASSISTANTIRJET Journal
 
Interactive speech based games for autistic children with asperger syndrome
Interactive speech based games for autistic children with asperger syndromeInteractive speech based games for autistic children with asperger syndrome
Interactive speech based games for autistic children with asperger syndromeAmal Abduallah
 
The Age of Conversational Agents
The Age of Conversational AgentsThe Age of Conversational Agents
The Age of Conversational AgentsFaction XYZ
 
Chapter 4 universal design
Chapter 4 universal designChapter 4 universal design
Chapter 4 universal designPado Pado
 
Developing Staff Competencies in Emerging Technologies
Developing Staff Competencies in Emerging TechnologiesDeveloping Staff Competencies in Emerging Technologies
Developing Staff Competencies in Emerging TechnologiesDouglas Joubert
 
TDWI Inda BI on Cloud Future State Vision
TDWI Inda BI on Cloud Future State VisionTDWI Inda BI on Cloud Future State Vision
TDWI Inda BI on Cloud Future State Visiontdwiindia
 
Designing Content for Multiple Devices
Designing Content for Multiple DevicesDesigning Content for Multiple Devices
Designing Content for Multiple DevicesBrandon Carson
 
Conversational Business - Trends
Conversational Business - TrendsConversational Business - Trends
Conversational Business - TrendsGeorgian
 

Semelhante a The Future of Search (Keynote at I-Know 2010) (20)

Empowering the Intelligent Enterprise
Empowering the Intelligent EnterpriseEmpowering the Intelligent Enterprise
Empowering the Intelligent Enterprise
 
Powering the Intelligent Enterprise
Powering the Intelligent EnterprisePowering the Intelligent Enterprise
Powering the Intelligent Enterprise
 
Speech Data Collection: Unlocking the Potential of Voice Technology
Speech Data Collection: Unlocking the Potential of Voice TechnologySpeech Data Collection: Unlocking the Potential of Voice Technology
Speech Data Collection: Unlocking the Potential of Voice Technology
 
BI Forum 2010 - Mobile Business Intelligence
BI Forum 2010 - Mobile Business IntelligenceBI Forum 2010 - Mobile Business Intelligence
BI Forum 2010 - Mobile Business Intelligence
 
Leveraging ICT for Development
Leveraging ICT for DevelopmentLeveraging ICT for Development
Leveraging ICT for Development
 
The Future of Accessible Digital Media
The Future of Accessible Digital MediaThe Future of Accessible Digital Media
The Future of Accessible Digital Media
 
Ross Rubin's Presentation
Ross Rubin's PresentationRoss Rubin's Presentation
Ross Rubin's Presentation
 
Mobsens -Journal paper
Mobsens -Journal paperMobsens -Journal paper
Mobsens -Journal paper
 
Circuit short roadmap
Circuit short roadmap Circuit short roadmap
Circuit short roadmap
 
Chapter 4
Chapter 4 Chapter 4
Chapter 4
 
Mobile Access to Licensed Databases in Medicine and Other Subject Areas
Mobile Access to Licensed Databases in Medicine and Other Subject AreasMobile Access to Licensed Databases in Medicine and Other Subject Areas
Mobile Access to Licensed Databases in Medicine and Other Subject Areas
 
A SURVEY ON AI POWERED PERSONAL ASSISTANT
A SURVEY ON AI POWERED PERSONAL ASSISTANTA SURVEY ON AI POWERED PERSONAL ASSISTANT
A SURVEY ON AI POWERED PERSONAL ASSISTANT
 
Interactive speech based games for autistic children with asperger syndrome
Interactive speech based games for autistic children with asperger syndromeInteractive speech based games for autistic children with asperger syndrome
Interactive speech based games for autistic children with asperger syndrome
 
The Age of Conversational Agents
The Age of Conversational AgentsThe Age of Conversational Agents
The Age of Conversational Agents
 
Chapter 4 universal design
Chapter 4 universal designChapter 4 universal design
Chapter 4 universal design
 
Poster Serenoa
Poster SerenoaPoster Serenoa
Poster Serenoa
 
Developing Staff Competencies in Emerging Technologies
Developing Staff Competencies in Emerging TechnologiesDeveloping Staff Competencies in Emerging Technologies
Developing Staff Competencies in Emerging Technologies
 
TDWI Inda BI on Cloud Future State Vision
TDWI Inda BI on Cloud Future State VisionTDWI Inda BI on Cloud Future State Vision
TDWI Inda BI on Cloud Future State Vision
 
Designing Content for Multiple Devices
Designing Content for Multiple DevicesDesigning Content for Multiple Devices
Designing Content for Multiple Devices
 
Conversational Business - Trends
Conversational Business - TrendsConversational Business - Trends
Conversational Business - Trends
 

Mais de marti_hearst

Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails:Latest Trends in Bioscience Literature SearchText, Tags and Thumbnails:Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Searchmarti_hearst
 
The Castanet Algorithm for semi-automatically inducing faceted metadata
The Castanet Algorithm for semi-automatically inducing faceted metadataThe Castanet Algorithm for semi-automatically inducing faceted metadata
The Castanet Algorithm for semi-automatically inducing faceted metadatamarti_hearst
 
Faceted Metadata for Site Navigation and Search
Faceted Metadata for Site Navigation and SearchFaceted Metadata for Site Navigation and Search
Faceted Metadata for Site Navigation and Searchmarti_hearst
 
Some thoughts on social tagging
Some thoughts on social taggingSome thoughts on social tagging
Some thoughts on social taggingmarti_hearst
 
Icwsm 2010 opening
Icwsm 2010 openingIcwsm 2010 opening
Icwsm 2010 openingmarti_hearst
 
Designing Search For Humans
Designing Search For HumansDesigning Search For Humans
Designing Search For Humansmarti_hearst
 

Mais de marti_hearst (7)

Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails:Latest Trends in Bioscience Literature SearchText, Tags and Thumbnails:Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
 
The Castanet Algorithm for semi-automatically inducing faceted metadata
The Castanet Algorithm for semi-automatically inducing faceted metadataThe Castanet Algorithm for semi-automatically inducing faceted metadata
The Castanet Algorithm for semi-automatically inducing faceted metadata
 
Faceted Metadata for Site Navigation and Search
Faceted Metadata for Site Navigation and SearchFaceted Metadata for Site Navigation and Search
Faceted Metadata for Site Navigation and Search
 
Some thoughts on social tagging
Some thoughts on social taggingSome thoughts on social tagging
Some thoughts on social tagging
 
Icwsm 2010 opening
Icwsm 2010 openingIcwsm 2010 opening
Icwsm 2010 opening
 
Designing Search For Humans
Designing Search For HumansDesigning Search For Humans
Designing Search For Humans
 
Social Technology
Social TechnologySocial Technology
Social Technology
 

Último

UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 

Último (20)

UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 

The Future of Search (Keynote at I-Know 2010)

  • 1. Future Trends in Search User Interfaces Dr. Marti Hearst UC Berkeley i-Know Conference Keynote Sept 1, 2010
  • 2. In some cases, blended and Primarily search text context-sensitive Fast response time Search Support for related queries Interfaces and documents today? Navigation and Tailored to keyword organization queries and iterating support from on the information faceted metadata 3
  • 3. Forecasting the Future First: What are the larger trends? In technology? In society? Next: Project out from these.
  • 4. Wide adoption of touch- Latent preferences activated devices with for audio and video excellent UI design Wide adoption of social media and user-generated Increasingly Natural available rich, integrated data Interfaces sources Improvements in Wide adoption of NLP, speech mobile devices with recognition via huge data sets 3
  • 5. Wide adoption of touch- Latent preferences activated devices with for audio and video excellent UI design Wide adoption of social media and user-generated Increasingly Natural available rich, integrated data Interfaces sources Improvements in Wide adoption of NLP, speech mobile devices with recognition via huge data sets 3
  • 6. Wide adoption of touch- Latent preferences activated devices with for audio and video excellent UI design Wide adoption of social media and user-generated Increasingly Natural available rich, integrated data Interfaces sources Improvements in Wide adoption of NLP, speech mobile devices with recognition via huge data sets 3
  • 7. Wide adoption of touch- Latent preferences activated devices with for audio and video excellent UI design Wide adoption of social media and user-generated Increasingly Natural available rich, integrated data Interfaces sources Improvements in Wide adoption of NLP, speech mobile devices with recognition via huge data sets 3
  • 8. Wide adoption of touch- Latent preferences activated devices with for audio and video excellent UI design Wide adoption of social media and user-generated Increasingly Natural available rich, integrated data Interfaces sources Improvements in Wide adoption of NLP, speech mobile devices with recognition via huge data sets 3
  • 9. Wide adoption of touch- Latent preferences activated devices with for audio and video excellent UI design Wide adoption of social media and user-generated Increasingly Natural available rich, integrated data Interfaces sources Improvements in Wide adoption of NLP, speech mobile devices with recognition via huge data sets 3
  • 10. Wide adoption of touch- Latent preferences activated devices with for audio and video excellent UI design Wide adoption of social media and user-generated Increasingly Natural available rich, integrated data Interfaces sources Improvements in Wide adoption of NLP, speech mobile devices with recognition via huge data sets 3
  • 11. Trend: Natural Interfaces What does this mean for Search UIs? 4
  • 12. Trend: Natural Interfaces What does this mean for Search UIs? • Longer, more natural queries • Search that is as social as people are • Deep integration of audio and video • Dialogue and conversational (farther out) 4
  • 14. Trend: Longer, more natural queries • The research suggests people prefer to state their information need rather than use keywords. • But after first using a search engine they quickly learned that full questions resulted in failure. • Average query length continues to increase • Major search engines are now handling long queries well. • Information worded as questions is increasing on the web. • From social question-answering sites and forums. 6
  • 15. A recent example: keywords failed 7
  • 16. Instead, ask as a question 8
  • 17. And: find an answer 9
  • 19. Trend: More Natural Queries • Blend two ideas: • “sloppy commands” • predictions based on user behavior data • This behavior is subtly and steadily increasing in sophistication across many interfaces. 11
  • 20. Sloppy Commands • Like command languages, but • the user has a lot of flexibility in expression • so memorization is not required • “time graz” “what time is it in graz” “graz time now” 12
  • 21. Sloppy Commands + Visual Feedback • Can include rich visual feedback • Quicksilver in Apple • Inky by Miller et al. 13
  • 22. Sloppy Commands + Rich Data • Combine Mozilla’s Ubiquity and Freebase to make a flexible predictive query engine • By spencerwaterbed: http://vimeo.com/13992710 14
  • 23. Sloppy Commands + Rich Data • Combine Mozilla’s Ubiquity and Freebase to make a flexible predictive query engine • By spencerwaterbed: http://vimeo.com/13992710 15
  • 24. Far Future Trend: Dialogue • We’re still far away. • SIRI is promising as a move forward; based on state-of-the-art research. 16
  • 25. Trend: Social Search People are Social; Computers are Lonely. Don’t Personalize Search, Socialize it!
  • 26. Social Search Implicit: Suggestions generated as a side-effect of search activity. Asking: Communicating directly with others. Explicit: knowledge accumulating via the deliberate contributions of many. Collaborative: Working with other people on a search task. 18
  • 27. Trend: Social Search • Socially motivated ranking of search results • Explicitly recommended • Digg, StumbleUpon • Delicious, Furl • Google’s SearchWiki • Implicitly recommended • Click-through • People who bought… • Yahoo’s MyWeb (now Google Social Search) 19
  • 28. Social Search: Implicit Suggestions • Human-generated suggestions (augmented with statistics) still beat purely machine- generated ones. • Spelling suggestions • Query term suggestions (“search as you type”) • Recommendations (books, movies, etc) • Ranking (using clickthrough statistics) 20
  • 29. Social Search: Asking for Answers What do people ask of their social networks? Type % Example Building a new playlist – any ideas for good running songs? Recommendation 29% I am wondering if I should buy the Kitchen-Aid ice cream maker? Opinion 22% Anyone know a way to put Excel charts into LaTeX? Factual 17% Rhetorical 14% Why are men so stupid? Invitation 9% Who wants to go to Navya Lounge this evening? Need a babysitter in a big way tonight… anyone?? Favor 4% I am hiring in my team. Do you know anyone who would be interested? Social connection 3% Offer 1% Could any of my friends use boys size 4 jeans? Morris et al., CHI 2010 21
  • 30. Social Search: Explicit Help via Question-Answering Sites • Content is produced in a manner amenable to searching for answers to questions. • Search tends to work well on these sites and on the internet leading to these sites • Like an FAQ but • with many authors, and • with the questions that the audience really wants the answers to, and • written in the language the audience wants to use. 22
  • 31. Social Search: Seeing info that people you know have seen • Yahoo MyWeb, Google Social Search 23
  • 32. Social Search: Explicit Suggestions Building Knowledge • Social knowledge management tools seem promising • Utilize the best of social networks, tagging, blogging, web page creation, wikis, and search. Millen et al., CHI 2006 24
  • 33. Social Search: People Collaborating Tools to help with this are only just beginning. Pickens et al., SIGIR 2008 25
  • 34. Social Search: People Collaborating Tools to help with this are only just beginning. Pickens et al., SIGIR 2008 25
  • 35. Future Trend: The Decline of Text • Or: the rise of audio/video • The “cultural heavy lifting” (in America at least)is moving from text to audio and video. (Full essay at http://edge.org/q2009/q09_9.html#hearst) 26
  • 36. Future Trend: The Decline of Text • Or: the rise of audio/video • Video and audio are now easy to produce and share. • Pew: Use of video sharing sites doubled from 2006-2009 • YouTube: Video “responses” apparently arose spontaneously • Videos for presidential debates were mundane. • Millions of video views; no where near this number for article readings • Pew: Marketing emails with podcasts 20% more likely to be opened. • Movies with subtitles do poorly in the U.S. • Newspaper web sites are starting to look like TV. (Full essay at http://edge.org/q2009/q09_9.html#hearst) 26
  • 37. Future Trend: The Decline of Text and Rise of Audio/Video • What is currently solved: • Ease of creating and sharing videos • What needs improvement: • Editing tools • The main impediments to more fully replacing text are: • The need for better search and scanning of audio and video • A means for silent audio input • What about the popularity of texting? • An interesting counter-trend • Especially popular among youth • Cheap • Can be done surreptitiously (Full essay at http://edge.org/q2009/q09_9.html#hearst) 28
  • 38. Future Trend: The Decline of Text and Rise of Audio/Video • Other advantages • Doesn’t require literacy (but can serve as a bridge) • Robust video devices to teach agricultural techniques • What about the popularity of texting? • An interesting counter-trend • Especially popular among youth • Cheap • Can be done surreptitiously (Full essay at http://edge.org/q2009/q09_9.html#hearst) 27
  • 39. Future Trends … not so much? • Personalization • Visualization … some breakthroughs are needed. 29
  • 40. Summary As algorithms get more sophisticated, we can build search interfaces that allow people to interact more naturally: • More language-like queries • Speaking & hearing rather than typing & reading • Interacting with other people while doing search tasks • Leveraging the knowledge in peoples’ heads. 30
  • 41. Thank you! Marti Hearst UC Berkeley Book full text freely available at: http://searchuserinterfaces.com