SlideShare uma empresa Scribd logo
1 de 28
Cheap, Accurate RFID Tracking of
Museum Visitors for Personalized
        Content Delivery

  Timothy Baldwin and Lejoe Thomas Kuriakose
1                        RFID Tracking of Museum Visitors for Personalized Content Delivery



              Kubadji Project Overview

• The Kubadji project is the combination of:
      user modelling
      language technology
     in settings that: (a) are informationally rich; (b) are
     occupied by users with different needs/backgrounds;
     (c) have expert domain knowledge of user behaviour;
     and (d) are associated with contexts and user
     behaviours that are informative in understanding users.

                                                                   MW 2009: 18 April, 2009
2                                                     RFID Tracking of Museum Visitors for Personalized Content Delivery




                                          to . . . ?
                     –W
                            hat
                                  ’s t
                          ore          his

                                is relate
                   em                       ?
            ll m
       Te
  –                     does th

                            so far!?
                 story me
   – The                     sa
                     the
                of
          ore
                  – How




     M
––W
        her
              en
                   ext
                        ?
Image: http://www.flickr.com/photos/paullew/2639507829/                                         MW 2009: 18 April, 2009
3                      RFID Tracking of Museum Visitors for Personalized Content Delivery




• Initial focus on:
     virtual simulation of the museum environment
     modelling based on historical data and incorporating
     static (web documents, Wikipedia, curator data,
     physical layout, ...)       and dynamic (observation
     of visitor behaviour, relevance feedback, free-text
     interaction, ...) information

• Collaboration between University of Melbourne, Monash
  University and Melbourne Museum

                                                                 MW 2009: 18 April, 2009
4                           RFID Tracking of Museum Visitors for Personalized Content Delivery




– Path prediction

– Exhibit recommendation


– Prediction of exhibit relatedness

– Personalised summaries



                                                                      MW 2009: 18 April, 2009
4                           RFID Tracking of Museum Visitors for Personalized Content Delivery




– Visitor tracking



– Path prediction

– Exhibit recommendation


– Prediction of exhibit relatedness

– Personalised summaries



                                                                      MW 2009: 18 April, 2009
4                           RFID Tracking of Museum Visitors for Personalized Content Delivery




– Visitor tracking



– Path prediction

– Exhibit recommendation


– Prediction of exhibit relatedness

– Personalised summaries



                                                                      MW 2009: 18 April, 2009
5                           RFID Tracking of Museum Visitors for Personalized Content Delivery




– Visitor tracking



– Path prediction

– Exhibit recommendation


– Prediction of exhibit relatedness

– Personalised summaries



                                                                      MW 2009: 18 April, 2009
6                       RFID Tracking of Museum Visitors for Personalized Content Delivery



             Museum Visitor Tracking
• Basic problem: track the
  path of each museum
  visitor
     with no intrusion
     at minimal cost
     as accurately as possible

• Underlying questions: how accurate do we need to
  be for “useful” personalisation? how do we measure
  accuracy?

                                                                  MW 2009: 18 April, 2009
7                     RFID Tracking of Museum Visitors for Personalized Content Delivery



        Contributions of this Research

• Development of an evaluation framework for “discrete”
  tracking, e.g. for museum purposes

• Comparison of tracking accuracy under different
  modalities, and finding that proximity-based tracking
  is a reasonable proxy for full-on gaze-based tracking




                                                                MW 2009: 18 April, 2009
8                RFID Tracking of Museum Visitors for Personalized Content Delivery



        Mainstream Tracking Options
• Passive RFID

• Active RFID

• Bluetooth

• Wireless LAN

• (Indoor) GPS



                                                           MW 2009: 18 April, 2009
8                RFID Tracking of Museum Visitors for Personalized Content Delivery



        Mainstream Tracking Options
• Passive RFID

• Active RFID

• Bluetooth

• Wireless LAN

• (Indoor) GPS



                                                           MW 2009: 18 April, 2009
9                      RFID Tracking of Museum Visitors for Personalized Content Delivery



     Sensing vs. “Bookmarking” vs. Tracking

• Sensing = automatically sensing that a visitor is in the
  proximity of a given exhibit (and acting accordingly)

• Bookmarking = visitor “swipes” a given exhibit (e.g. to
  get more information post-visit)

• Tracking = tracing a given visitor’s path through the
  museum space



                                                                 MW 2009: 18 April, 2009
10                     RFID Tracking of Museum Visitors for Personalized Content Delivery



       Continuous vs. Discrete Tracking

• Ultimately, we are interested in which exhibits a given
  visitor has visited, when, and for how long; as such,
  discrete tracking is (probably) sufficient for our purposes
        Continuous:                                   Discrete:


                               vs.



                                                                 MW 2009: 18 April, 2009
11                     RFID Tracking of Museum Visitors for Personalized Content Delivery



          Spin-off Benefits of Tracking

• “Heat mapping” of visitor pathways through the
  museum

• Analysis of exhibit “clusters”

• Profiling of different visitor types

• Targeted marketing



                                                                 MW 2009: 18 April, 2009
12        RFID Tracking of Museum Visitors for Personalized Content Delivery




     The Gory Details




                                                   MW 2009: 18 April, 2009
13                    RFID Tracking of Museum Visitors for Personalized Content Delivery



                 Hardware Set-up
• Visitors provided with passive RFID tags, housed in a
  badge holder worn around the neck

• Exhibits/exhibit areas instrumented with                                    RFID
  antennae, connected to individual RFID readers

• RFID readers connected to a central server via USB
  connections

• Tracker output takes the form of a sequence of
   exhibiti, visitorj , timestart, timeend tuples
                                                                MW 2009: 18 April, 2009
14                      RFID Tracking of Museum Visitors for Personalized Content Delivery



                   Man vs. Machine
• The basic question we are asking is:
      how accurate is automatic tracking?

• To answer this question, we compare RFID-based
  tracking to human tracking over a series of visitors to
  two separate mini-galleries, with the humans alternating
  between the two “tracking modalities” of:
 1. physical proximity-based exhibit “engagement”
 2. visitor gaze-based exhibit “engagement”

                                                                  MW 2009: 18 April, 2009
15                      RFID Tracking of Museum Visitors for Personalized Content Delivery



               Tracking Experiment
• Two separate mini-galleries, each with three exhibits:




• Two human trackers (same tracking modality)

• 15 visitors in total, one at a time
                                                                  MW 2009: 18 April, 2009
16                    RFID Tracking of Museum Visitors for Personalized Content Delivery



                   GeckoTracker
• The human trackers used the GeckoTracker
  tracking software to record where a given visitor went




• (Same software used for large-scale full-visit tracking
  experiment through Melbourne Museum)
                                                                MW 2009: 18 April, 2009
17                     RFID Tracking of Museum Visitors for Personalized Content Delivery



                      Evaluation

• Basic methodology, given an evaluation metric:
      evaluate the “agreement” between the two human
      trackers [gold-standard]
      evaluate the “agreement” between the RFID output
      and the intersection of the two human trackers
      compare the two




                                                                 MW 2009: 18 April, 2009
18                          RFID Tracking of Museum Visitors for Personalized Content Delivery



        Evaluation Metric 1: Edit Distance

• Intuition: how many “tweaks” to the sequence of
  exhibits returned by method A need to be made to
  transform it into the sequence for method B? [ignore
  time spent at exhibits]
      d( E1, E3, E1 , E2, E1 ) = 2
      d( E1, E3, E1 , E3, E1 ) = 1

• Use edit distance to calculate the distance between a
  given pair of sequences

                                                                      MW 2009: 18 April, 2009
19                              RFID Tracking of Museum Visitors for Personalized Content Delivery



         Evaluation Metric 2: Paired t-test

• Intuition: what is the statistical similarity in the timed
  sequence of exhibits returned by method A relative to
  that for method B?
      t( E1(0 : 10, 0 : 25), ... , E2(0 : 25, 0 : 37), ... ) = 0.7
      t( E1(0 : 10, 0 : 25), ... , E1(0 : 10, 0 : 27), ... ) = 0.1

• Normalise the times, and calculate using the two-tailed
  paired t-test


                                                                          MW 2009: 18 April, 2009
20                    RFID Tracking of Museum Visitors for Personalized Content Delivery



 Results: Human vs. Machine (Gallery 1)
                  Tracker         Edit   Paired
     Modality
                  Pairing       Distance t-test
              Human vs. Human     0.50    0.41
     Distance
              Human vs. machine   0.75    0.71
              Human vs. Human     0.75    0.43
      Gaze
              Human vs. machine   1.00    0.76




                                                               MW 2009: 18 April, 2009
21                    RFID Tracking of Museum Visitors for Personalized Content Delivery



 Results: Human vs. Machine (Gallery 2)
                  Tracker         Edit   Paired
     Modality
                  Pairing       Distance t-test
              Human vs. Human     1.25    0.17
     Distance
              Human vs. machine   2.25    0.36
              Human vs. Human     1.25    0.30
      Gaze
              Human vs. machine   1.50    0.37




                                                               MW 2009: 18 April, 2009
22                   RFID Tracking of Museum Visitors for Personalized Content Delivery



      Numbers, Numbers Everywhere ...

• RFID-based tracker always performs worse than human
  performance

• Relative human vs. machine agreement is almost
  unchanged between the distance and gaze modalities

• Open-plan galleries are more of a challenge for both
  humans and machines



                                                               MW 2009: 18 April, 2009
23                     RFID Tracking of Museum Visitors for Personalized Content Delivery



                    Error Analysis

• False negatives the primary cause of errors for the RFID-
  based tracker

• Signal dropout also contributed




                                                                 MW 2009: 18 April, 2009
24                      RFID Tracking of Museum Visitors for Personalized Content Delivery



                       Summary
• Promising results for RFID-based tracking

• Proposal of a series of evaluation metrics for tracking
  evaluation



• Solid platform to do all the
  sexy research ...



                                                                  MW 2009: 18 April, 2009

Mais conteúdo relacionado

Mais de museums and the web

MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap be...
MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap be...MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap be...
MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap be...museums and the web
 
MW2011: Klavans, J. +, Computational Linguistics in Museums: Applications fo...
MW2011: Klavans, J.  +, Computational Linguistics in Museums: Applications fo...MW2011: Klavans, J.  +, Computational Linguistics in Museums: Applications fo...
MW2011: Klavans, J. +, Computational Linguistics in Museums: Applications fo...museums and the web
 
MW2011: L. Tallon + I. Froes, Going Mobile? Insights into the museum communit...
MW2011: L. Tallon + I. Froes, Going Mobile? Insights into the museum communit...MW2011: L. Tallon + I. Froes, Going Mobile? Insights into the museum communit...
MW2011: L. Tallon + I. Froes, Going Mobile? Insights into the museum communit...museums and the web
 
MW2011: D. Laursen, Guided expectations: a case study of a sound collage audi...
MW2011: D. Laursen, Guided expectations: a case study of a sound collage audi...MW2011: D. Laursen, Guided expectations: a case study of a sound collage audi...
MW2011: D. Laursen, Guided expectations: a case study of a sound collage audi...museums and the web
 
MW2011: J. Flemming +, Launching the MFA Multimedia Guide
MW2011: J. Flemming +, Launching the MFA Multimedia GuideMW2011: J. Flemming +, Launching the MFA Multimedia Guide
MW2011: J. Flemming +, Launching the MFA Multimedia Guidemuseums and the web
 
MW2011: S. Fantoni, Mobile devices for orientation and way finding: the case ...
MW2011: S. Fantoni, Mobile devices for orientation and way finding: the case ...MW2011: S. Fantoni, Mobile devices for orientation and way finding: the case ...
MW2011: S. Fantoni, Mobile devices for orientation and way finding: the case ...museums and the web
 
MW2011: J. Bickersteth + C. Ainsley, Mobile Phones and Visitor Tracking
MW2011: J. Bickersteth + C. Ainsley, Mobile Phones and Visitor TrackingMW2011: J. Bickersteth + C. Ainsley, Mobile Phones and Visitor Tracking
MW2011: J. Bickersteth + C. Ainsley, Mobile Phones and Visitor Trackingmuseums and the web
 
MW2011: Quigley, S., Integration of Print and Digital Publishing Workflows at...
MW2011: Quigley, S., Integration of Print and Digital Publishing Workflows at...MW2011: Quigley, S., Integration of Print and Digital Publishing Workflows at...
MW2011: Quigley, S., Integration of Print and Digital Publishing Workflows at...museums and the web
 
MW2011: Cope, A., Authority Records, Future Computers and Other Unfinished Hi...
MW2011: Cope, A., Authority Records, Future Computers and Other Unfinished Hi...MW2011: Cope, A., Authority Records, Future Computers and Other Unfinished Hi...
MW2011: Cope, A., Authority Records, Future Computers and Other Unfinished Hi...museums and the web
 
MW2011: S. Kenderdine, Cultural Data Sculpting
MW2011: S. Kenderdine, Cultural Data SculptingMW2011: S. Kenderdine, Cultural Data Sculpting
MW2011: S. Kenderdine, Cultural Data Sculptingmuseums and the web
 
MW2010: N. Proctor, The Museum Is Mobile: Cross-platform content design for a...
MW2010: N. Proctor, The Museum Is Mobile: Cross-platform content design for a...MW2010: N. Proctor, The Museum Is Mobile: Cross-platform content design for a...
MW2010: N. Proctor, The Museum Is Mobile: Cross-platform content design for a...museums and the web
 
MW2010: J. Doyle + M. Doyle, Mixing Social Glue with Brick and Mortar: Experi...
MW2010: J. Doyle + M. Doyle, Mixing Social Glue with Brick and Mortar: Experi...MW2010: J. Doyle + M. Doyle, Mixing Social Glue with Brick and Mortar: Experi...
MW2010: J. Doyle + M. Doyle, Mixing Social Glue with Brick and Mortar: Experi...museums and the web
 
MW2010: M. Petrie + L. Tallon, The iPhone effect?: Comparing visitors’ and mu...
MW2010: M. Petrie + L. Tallon, The iPhone effect?: Comparing visitors’ and mu...MW2010: M. Petrie + L. Tallon, The iPhone effect?: Comparing visitors’ and mu...
MW2010: M. Petrie + L. Tallon, The iPhone effect?: Comparing visitors’ and mu...museums and the web
 
MW2010: Building an online research community: The Reciprocal Research Network
MW2010: Building an online research community: The Reciprocal Research Network MW2010: Building an online research community: The Reciprocal Research Network
MW2010: Building an online research community: The Reciprocal Research Network museums and the web
 
MW2010: S. Hazan et al., ATHENA: A Mechanism for Harvesting Europe's Museum H...
MW2010: S. Hazan et al., ATHENA: A Mechanism for Harvesting Europe's Museum H...MW2010: S. Hazan et al., ATHENA: A Mechanism for Harvesting Europe's Museum H...
MW2010: S. Hazan et al., ATHENA: A Mechanism for Harvesting Europe's Museum H...museums and the web
 
MW2010: D. Peacock, Putting Mallala on the map: Creating a wiki community wit...
MW2010: D. Peacock, Putting Mallala on the map: Creating a wiki community wit...MW2010: D. Peacock, Putting Mallala on the map: Creating a wiki community wit...
MW2010: D. Peacock, Putting Mallala on the map: Creating a wiki community wit...museums and the web
 
MW2010: E. Bachta and R. Stein, Breaking the Bottleneck: Using Pseudo-Wikis t...
MW2010: E. Bachta and R. Stein, Breaking the Bottleneck: Using Pseudo-Wikis t...MW2010: E. Bachta and R. Stein, Breaking the Bottleneck: Using Pseudo-Wikis t...
MW2010: E. Bachta and R. Stein, Breaking the Bottleneck: Using Pseudo-Wikis t...museums and the web
 
MW2010: A. Burnette, D. Mitroff Silvers + C. Sexton, Tales of the Unexpected:...
MW2010: A. Burnette, D. Mitroff Silvers + C. Sexton, Tales of the Unexpected:...MW2010: A. Burnette, D. Mitroff Silvers + C. Sexton, Tales of the Unexpected:...
MW2010: A. Burnette, D. Mitroff Silvers + C. Sexton, Tales of the Unexpected:...museums and the web
 
MW2010: Dana Mitroff Silvers + Alon Salant, Play at Work: Applying Agile Meth...
MW2010: Dana Mitroff Silvers + Alon Salant, Play at Work: Applying Agile Meth...MW2010: Dana Mitroff Silvers + Alon Salant, Play at Work: Applying Agile Meth...
MW2010: Dana Mitroff Silvers + Alon Salant, Play at Work: Applying Agile Meth...museums and the web
 

Mais de museums and the web (20)

MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap be...
MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap be...MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap be...
MW2011: G. Chae +, Can Social Tagging Be a Tool to Reduce the Semantic Gap be...
 
MW2011: Klavans, J. +, Computational Linguistics in Museums: Applications fo...
MW2011: Klavans, J.  +, Computational Linguistics in Museums: Applications fo...MW2011: Klavans, J.  +, Computational Linguistics in Museums: Applications fo...
MW2011: Klavans, J. +, Computational Linguistics in Museums: Applications fo...
 
MW2011: L. Tallon + I. Froes, Going Mobile? Insights into the museum communit...
MW2011: L. Tallon + I. Froes, Going Mobile? Insights into the museum communit...MW2011: L. Tallon + I. Froes, Going Mobile? Insights into the museum communit...
MW2011: L. Tallon + I. Froes, Going Mobile? Insights into the museum communit...
 
MW2011: D. Laursen, Guided expectations: a case study of a sound collage audi...
MW2011: D. Laursen, Guided expectations: a case study of a sound collage audi...MW2011: D. Laursen, Guided expectations: a case study of a sound collage audi...
MW2011: D. Laursen, Guided expectations: a case study of a sound collage audi...
 
MW2011: J. Flemming +, Launching the MFA Multimedia Guide
MW2011: J. Flemming +, Launching the MFA Multimedia GuideMW2011: J. Flemming +, Launching the MFA Multimedia Guide
MW2011: J. Flemming +, Launching the MFA Multimedia Guide
 
MW2011: S. Fantoni, Mobile devices for orientation and way finding: the case ...
MW2011: S. Fantoni, Mobile devices for orientation and way finding: the case ...MW2011: S. Fantoni, Mobile devices for orientation and way finding: the case ...
MW2011: S. Fantoni, Mobile devices for orientation and way finding: the case ...
 
MW2011: J. Bickersteth + C. Ainsley, Mobile Phones and Visitor Tracking
MW2011: J. Bickersteth + C. Ainsley, Mobile Phones and Visitor TrackingMW2011: J. Bickersteth + C. Ainsley, Mobile Phones and Visitor Tracking
MW2011: J. Bickersteth + C. Ainsley, Mobile Phones and Visitor Tracking
 
MW2011 Best of the Web Awards
MW2011 Best of the Web AwardsMW2011 Best of the Web Awards
MW2011 Best of the Web Awards
 
MW2011: Quigley, S., Integration of Print and Digital Publishing Workflows at...
MW2011: Quigley, S., Integration of Print and Digital Publishing Workflows at...MW2011: Quigley, S., Integration of Print and Digital Publishing Workflows at...
MW2011: Quigley, S., Integration of Print and Digital Publishing Workflows at...
 
MW2011: Cope, A., Authority Records, Future Computers and Other Unfinished Hi...
MW2011: Cope, A., Authority Records, Future Computers and Other Unfinished Hi...MW2011: Cope, A., Authority Records, Future Computers and Other Unfinished Hi...
MW2011: Cope, A., Authority Records, Future Computers and Other Unfinished Hi...
 
MW2011: S. Kenderdine, Cultural Data Sculpting
MW2011: S. Kenderdine, Cultural Data SculptingMW2011: S. Kenderdine, Cultural Data Sculpting
MW2011: S. Kenderdine, Cultural Data Sculpting
 
MW2010: N. Proctor, The Museum Is Mobile: Cross-platform content design for a...
MW2010: N. Proctor, The Museum Is Mobile: Cross-platform content design for a...MW2010: N. Proctor, The Museum Is Mobile: Cross-platform content design for a...
MW2010: N. Proctor, The Museum Is Mobile: Cross-platform content design for a...
 
MW2010: J. Doyle + M. Doyle, Mixing Social Glue with Brick and Mortar: Experi...
MW2010: J. Doyle + M. Doyle, Mixing Social Glue with Brick and Mortar: Experi...MW2010: J. Doyle + M. Doyle, Mixing Social Glue with Brick and Mortar: Experi...
MW2010: J. Doyle + M. Doyle, Mixing Social Glue with Brick and Mortar: Experi...
 
MW2010: M. Petrie + L. Tallon, The iPhone effect?: Comparing visitors’ and mu...
MW2010: M. Petrie + L. Tallon, The iPhone effect?: Comparing visitors’ and mu...MW2010: M. Petrie + L. Tallon, The iPhone effect?: Comparing visitors’ and mu...
MW2010: M. Petrie + L. Tallon, The iPhone effect?: Comparing visitors’ and mu...
 
MW2010: Building an online research community: The Reciprocal Research Network
MW2010: Building an online research community: The Reciprocal Research Network MW2010: Building an online research community: The Reciprocal Research Network
MW2010: Building an online research community: The Reciprocal Research Network
 
MW2010: S. Hazan et al., ATHENA: A Mechanism for Harvesting Europe's Museum H...
MW2010: S. Hazan et al., ATHENA: A Mechanism for Harvesting Europe's Museum H...MW2010: S. Hazan et al., ATHENA: A Mechanism for Harvesting Europe's Museum H...
MW2010: S. Hazan et al., ATHENA: A Mechanism for Harvesting Europe's Museum H...
 
MW2010: D. Peacock, Putting Mallala on the map: Creating a wiki community wit...
MW2010: D. Peacock, Putting Mallala on the map: Creating a wiki community wit...MW2010: D. Peacock, Putting Mallala on the map: Creating a wiki community wit...
MW2010: D. Peacock, Putting Mallala on the map: Creating a wiki community wit...
 
MW2010: E. Bachta and R. Stein, Breaking the Bottleneck: Using Pseudo-Wikis t...
MW2010: E. Bachta and R. Stein, Breaking the Bottleneck: Using Pseudo-Wikis t...MW2010: E. Bachta and R. Stein, Breaking the Bottleneck: Using Pseudo-Wikis t...
MW2010: E. Bachta and R. Stein, Breaking the Bottleneck: Using Pseudo-Wikis t...
 
MW2010: A. Burnette, D. Mitroff Silvers + C. Sexton, Tales of the Unexpected:...
MW2010: A. Burnette, D. Mitroff Silvers + C. Sexton, Tales of the Unexpected:...MW2010: A. Burnette, D. Mitroff Silvers + C. Sexton, Tales of the Unexpected:...
MW2010: A. Burnette, D. Mitroff Silvers + C. Sexton, Tales of the Unexpected:...
 
MW2010: Dana Mitroff Silvers + Alon Salant, Play at Work: Applying Agile Meth...
MW2010: Dana Mitroff Silvers + Alon Salant, Play at Work: Applying Agile Meth...MW2010: Dana Mitroff Silvers + Alon Salant, Play at Work: Applying Agile Meth...
MW2010: Dana Mitroff Silvers + Alon Salant, Play at Work: Applying Agile Meth...
 

Último

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfhans926745
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 

Último (20)

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 

Cheap, Accurate RFID Tracking of Museum Visitors for Personalised Content Delivery

  • 1. Cheap, Accurate RFID Tracking of Museum Visitors for Personalized Content Delivery Timothy Baldwin and Lejoe Thomas Kuriakose
  • 2. 1 RFID Tracking of Museum Visitors for Personalized Content Delivery Kubadji Project Overview • The Kubadji project is the combination of: user modelling language technology in settings that: (a) are informationally rich; (b) are occupied by users with different needs/backgrounds; (c) have expert domain knowledge of user behaviour; and (d) are associated with contexts and user behaviours that are informative in understanding users. MW 2009: 18 April, 2009
  • 3. 2 RFID Tracking of Museum Visitors for Personalized Content Delivery to . . . ? –W hat ’s t ore his is relate em ? ll m Te – does th so far!? story me – The sa the of ore – How M ––W her en ext ? Image: http://www.flickr.com/photos/paullew/2639507829/ MW 2009: 18 April, 2009
  • 4. 3 RFID Tracking of Museum Visitors for Personalized Content Delivery • Initial focus on: virtual simulation of the museum environment modelling based on historical data and incorporating static (web documents, Wikipedia, curator data, physical layout, ...) and dynamic (observation of visitor behaviour, relevance feedback, free-text interaction, ...) information • Collaboration between University of Melbourne, Monash University and Melbourne Museum MW 2009: 18 April, 2009
  • 5. 4 RFID Tracking of Museum Visitors for Personalized Content Delivery – Path prediction – Exhibit recommendation – Prediction of exhibit relatedness – Personalised summaries MW 2009: 18 April, 2009
  • 6. 4 RFID Tracking of Museum Visitors for Personalized Content Delivery – Visitor tracking – Path prediction – Exhibit recommendation – Prediction of exhibit relatedness – Personalised summaries MW 2009: 18 April, 2009
  • 7. 4 RFID Tracking of Museum Visitors for Personalized Content Delivery – Visitor tracking – Path prediction – Exhibit recommendation – Prediction of exhibit relatedness – Personalised summaries MW 2009: 18 April, 2009
  • 8. 5 RFID Tracking of Museum Visitors for Personalized Content Delivery – Visitor tracking – Path prediction – Exhibit recommendation – Prediction of exhibit relatedness – Personalised summaries MW 2009: 18 April, 2009
  • 9. 6 RFID Tracking of Museum Visitors for Personalized Content Delivery Museum Visitor Tracking • Basic problem: track the path of each museum visitor with no intrusion at minimal cost as accurately as possible • Underlying questions: how accurate do we need to be for “useful” personalisation? how do we measure accuracy? MW 2009: 18 April, 2009
  • 10. 7 RFID Tracking of Museum Visitors for Personalized Content Delivery Contributions of this Research • Development of an evaluation framework for “discrete” tracking, e.g. for museum purposes • Comparison of tracking accuracy under different modalities, and finding that proximity-based tracking is a reasonable proxy for full-on gaze-based tracking MW 2009: 18 April, 2009
  • 11. 8 RFID Tracking of Museum Visitors for Personalized Content Delivery Mainstream Tracking Options • Passive RFID • Active RFID • Bluetooth • Wireless LAN • (Indoor) GPS MW 2009: 18 April, 2009
  • 12. 8 RFID Tracking of Museum Visitors for Personalized Content Delivery Mainstream Tracking Options • Passive RFID • Active RFID • Bluetooth • Wireless LAN • (Indoor) GPS MW 2009: 18 April, 2009
  • 13. 9 RFID Tracking of Museum Visitors for Personalized Content Delivery Sensing vs. “Bookmarking” vs. Tracking • Sensing = automatically sensing that a visitor is in the proximity of a given exhibit (and acting accordingly) • Bookmarking = visitor “swipes” a given exhibit (e.g. to get more information post-visit) • Tracking = tracing a given visitor’s path through the museum space MW 2009: 18 April, 2009
  • 14. 10 RFID Tracking of Museum Visitors for Personalized Content Delivery Continuous vs. Discrete Tracking • Ultimately, we are interested in which exhibits a given visitor has visited, when, and for how long; as such, discrete tracking is (probably) sufficient for our purposes Continuous: Discrete: vs. MW 2009: 18 April, 2009
  • 15. 11 RFID Tracking of Museum Visitors for Personalized Content Delivery Spin-off Benefits of Tracking • “Heat mapping” of visitor pathways through the museum • Analysis of exhibit “clusters” • Profiling of different visitor types • Targeted marketing MW 2009: 18 April, 2009
  • 16. 12 RFID Tracking of Museum Visitors for Personalized Content Delivery The Gory Details MW 2009: 18 April, 2009
  • 17. 13 RFID Tracking of Museum Visitors for Personalized Content Delivery Hardware Set-up • Visitors provided with passive RFID tags, housed in a badge holder worn around the neck • Exhibits/exhibit areas instrumented with RFID antennae, connected to individual RFID readers • RFID readers connected to a central server via USB connections • Tracker output takes the form of a sequence of exhibiti, visitorj , timestart, timeend tuples MW 2009: 18 April, 2009
  • 18. 14 RFID Tracking of Museum Visitors for Personalized Content Delivery Man vs. Machine • The basic question we are asking is: how accurate is automatic tracking? • To answer this question, we compare RFID-based tracking to human tracking over a series of visitors to two separate mini-galleries, with the humans alternating between the two “tracking modalities” of: 1. physical proximity-based exhibit “engagement” 2. visitor gaze-based exhibit “engagement” MW 2009: 18 April, 2009
  • 19. 15 RFID Tracking of Museum Visitors for Personalized Content Delivery Tracking Experiment • Two separate mini-galleries, each with three exhibits: • Two human trackers (same tracking modality) • 15 visitors in total, one at a time MW 2009: 18 April, 2009
  • 20. 16 RFID Tracking of Museum Visitors for Personalized Content Delivery GeckoTracker • The human trackers used the GeckoTracker tracking software to record where a given visitor went • (Same software used for large-scale full-visit tracking experiment through Melbourne Museum) MW 2009: 18 April, 2009
  • 21. 17 RFID Tracking of Museum Visitors for Personalized Content Delivery Evaluation • Basic methodology, given an evaluation metric: evaluate the “agreement” between the two human trackers [gold-standard] evaluate the “agreement” between the RFID output and the intersection of the two human trackers compare the two MW 2009: 18 April, 2009
  • 22. 18 RFID Tracking of Museum Visitors for Personalized Content Delivery Evaluation Metric 1: Edit Distance • Intuition: how many “tweaks” to the sequence of exhibits returned by method A need to be made to transform it into the sequence for method B? [ignore time spent at exhibits] d( E1, E3, E1 , E2, E1 ) = 2 d( E1, E3, E1 , E3, E1 ) = 1 • Use edit distance to calculate the distance between a given pair of sequences MW 2009: 18 April, 2009
  • 23. 19 RFID Tracking of Museum Visitors for Personalized Content Delivery Evaluation Metric 2: Paired t-test • Intuition: what is the statistical similarity in the timed sequence of exhibits returned by method A relative to that for method B? t( E1(0 : 10, 0 : 25), ... , E2(0 : 25, 0 : 37), ... ) = 0.7 t( E1(0 : 10, 0 : 25), ... , E1(0 : 10, 0 : 27), ... ) = 0.1 • Normalise the times, and calculate using the two-tailed paired t-test MW 2009: 18 April, 2009
  • 24. 20 RFID Tracking of Museum Visitors for Personalized Content Delivery Results: Human vs. Machine (Gallery 1) Tracker Edit Paired Modality Pairing Distance t-test Human vs. Human 0.50 0.41 Distance Human vs. machine 0.75 0.71 Human vs. Human 0.75 0.43 Gaze Human vs. machine 1.00 0.76 MW 2009: 18 April, 2009
  • 25. 21 RFID Tracking of Museum Visitors for Personalized Content Delivery Results: Human vs. Machine (Gallery 2) Tracker Edit Paired Modality Pairing Distance t-test Human vs. Human 1.25 0.17 Distance Human vs. machine 2.25 0.36 Human vs. Human 1.25 0.30 Gaze Human vs. machine 1.50 0.37 MW 2009: 18 April, 2009
  • 26. 22 RFID Tracking of Museum Visitors for Personalized Content Delivery Numbers, Numbers Everywhere ... • RFID-based tracker always performs worse than human performance • Relative human vs. machine agreement is almost unchanged between the distance and gaze modalities • Open-plan galleries are more of a challenge for both humans and machines MW 2009: 18 April, 2009
  • 27. 23 RFID Tracking of Museum Visitors for Personalized Content Delivery Error Analysis • False negatives the primary cause of errors for the RFID- based tracker • Signal dropout also contributed MW 2009: 18 April, 2009
  • 28. 24 RFID Tracking of Museum Visitors for Personalized Content Delivery Summary • Promising results for RFID-based tracking • Proposal of a series of evaluation metrics for tracking evaluation • Solid platform to do all the sexy research ... MW 2009: 18 April, 2009