SlideShare uma empresa Scribd logo
1 de 25
Presented By: SUMMIYA FARHEEN
             8th Sem CSE
User defined gestures for surface computing
INTRODUCTION
What is a gesture ?
  Gestures are expressive , meaningful body motions with the intent to convey
  information or to interact with the environment.

  Body motions  physical movements of the fingers, hands, arms head, head,
  face or body.
                            What is Surface computing ?
                             It is a computer that interacts with the user
                             through the surface of an ordinary object,
                             rather than a keyboard or monitor.

                             User interacts with touch sensitive screen.

                             People use their fingers to manipulate it.
A key challenge
Traditional input using the keyboard, mouse, and mouse-based widgets is no
longer preferable

                    No keyboard used




                                No mouse used


                  Human-computer interaction have been exploring interactive

                  TABLETOPS for use by individuals and groups, as part of
                  multi-display environments, and for fun and entertainment.
STRUCTURE OF TABLETOP
   History
 This idea came up in 2001 by the Microsoft researchers “Steve bark son” &
   “ Andy Wilson”.
 In 2003 they presented to bill gates for the approval.
 Later in 2007 this interactive table top device was built.



               Tabletop Computer
WORKING OF MICROSOFT SURFACE
The Surface is not a touch-sensitive screen device…
It uses multiple infrared cameras beneath the screen to sense objects,
physical touch, etc. .
This information is processed and
         displayed using “Rear Projection”.

          (1)Screen Diffuser :

           ”Multi-touch" screen.
           Can process multiple inputs
             and recognize objects by
               their shapes or coded
          "domino" tags.
Cont.…
(2) Infrared:
    The ”Machine Vision" is aimed at the screen.

    Once an object touches the tabletop ;

       the light reflects back and is picked up by infrared cameras.

(3) CPU:
    Uses similar components as current desktop computers, Core 2 Duo processor,

             2GB of RAM and a 256MB graphics card, Wireless communication,

                     Wi-Fi and Bluetooth antennas, Operating system.

                        (4) Projector:
                         Uses a DLP (digital light processing) light engine.
CLASSIFICATION OF HUMAN GESTURE
“Microsoft Surface represents a fundamental change in the way we interact with
digital content.
With Surface, we can actually grab data with our hands, and move information
between objects with natural gestures and touch.”
                    1. Efron
                            conducted studies of human gesture he categorized
                    it into five categories –
                    a) Physiographic
                    b) Kinetographic
                    c)   Ideographic
                    d) Deictic and
                    e)   Batons.
2. Kendon
   Showed that gestures exist on a spectrum of formality and speech-dependency.
   From least to most formal, the spectrum was: language-like gestures, emblems,
     and sign languages.

3. Tang
 Analyzed people collaborating around a large drawing surface.
 Gestures emerged as an important element for simulating operations,
              indicating areas of interest, and referring to other group members.
              Tang noted actions and functions, i.e., behaviors and their effects,
                which are like the signs and referents in our guessability methodology.
CLASSIFICATION OF SURFACE GESTURES
 Three authors independently designed
   their own gestures for the 27
   Referents.

 Among those 27 referents Four were
   not assigned as gestures:

          Insert

                Maximize

                     Task switch

                               Close
Instead 
• Insert used by dragging

• Maximize used by enlarging

• Task switch by tapping an imaginary taskbar button.

• Close by tapping an imaginary button in the top-right corner of an open view.


            And they manually classified each gesture along four dimensions:
                                      1. Form
                                      2. Nature
                                      3. Binding
                                      4. Flow
1. Form:
• The scope of this dimension is within one hand.

• It is applied separately to each hand in a 2-hand gesture.

• These are worth distinguishing because of their similarity to mouse actions.


                  2. Nature:
                  • In the nature dimension, symbolic gestures are visual depictions.
                  • Examples :
                           Tracing a caret (“^”) to perform insert,
                    Or
                           Forming the O.K. pose on the table (“        ”) for accept.
3. Binding:
• In this dimension, object-centric gestures only require information about the object
   they affect or produce.

• An example is pinching two fingers together on top of an object for shrink.



              4. Flow:
              • A gesture’s flow is discrete if the gesture is performed, delimited,
                  recognized, and responded to as an event.

              • An example is tracing a question mark (“?”) to bring up help. .
 Although the authors are experts in human computer interaction, it was
   hypothesized that the “wisdom of crowds” would generate a better set than the
   authors.

 Each author individually came up with only 43.5% of the user-defined
   gestures.

 Even combined, the authors only covered 60.9% of the users’ set.


                This suggests that three experts cannot generate the scope of
                               gestures that 20 participants can.
 Later the authors asked 20 people to participate to find different gestures based
   on their ideas thinking it would make better gesture set.



 Among those 20 participants some used 1-hand gestures and some used 2-hand
   gestures.


                  Totally they made 1080 gestures set .
                 [27refrents X 20 participants X 2 = 1080]
THE USER-DEFINED
GESTURE SET
User defined gestures for surface computing
How is the Surface used ?
• Wireless! Transfer pictures from camera to
Surface and cell phone. “Drag and drop virtual
content to physical objects.”
• Digital interactive painting using paint brush
• At a phone store.
• At a restaurant.
• Play games and use the Internet.
• Jukebox! Browse music, make play lists.
• Maps and Billboard for advertising
FEATURES OF SURFACE COMPUTING
  A form of computing that offers “a natural way of interacting with information,”
  rather than traditional user interface:


• Direct Interaction: The ability to "grab" digital
   information with hands - interacting with
   touch/gesture, not with a mouse or keyboard.


                 • Multi–Touch: The ability to
                    recognize multiple points of
                    contact at the same time, not just
                    one (Ex. one finger, like with most
                    touch screens), but dozens.
• Multi–User: The Surface’s screen is horizontal,
   allowing many people to come together around it
   and experience a “collaborative , face–to–face
   computing experience”.



              • Object Recognition:
              Physical objects can be placed on the
              Surface’s screen to “trigger different
              types of digital responses” .
                    (Ex. cell phones, cameras,
                         & glasses of wine).
WHO’S USING SURFACE TODAY ?



        Financial Services
          Healthcare
          Leisure and
         Entertainment
             Retail
            Casino
        Hotels and Resorts
        Disney Innovations
             AT&T
            T-Mobile
MICROSOFT SURFACE PROBLEMS
• $$$$$$$ Surface machines very
  expensive, cost between $5,000 and $10,000.

•Not portable .

•Poor accuracy as fat fingers are not as accurate
as mouse or stylus.

•Objects need to be tagged (domino tags)


                      • Must own devices such as a cell phone to upload photos into
                         or share with others.

                      • Have to be careful of the table surface not to damage it.
CONCLUSION
o The study of surface gestures leading to a user-defined gesture set based on
   participants’ agreement over 1080 gestures.



  o Beyond reflecting user behavior, the user-defined set has properties that
     make it a good candidate for deployment in tabletop systems,

               such as
                     Ease of recognition
                     Consistency
                     Reversibility and versatility through aliasing.
o Also a taxonomy of surface gestures useful for analyzing and characterizing.

o This work represents a necessary step in bringing interactive surfaces closer
   to the hands and minds of tabletop users.


o Its not just a touch screen but more of a touch -grab-move-slide-resize-and-
   place-objects on top of the screen.

              o Surface takes existing technology and presents it in a new way.

                 o Fundamentally changes the way we interacts with technology.

                 o So it opens up new possibilities that weren’t there before.
“A COMPUTER ON EVERY DESKTOP “


           NOW WE SAY


“EVERY DESKTOP WILL BE A COMPUTER”



               THANK YOU…… 

Mais conteúdo relacionado

Mais procurados

The Coming Age of Empathic Computing
The Coming Age of Empathic ComputingThe Coming Age of Empathic Computing
The Coming Age of Empathic ComputingMark Billinghurst
 
Surface computer ppt
Surface computer pptSurface computer ppt
Surface computer ppttejalc
 
surface computer ppt
surface computer pptsurface computer ppt
surface computer pptkabego18audry
 
Hands and Speech in Space: Multimodal Input for Augmented Reality
Hands and Speech in Space: Multimodal Input for Augmented Reality Hands and Speech in Space: Multimodal Input for Augmented Reality
Hands and Speech in Space: Multimodal Input for Augmented Reality Mark Billinghurst
 
Surface Computing
Surface ComputingSurface Computing
Surface Computingshivu1234
 
RBI paper, CHI 2008
RBI paper, CHI 2008RBI paper, CHI 2008
RBI paper, CHI 2008guest0dd2a1
 
Surface computing
Surface computingSurface computing
Surface computingChandan Jha
 
COSC 426 Lect. 6: Collaborative AR
COSC 426 Lect. 6: Collaborative ARCOSC 426 Lect. 6: Collaborative AR
COSC 426 Lect. 6: Collaborative ARMark Billinghurst
 
Comp4010 Lecture9 VR Input and Systems
Comp4010 Lecture9 VR Input and SystemsComp4010 Lecture9 VR Input and Systems
Comp4010 Lecture9 VR Input and SystemsMark Billinghurst
 
UX Strategy for Any Device
UX Strategy for Any DeviceUX Strategy for Any Device
UX Strategy for Any DeviceDave Hogue
 
Microsoft Surface Report
Microsoft Surface ReportMicrosoft Surface Report
Microsoft Surface Reportpiyush khadse
 
426 lecture6b: AR Interaction
426 lecture6b: AR Interaction426 lecture6b: AR Interaction
426 lecture6b: AR InteractionMark Billinghurst
 

Mais procurados (20)

Surface computing
Surface computingSurface computing
Surface computing
 
Surface computer
Surface computerSurface computer
Surface computer
 
The Coming Age of Empathic Computing
The Coming Age of Empathic ComputingThe Coming Age of Empathic Computing
The Coming Age of Empathic Computing
 
Surface computer ppt
Surface computer pptSurface computer ppt
Surface computer ppt
 
Bally Sloane
Bally SloaneBally Sloane
Bally Sloane
 
surface computer ppt
surface computer pptsurface computer ppt
surface computer ppt
 
Hands and Speech in Space: Multimodal Input for Augmented Reality
Hands and Speech in Space: Multimodal Input for Augmented Reality Hands and Speech in Space: Multimodal Input for Augmented Reality
Hands and Speech in Space: Multimodal Input for Augmented Reality
 
Empathic Computing
Empathic ComputingEmpathic Computing
Empathic Computing
 
Surface Computing
Surface ComputingSurface Computing
Surface Computing
 
RBI paper, CHI 2008
RBI paper, CHI 2008RBI paper, CHI 2008
RBI paper, CHI 2008
 
Surface computer
Surface computerSurface computer
Surface computer
 
Surface computing
Surface computingSurface computing
Surface computing
 
Can You See What I See?
Can You See What I See?Can You See What I See?
Can You See What I See?
 
COSC 426 Lect. 6: Collaborative AR
COSC 426 Lect. 6: Collaborative ARCOSC 426 Lect. 6: Collaborative AR
COSC 426 Lect. 6: Collaborative AR
 
Comp4010 Lecture9 VR Input and Systems
Comp4010 Lecture9 VR Input and SystemsComp4010 Lecture9 VR Input and Systems
Comp4010 Lecture9 VR Input and Systems
 
UX Strategy for Any Device
UX Strategy for Any DeviceUX Strategy for Any Device
UX Strategy for Any Device
 
Surface Computing & Devices
Surface Computing & DevicesSurface Computing & Devices
Surface Computing & Devices
 
Microsoft surface
Microsoft surfaceMicrosoft surface
Microsoft surface
 
Microsoft Surface Report
Microsoft Surface ReportMicrosoft Surface Report
Microsoft Surface Report
 
426 lecture6b: AR Interaction
426 lecture6b: AR Interaction426 lecture6b: AR Interaction
426 lecture6b: AR Interaction
 

Semelhante a User defined gestures for surface computing

The artificiality of natural user interfaces alessio malizia
The artificiality of natural user interfaces   alessio maliziaThe artificiality of natural user interfaces   alessio malizia
The artificiality of natural user interfaces alessio maliziaMarco Ajovalasit
 
microsoft-surface-ppt From EnggRoom.ppt
microsoft-surface-ppt From EnggRoom.pptmicrosoft-surface-ppt From EnggRoom.ppt
microsoft-surface-ppt From EnggRoom.pptAnkush306222
 
microsoft-surface-ppt From EnggRoom.ppt
microsoft-surface-ppt From EnggRoom.pptmicrosoft-surface-ppt From EnggRoom.ppt
microsoft-surface-ppt From EnggRoom.pptBree79
 
Sixth sense technology_ppt1
Sixth sense technology_ppt1Sixth sense technology_ppt1
Sixth sense technology_ppt1Snigdha Roy
 
Multimodal Interaction: An Introduction
Multimodal Interaction: An IntroductionMultimodal Interaction: An Introduction
Multimodal Interaction: An IntroductionAbdallah El Ali
 
Sixth sense technology_ppt1
Sixth sense technology_ppt1Sixth sense technology_ppt1
Sixth sense technology_ppt1Jayant Mehta
 
T3con10_html5_kosack_zinner
T3con10_html5_kosack_zinnerT3con10_html5_kosack_zinner
T3con10_html5_kosack_zinnerRobert Zinner
 
Surface computing ppt
Surface computing pptSurface computing ppt
Surface computing pptJayati Tiwari
 
Microsoft surface .. sohan singh grover 9996402177
Microsoft surface .. sohan singh grover 9996402177Microsoft surface .. sohan singh grover 9996402177
Microsoft surface .. sohan singh grover 9996402177Sohan Grover
 
surface copmputer
surface copmputersurface copmputer
surface copmputerkondalarao7
 
An Overview of Interactive Surfaces: Applications, Sensors, and Dimensions
An Overview of Interactive Surfaces: Applications, Sensors, and DimensionsAn Overview of Interactive Surfaces: Applications, Sensors, and Dimensions
An Overview of Interactive Surfaces: Applications, Sensors, and Dimensionsgaup_geo
 
Touch Research 3: How Bodies Matter [Handouts]
Touch Research 3: How Bodies Matter [Handouts]Touch Research 3: How Bodies Matter [Handouts]
Touch Research 3: How Bodies Matter [Handouts]Harald Felgner, PhD
 

Semelhante a User defined gestures for surface computing (20)

The artificiality of natural user interfaces alessio malizia
The artificiality of natural user interfaces   alessio maliziaThe artificiality of natural user interfaces   alessio malizia
The artificiality of natural user interfaces alessio malizia
 
microsoft-surface-ppt From EnggRoom.ppt
microsoft-surface-ppt From EnggRoom.pptmicrosoft-surface-ppt From EnggRoom.ppt
microsoft-surface-ppt From EnggRoom.ppt
 
microsoft-surface-ppt From EnggRoom.ppt
microsoft-surface-ppt From EnggRoom.pptmicrosoft-surface-ppt From EnggRoom.ppt
microsoft-surface-ppt From EnggRoom.ppt
 
Surface Computing
Surface ComputingSurface Computing
Surface Computing
 
Sixth sense technology_ppt1
Sixth sense technology_ppt1Sixth sense technology_ppt1
Sixth sense technology_ppt1
 
Multimodal Interaction: An Introduction
Multimodal Interaction: An IntroductionMultimodal Interaction: An Introduction
Multimodal Interaction: An Introduction
 
Multi touch
Multi touchMulti touch
Multi touch
 
Sixth sense technology_ppt1
Sixth sense technology_ppt1Sixth sense technology_ppt1
Sixth sense technology_ppt1
 
SIXTH SENSE TECHNOLOGY
SIXTH SENSE TECHNOLOGYSIXTH SENSE TECHNOLOGY
SIXTH SENSE TECHNOLOGY
 
T3con10_html5_kosack_zinner
T3con10_html5_kosack_zinnerT3con10_html5_kosack_zinner
T3con10_html5_kosack_zinner
 
6th sence final
6th sence final6th sence final
6th sence final
 
Microsoft Surface Technology
Microsoft Surface TechnologyMicrosoft Surface Technology
Microsoft Surface Technology
 
surface computer
surface computersurface computer
surface computer
 
Surface computing ppt
Surface computing pptSurface computing ppt
Surface computing ppt
 
Microsoft surface .. sohan singh grover 9996402177
Microsoft surface .. sohan singh grover 9996402177Microsoft surface .. sohan singh grover 9996402177
Microsoft surface .. sohan singh grover 9996402177
 
surface copmputer
surface copmputersurface copmputer
surface copmputer
 
An Overview of Interactive Surfaces: Applications, Sensors, and Dimensions
An Overview of Interactive Surfaces: Applications, Sensors, and DimensionsAn Overview of Interactive Surfaces: Applications, Sensors, and Dimensions
An Overview of Interactive Surfaces: Applications, Sensors, and Dimensions
 
14 585
14 58514 585
14 585
 
Touch Research 3: How Bodies Matter [Handouts]
Touch Research 3: How Bodies Matter [Handouts]Touch Research 3: How Bodies Matter [Handouts]
Touch Research 3: How Bodies Matter [Handouts]
 
Surface Computing
Surface ComputingSurface Computing
Surface Computing
 

Último

9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5DianaGray10
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Alexander Turgeon
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 

Último (20)

9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024Valere | Digital Solutions & AI Transformation Portfolio | 2024
Valere | Digital Solutions & AI Transformation Portfolio | 2024
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 

User defined gestures for surface computing

  • 1. Presented By: SUMMIYA FARHEEN 8th Sem CSE
  • 3. INTRODUCTION What is a gesture ? Gestures are expressive , meaningful body motions with the intent to convey information or to interact with the environment. Body motions  physical movements of the fingers, hands, arms head, head, face or body. What is Surface computing ? It is a computer that interacts with the user through the surface of an ordinary object, rather than a keyboard or monitor. User interacts with touch sensitive screen. People use their fingers to manipulate it.
  • 4. A key challenge Traditional input using the keyboard, mouse, and mouse-based widgets is no longer preferable No keyboard used No mouse used Human-computer interaction have been exploring interactive TABLETOPS for use by individuals and groups, as part of multi-display environments, and for fun and entertainment.
  • 5. STRUCTURE OF TABLETOP History  This idea came up in 2001 by the Microsoft researchers “Steve bark son” & “ Andy Wilson”.  In 2003 they presented to bill gates for the approval.  Later in 2007 this interactive table top device was built. Tabletop Computer
  • 6. WORKING OF MICROSOFT SURFACE The Surface is not a touch-sensitive screen device… It uses multiple infrared cameras beneath the screen to sense objects, physical touch, etc. . This information is processed and displayed using “Rear Projection”. (1)Screen Diffuser :  ”Multi-touch" screen.  Can process multiple inputs and recognize objects by their shapes or coded "domino" tags.
  • 7. Cont.… (2) Infrared:  The ”Machine Vision" is aimed at the screen.  Once an object touches the tabletop ; the light reflects back and is picked up by infrared cameras. (3) CPU:  Uses similar components as current desktop computers, Core 2 Duo processor, 2GB of RAM and a 256MB graphics card, Wireless communication, Wi-Fi and Bluetooth antennas, Operating system. (4) Projector:  Uses a DLP (digital light processing) light engine.
  • 8. CLASSIFICATION OF HUMAN GESTURE “Microsoft Surface represents a fundamental change in the way we interact with digital content. With Surface, we can actually grab data with our hands, and move information between objects with natural gestures and touch.” 1. Efron  conducted studies of human gesture he categorized it into five categories – a) Physiographic b) Kinetographic c) Ideographic d) Deictic and e) Batons.
  • 9. 2. Kendon  Showed that gestures exist on a spectrum of formality and speech-dependency.  From least to most formal, the spectrum was: language-like gestures, emblems, and sign languages. 3. Tang  Analyzed people collaborating around a large drawing surface.  Gestures emerged as an important element for simulating operations, indicating areas of interest, and referring to other group members.  Tang noted actions and functions, i.e., behaviors and their effects, which are like the signs and referents in our guessability methodology.
  • 10. CLASSIFICATION OF SURFACE GESTURES  Three authors independently designed their own gestures for the 27 Referents.  Among those 27 referents Four were not assigned as gestures: Insert Maximize Task switch Close
  • 11. Instead  • Insert used by dragging • Maximize used by enlarging • Task switch by tapping an imaginary taskbar button. • Close by tapping an imaginary button in the top-right corner of an open view.  And they manually classified each gesture along four dimensions: 1. Form 2. Nature 3. Binding 4. Flow
  • 12. 1. Form: • The scope of this dimension is within one hand. • It is applied separately to each hand in a 2-hand gesture. • These are worth distinguishing because of their similarity to mouse actions. 2. Nature: • In the nature dimension, symbolic gestures are visual depictions. • Examples :  Tracing a caret (“^”) to perform insert, Or  Forming the O.K. pose on the table (“ ”) for accept.
  • 13. 3. Binding: • In this dimension, object-centric gestures only require information about the object they affect or produce. • An example is pinching two fingers together on top of an object for shrink. 4. Flow: • A gesture’s flow is discrete if the gesture is performed, delimited, recognized, and responded to as an event. • An example is tracing a question mark (“?”) to bring up help. .
  • 14.  Although the authors are experts in human computer interaction, it was hypothesized that the “wisdom of crowds” would generate a better set than the authors.  Each author individually came up with only 43.5% of the user-defined gestures.  Even combined, the authors only covered 60.9% of the users’ set.  This suggests that three experts cannot generate the scope of gestures that 20 participants can.
  • 15.  Later the authors asked 20 people to participate to find different gestures based on their ideas thinking it would make better gesture set.  Among those 20 participants some used 1-hand gestures and some used 2-hand gestures.  Totally they made 1080 gestures set . [27refrents X 20 participants X 2 = 1080]
  • 18. How is the Surface used ? • Wireless! Transfer pictures from camera to Surface and cell phone. “Drag and drop virtual content to physical objects.” • Digital interactive painting using paint brush • At a phone store. • At a restaurant. • Play games and use the Internet. • Jukebox! Browse music, make play lists. • Maps and Billboard for advertising
  • 19. FEATURES OF SURFACE COMPUTING A form of computing that offers “a natural way of interacting with information,” rather than traditional user interface: • Direct Interaction: The ability to "grab" digital information with hands - interacting with touch/gesture, not with a mouse or keyboard. • Multi–Touch: The ability to recognize multiple points of contact at the same time, not just one (Ex. one finger, like with most touch screens), but dozens.
  • 20. • Multi–User: The Surface’s screen is horizontal, allowing many people to come together around it and experience a “collaborative , face–to–face computing experience”. • Object Recognition: Physical objects can be placed on the Surface’s screen to “trigger different types of digital responses” . (Ex. cell phones, cameras, & glasses of wine).
  • 21. WHO’S USING SURFACE TODAY ? Financial Services Healthcare Leisure and Entertainment Retail Casino Hotels and Resorts Disney Innovations AT&T  T-Mobile
  • 22. MICROSOFT SURFACE PROBLEMS • $$$$$$$ Surface machines very expensive, cost between $5,000 and $10,000. •Not portable . •Poor accuracy as fat fingers are not as accurate as mouse or stylus. •Objects need to be tagged (domino tags) • Must own devices such as a cell phone to upload photos into or share with others. • Have to be careful of the table surface not to damage it.
  • 23. CONCLUSION o The study of surface gestures leading to a user-defined gesture set based on participants’ agreement over 1080 gestures. o Beyond reflecting user behavior, the user-defined set has properties that make it a good candidate for deployment in tabletop systems, such as  Ease of recognition  Consistency  Reversibility and versatility through aliasing.
  • 24. o Also a taxonomy of surface gestures useful for analyzing and characterizing. o This work represents a necessary step in bringing interactive surfaces closer to the hands and minds of tabletop users. o Its not just a touch screen but more of a touch -grab-move-slide-resize-and- place-objects on top of the screen. o Surface takes existing technology and presents it in a new way. o Fundamentally changes the way we interacts with technology. o So it opens up new possibilities that weren’t there before.
  • 25. “A COMPUTER ON EVERY DESKTOP “ NOW WE SAY “EVERY DESKTOP WILL BE A COMPUTER” THANK YOU…… 