Leap Motion is an American company that manufactures and markets a computer hardware sensor device that supports hand and finger motions as input, analogous to a mouse, but requires no hand contact or touching.

1. LEAP MOTION
By Sandeep

2. INTRODUCTION
Welcome
The Leap Motion controller is a
small device that can be connected
to a computer using a USB.
This research is part of a larger research project called Seek and Sign.
The Seek and Sign project explores the use of technology in supporting
young Deaf and hard of hearing children while learning sign language,
and specifically Auslan (Australian Sign Language) (Potter et al. 2012).
The aim is produce efficient, affordable technology applications that can
be easily accessed by the families of these children.
Leap Motion is founded by Michael Buckwald & David Holtz in 2010 at
San Francisco.

3. GESTURE
RECOGNITION
AND SIGN LANGUAGE
Gesture recognition is concerned with identifying human
gestures using technology. This is an established research area
with a broad background and many gesture recognition systems
have been developed.
Kinect
Motion sensing input device by Microsoft
Launched in 2010
Helps users interact with the Xbox 360 without touching
Traditional gesture recognition involves algorithms in conjunction with technology, and several applications of
this have been developed for signing. Vamplew and Adams (1998) developed the SLARTI (Sign Language
Recognition) system using neural networks with gesture recognition for Auslan.
5

4. How does the Leap
Motion controller
work?
Hardware
It has 2 IR cameras and 3 IR LEDs that sense the movement of
your hands above the sensor.
The accuracy with which the sensor tracks your hands is very good but the main limitation is you will have to
hold your hand over the sensor in the coverage area. As with any hardware, the strength of this technology is
going to be in the apps and there are no groundbreaking apps yet.

5. Interaction Area
2 feet above the controller, by 2 feet wide on
each side (150º angle), by 2 feet deep on each
side (120º angle)
the device's USB controller reads the sensor data
in its local memory and makes any necessary
resolution adjustments. This data is streamed on
Leap Motion tracking software via USB.
The data takes the form of grayscale stereo image
of the individual infrared light spectrum in the left
and right cameras. Generally, you will see only
those items which are published directly by the
Lead Motion Controller's LEDs.
Software
The Leap Motion Service is the software on your computer that processes the images. After compensating for
background objects (such as heads) and ambient environmental lighting, the images are analyzed to reconstruct
a 3D representation of what the device sees.

6. VR Developer Setup
Leap Monitor
Control (Desktop)
Oculus Rift
Oculus Rift Desktop
HTC Vive
Remove The Sticker from
top of controller
Use the USB cable included
in the box. The shiny side of
the controller faces up and
the green light faces
towards you.
Setup
VR Setup

7. LEAP MOTION
TECHNOLOGY
The Leap Motion controller is a sensor device that aims to
translate hand movements into computer commands. The
controller itself is an eight by three centimeter unit that plugs
into the USB on a computer. Placed face up on a surface, the
controller senses the area above it and is sensitive to a range
of approximately one meter.

8. A LEAP MOTION
EXPLORATION
This paper presents an initial study exploring the
functionality of the Leap Motion controller with a
focus on its suitability for use with Auslan. A Leap
Motion controller was used by two members of the
research team in conjunction with a laptop and the
Leap Motion software development kit.

9. THE WEAKNESSES OF THE LEAP
MOTION CONTROLLER
The Leap Motion controller has difficulty maintaining accuracy and fidelity of detection when the hands do not
have direct line of sight with the controller. In practice this means that during detection, if a hand is rotated from
a position of palm parallel to the flat surface of the controller

10. The Leap Motion right-handed coordinate system
• The Leap Motion API measures physical quantities with the following units:
• Distance: millimeters
• Time: microseconds (unless otherwise noted)
• Speed: millimeters/second
• Angle: radians

11. Inferencing (detection
limitations)
In an attempt to overcome the
device's limitations particularly in
regards to hand rotation and digits
touching, it may be possible to infer
the location of fingers, fingertips and
movements in periods where we are
able to assume the fingers are still
present but the controller is failing
to detect them.
Artificial Neural Network
Training
Using an Artificial Neural Network
with the controller to recognize
Auslan symbols is possible provided
that each symbol is trained before
use and attempted recognition.
Based on the evaluation testing of
the Leap Motion controller, it
appears that while the device has
potential, the API supporting the
device is not yet ready to interpret
the full range of sign language.
FUTURE POSSIBILITIES

12. For VR use, the minimum system requirements are as follows:
NVIDIA GTX 970 / AMD R9 290 equivalent or greater
Intel i5-4590 equivalent or greater
8GB+ RAM
Compatible HDMI 1.3 video output
2x USB 3.0 ports
Windows 7 SP1 or newer
2 GB RAM
USB 2.0 port
Windows® 7 above
Mac® OS X 10.7 above
AMD Phenom™ II or
Intel® Core™ i3/i5/i7
processor
Internet connection
12
What are the system requirements?

13. Advantages and Disadvantages
Advantages
Portable.
Leap is more accurate, cheaper and high
resolution.
Affordable and Inexpensive.
Most easiest method in computer
interaction.
In further it may develop in Robotic areas
and also in Business fields.
Plug and play via USB.
Disadvantages
Specific h/w and special programs required
to obtain and process the data.
The real life performance may not translate
on to the computer model as expected.
Limited number of apps available in
airspace.
Cost of the app.
Not able to perform well on all light
conditions.

14. Thank You
14