SlideShare uma empresa Scribd logo
1 de 12
Baixar para ler offline
Eye Tracking for
Reading Detection Algorithm
‫חברת‬ ‫עם‬ ‫בשיתוף‬ ‫נעשה‬ ‫הפרויקט‬Intel.
Project Targets
Reading Detection
Line Detection
Experimental Data base
System Architecture
• Calibration- Running Points
• Experiment- Running App Full
With Texts
• Sampling & Recording
User’s Gaze Points Data
• Mapping Each Point Into 3
Dimensions
• Algo-
Reading
Detection
‫הבאים‬ ‫השלבים‬ ‫מתרחשים‬ ‫האפליקציה‬ ‫לריצת‬ ‫במקביל‬-
Challenges & Solutions
 C-App programing at C# for Windows Mobile platform.
 Eye Tracking System.
 Big Data Base.
 Algorithm-
• Developing an idea.
• Determine parameters.
• Bringing idea into real code.
Products
 Apps:
 Experimental App- app that contains a variety of texts and
pictures, simulating daily content and use.
 Tracking App- app that record user’s gaze points
by sampling the eye’s sight location in 30 [Hz].
Products- Algorithm
 Raw Data
 Step 1 –
Interpolation &
Averaging
2.4
2.45
2.5
2.55
2.6
2.65
2.7
x 10
5
0 200 400 600 800 1000 1200 1400
0
500
1000
time[msec]
X [pixels]
3D gaze points classification
Y[pixels]
2.4
2.45
2.5
2.55
2.6
2.65
2.7
x 10
5
0 200 400 600 800 1000 1200 1400
0
1000
2000
time[msec]
X [pixels]
3D gaze points classification
Y[pixels]
0 200 400 600 800 1000 1200 1400
0
200
400
600
800
1000
1200
X [pixels]
Y[pixels]
2D gaze points classification
0 200 400 600 800 1000 1200 1400
0
200
400
600
800
1000
1200
X [pixels]
Y[pixels]
2D gaze points classification
Products- Algorithm
Cases:
1. (dx & dy) < ReadingValue READING MODE
2. (dx > ReadingValue) & (dy < Reading value) LINE BREAK
 GraphicView –
0 200 400 600 800 1000 1200 1400
0
200
400
600
800
1000
1200
X [pixels]
Y[pixels]
2D gaze points classification
non reading points
line break points
reading pattern points
2.4
2.45
2.5
2.55
2.6
2.65
2.7
x 10
5
0 200 400 600 800 1000 1200 1400
0
1000
2000
time[msec]
X [pixels]
3D gaze points classification
Y[pixels]
non reading points
line break points
reading pattern points
Results
App’s first page,
containing 8 lines & title
1.2
1.22
1.24
1.26
1.28
1.3
1.32
1.34
1.36
1.38
1.4
x 10
5
0 200 400 600 800 1000 1200 1400
0
500
1000
time[msec]
X [pixels]
3D gaze points classification
Y[pixels]
1.2
1.22
1.24
1.26
1.28
1.3
1.32
1.34
1.36
1.38
1.4
x 10
5
0 200 400 600 800 1000 1200 1400
0
500
1000
time[msec]
X [pixels]
3D gaze points classification
Y[pixels]
non reading points
line break points
reading pattern points
Experiment
to raw data
Processing &
results
Results
Dx
Dy
80100120140
2516.5±4.914.25±3.611.2±3.27.9±2.7
3516.8±4.814.6±3.711.5±3.458.3±2.9
4517±514.7±3.811.6±3.78.5±3.1
5517.4±5.115±3.811.8±3.78.6±3.1
Page 13 in
the app,
text in
english.
Contain 13
lines (no
title).
Results
Dx
Dy
80100120140
2526.1±6.5
(26.6±9.7)
22±5.5
(22±7.3)
18.2±4.6
(18.2±6.1)
14.9±4.7
(14.8±5.6)
3526.7±7.1
(27.2±10)
22.5±5.6
(22.5±7.5)
19±4.5
(18.9±6)
15.7±4.6
(15.6±5.5)
4527±7
(27.6±10.6)
22.9±5.7
(23±7.9)
19.3±4.4
(19.4±6.3)
16.1±4.5
(16±5.6)
5527.5±6.9
(11.528.3±)
23.3±5.6
(23.5±8.35)
19.8±4.4
(19.9±6.7)
16.4±4.4
(16.4±6.1)
Page 7 in the
app, text in
hebrew.
Contain 19
lines & title
Comparison
Figure 1. pooled evidence algorithm by IBM Almaden Rsearch Center,
San Jose, USA.
Figure 2. our algorithm
Future Work
 Enhance Accuracy.
 Real-Time.
 Line detection.

Mais conteúdo relacionado

Destaque

Driver fatigue detection system
Driver fatigue detection systemDriver fatigue detection system
Driver fatigue detection systemYASH TILVA
 
EYE BLINK SENSOR TO CONTROL ACCIDENTPpt main
EYE BLINK SENSOR TO CONTROL ACCIDENTPpt mainEYE BLINK SENSOR TO CONTROL ACCIDENTPpt main
EYE BLINK SENSOR TO CONTROL ACCIDENTPpt mainGourav Srivastava
 
Accident prevention using bluetooth tech and eye blink sensor
Accident prevention using bluetooth tech and eye blink sensorAccident prevention using bluetooth tech and eye blink sensor
Accident prevention using bluetooth tech and eye blink sensorAntony Ignesh
 
Car speed control using bluetooth
Car speed control using bluetoothCar speed control using bluetooth
Car speed control using bluetoothNagendra Reddy
 
Vechicle accident prevention using eye bilnk sensor ppt
Vechicle accident prevention using eye bilnk sensor pptVechicle accident prevention using eye bilnk sensor ppt
Vechicle accident prevention using eye bilnk sensor pptsatish 486
 
LPC 2148 ARM MICROCONTROLLER
LPC 2148 ARM MICROCONTROLLERLPC 2148 ARM MICROCONTROLLER
LPC 2148 ARM MICROCONTROLLERsravannunna24
 
ACCIDENT DETECTION AND VEHICLE TRACKING USING GPS,GSM AND MEMS
ACCIDENT DETECTION AND VEHICLE TRACKING USING GPS,GSM AND MEMSACCIDENT DETECTION AND VEHICLE TRACKING USING GPS,GSM AND MEMS
ACCIDENT DETECTION AND VEHICLE TRACKING USING GPS,GSM AND MEMSKrishna Moparthi
 
Automatic vehicle accident detection and messaging system using gsm and gps m...
Automatic vehicle accident detection and messaging system using gsm and gps m...Automatic vehicle accident detection and messaging system using gsm and gps m...
Automatic vehicle accident detection and messaging system using gsm and gps m...mahesh_rman
 

Destaque (9)

Driver fatigue detection system
Driver fatigue detection systemDriver fatigue detection system
Driver fatigue detection system
 
EYE BLINK SENSOR TO CONTROL ACCIDENTPpt main
EYE BLINK SENSOR TO CONTROL ACCIDENTPpt mainEYE BLINK SENSOR TO CONTROL ACCIDENTPpt main
EYE BLINK SENSOR TO CONTROL ACCIDENTPpt main
 
Accident prevention using bluetooth tech and eye blink sensor
Accident prevention using bluetooth tech and eye blink sensorAccident prevention using bluetooth tech and eye blink sensor
Accident prevention using bluetooth tech and eye blink sensor
 
Car speed control using bluetooth
Car speed control using bluetoothCar speed control using bluetooth
Car speed control using bluetooth
 
Vechicle accident prevention using eye bilnk sensor ppt
Vechicle accident prevention using eye bilnk sensor pptVechicle accident prevention using eye bilnk sensor ppt
Vechicle accident prevention using eye bilnk sensor ppt
 
LPC 2148 ARM MICROCONTROLLER
LPC 2148 ARM MICROCONTROLLERLPC 2148 ARM MICROCONTROLLER
LPC 2148 ARM MICROCONTROLLER
 
Eye gaze communication
Eye gaze communicationEye gaze communication
Eye gaze communication
 
ACCIDENT DETECTION AND VEHICLE TRACKING USING GPS,GSM AND MEMS
ACCIDENT DETECTION AND VEHICLE TRACKING USING GPS,GSM AND MEMSACCIDENT DETECTION AND VEHICLE TRACKING USING GPS,GSM AND MEMS
ACCIDENT DETECTION AND VEHICLE TRACKING USING GPS,GSM AND MEMS
 
Automatic vehicle accident detection and messaging system using gsm and gps m...
Automatic vehicle accident detection and messaging system using gsm and gps m...Automatic vehicle accident detection and messaging system using gsm and gps m...
Automatic vehicle accident detection and messaging system using gsm and gps m...
 

Semelhante a מצגת הגנה

[Tutorial] building machine learning models for predictive maintenance applic...
[Tutorial] building machine learning models for predictive maintenance applic...[Tutorial] building machine learning models for predictive maintenance applic...
[Tutorial] building machine learning models for predictive maintenance applic...PAPIs.io
 
IRJET- Designing of OCR Tool Box for Decoding Vehicle Number Plate using MATLAB
IRJET- Designing of OCR Tool Box for Decoding Vehicle Number Plate using MATLABIRJET- Designing of OCR Tool Box for Decoding Vehicle Number Plate using MATLAB
IRJET- Designing of OCR Tool Box for Decoding Vehicle Number Plate using MATLABIRJET Journal
 
Rapid object detection using boosted cascade of simple features
Rapid object detection using boosted  cascade of simple featuresRapid object detection using boosted  cascade of simple features
Rapid object detection using boosted cascade of simple featuresHirantha Pradeep
 
Bl32821831
Bl32821831Bl32821831
Bl32821831IJMER
 
APPLICATIONS OF MACHINE VISION
APPLICATIONS OF MACHINE VISIONAPPLICATIONS OF MACHINE VISION
APPLICATIONS OF MACHINE VISIONanil badiger
 
3D Image visualization
3D Image visualization3D Image visualization
3D Image visualizationalok ray
 
IRJET- Full Body Motion Detection and Surveillance System Application
IRJET-  	  Full Body Motion Detection and Surveillance System ApplicationIRJET-  	  Full Body Motion Detection and Surveillance System Application
IRJET- Full Body Motion Detection and Surveillance System ApplicationIRJET Journal
 
Security by user through application to lock/unlock machine by face detection
Security by user through application to lock/unlock machine by face detectionSecurity by user through application to lock/unlock machine by face detection
Security by user through application to lock/unlock machine by face detectionIRJET Journal
 
3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor P...
3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor P...3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor P...
3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor P...ijcga
 
ANISH_and_DR.DANIEL_VRINCEANU_Presentation
ANISH_and_DR.DANIEL_VRINCEANU_PresentationANISH_and_DR.DANIEL_VRINCEANU_Presentation
ANISH_and_DR.DANIEL_VRINCEANU_PresentationAnish Patel
 
Real Time & Automated Meter Reading using Image Processing Reducing Human Error
Real Time & Automated Meter Reading using Image Processing Reducing Human ErrorReal Time & Automated Meter Reading using Image Processing Reducing Human Error
Real Time & Automated Meter Reading using Image Processing Reducing Human ErrorIRJET Journal
 
Questions On The Equation For Regression
Questions On The Equation For RegressionQuestions On The Equation For Regression
Questions On The Equation For RegressionTiffany Sandoval
 
IRJET- Image based Approach for Indian Fake Note Detection by Dark Channe...
IRJET-  	  Image based Approach for Indian Fake Note Detection by Dark Channe...IRJET-  	  Image based Approach for Indian Fake Note Detection by Dark Channe...
IRJET- Image based Approach for Indian Fake Note Detection by Dark Channe...IRJET Journal
 
IRJET - Visual Enhancement of E-Commerce Products
IRJET -  	  Visual Enhancement of E-Commerce ProductsIRJET -  	  Visual Enhancement of E-Commerce Products
IRJET - Visual Enhancement of E-Commerce ProductsIRJET Journal
 
Detection of a user-defined object in an image using feature extraction- Trai...
Detection of a user-defined object in an image using feature extraction- Trai...Detection of a user-defined object in an image using feature extraction- Trai...
Detection of a user-defined object in an image using feature extraction- Trai...IRJET Journal
 
IRJET- Proposed Approach for Layout & Handwritten Character Recognization in OCR
IRJET- Proposed Approach for Layout & Handwritten Character Recognization in OCRIRJET- Proposed Approach for Layout & Handwritten Character Recognization in OCR
IRJET- Proposed Approach for Layout & Handwritten Character Recognization in OCRIRJET Journal
 

Semelhante a מצגת הגנה (20)

[Tutorial] building machine learning models for predictive maintenance applic...
[Tutorial] building machine learning models for predictive maintenance applic...[Tutorial] building machine learning models for predictive maintenance applic...
[Tutorial] building machine learning models for predictive maintenance applic...
 
IRJET- Designing of OCR Tool Box for Decoding Vehicle Number Plate using MATLAB
IRJET- Designing of OCR Tool Box for Decoding Vehicle Number Plate using MATLABIRJET- Designing of OCR Tool Box for Decoding Vehicle Number Plate using MATLAB
IRJET- Designing of OCR Tool Box for Decoding Vehicle Number Plate using MATLAB
 
OpenCV+Android.pptx
OpenCV+Android.pptxOpenCV+Android.pptx
OpenCV+Android.pptx
 
Rapid object detection using boosted cascade of simple features
Rapid object detection using boosted  cascade of simple featuresRapid object detection using boosted  cascade of simple features
Rapid object detection using boosted cascade of simple features
 
Bl32821831
Bl32821831Bl32821831
Bl32821831
 
APPLICATIONS OF MACHINE VISION
APPLICATIONS OF MACHINE VISIONAPPLICATIONS OF MACHINE VISION
APPLICATIONS OF MACHINE VISION
 
3D Image visualization
3D Image visualization3D Image visualization
3D Image visualization
 
Choudhary2015
Choudhary2015Choudhary2015
Choudhary2015
 
IRJET- Full Body Motion Detection and Surveillance System Application
IRJET-  	  Full Body Motion Detection and Surveillance System ApplicationIRJET-  	  Full Body Motion Detection and Surveillance System Application
IRJET- Full Body Motion Detection and Surveillance System Application
 
Security by user through application to lock/unlock machine by face detection
Security by user through application to lock/unlock machine by face detectionSecurity by user through application to lock/unlock machine by face detection
Security by user through application to lock/unlock machine by face detection
 
3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor P...
3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor P...3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor P...
3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor P...
 
ANISH_and_DR.DANIEL_VRINCEANU_Presentation
ANISH_and_DR.DANIEL_VRINCEANU_PresentationANISH_and_DR.DANIEL_VRINCEANU_Presentation
ANISH_and_DR.DANIEL_VRINCEANU_Presentation
 
Real Time & Automated Meter Reading using Image Processing Reducing Human Error
Real Time & Automated Meter Reading using Image Processing Reducing Human ErrorReal Time & Automated Meter Reading using Image Processing Reducing Human Error
Real Time & Automated Meter Reading using Image Processing Reducing Human Error
 
Questions On The Equation For Regression
Questions On The Equation For RegressionQuestions On The Equation For Regression
Questions On The Equation For Regression
 
IRJET- Image based Approach for Indian Fake Note Detection by Dark Channe...
IRJET-  	  Image based Approach for Indian Fake Note Detection by Dark Channe...IRJET-  	  Image based Approach for Indian Fake Note Detection by Dark Channe...
IRJET- Image based Approach for Indian Fake Note Detection by Dark Channe...
 
IRJET - Visual Enhancement of E-Commerce Products
IRJET -  	  Visual Enhancement of E-Commerce ProductsIRJET -  	  Visual Enhancement of E-Commerce Products
IRJET - Visual Enhancement of E-Commerce Products
 
Applications3d Geomagic
Applications3d GeomagicApplications3d Geomagic
Applications3d Geomagic
 
OCR2
OCR2OCR2
OCR2
 
Detection of a user-defined object in an image using feature extraction- Trai...
Detection of a user-defined object in an image using feature extraction- Trai...Detection of a user-defined object in an image using feature extraction- Trai...
Detection of a user-defined object in an image using feature extraction- Trai...
 
IRJET- Proposed Approach for Layout & Handwritten Character Recognization in OCR
IRJET- Proposed Approach for Layout & Handwritten Character Recognization in OCRIRJET- Proposed Approach for Layout & Handwritten Character Recognization in OCR
IRJET- Proposed Approach for Layout & Handwritten Character Recognization in OCR
 

מצגת הגנה