SlideShare uma empresa Scribd logo
1 de 30
Autonomous Quadcopter
Navigation
Group: Waka Waka
H. Kidane, I. Sadek, M. Elawady
Supervisor: Prof. Y. Petillot
1B31XP Robotics Project
Agenda
• Overview
• Related Work
• Control Processing
• Vision Processing
• Future Work
B31XP Robotics Project 2
Agenda
• Overview
• Related Work
• Control Processing
• Vision Processing
• Future Work
B31XP Robotics Project 3
Overview
B31XP Robotics Project 4
Problem Definition
Detecting and avoiding frontal obstacles using quad-rotor Ar.drone 2
Overview
B31XP Robotics Project 5
Indoor 420g
HD Camera 720P 30FPS
Outdoor 320g
Ultrasound Sensor
Very Light and High Resistance Plastic
Specific Propeller
What is Ar.Drone?
Agenda
• Overview
• Related Work
• Control Processing
• Vision Processing
• Future Work
B31XP Robotics Project 6
Related Work I
B31XP Robotics Project 7
Blob Based Obstacle Avoidance
Algorithm
• Assuming the floor as only one pattern or one color.
• The blob repressing the floor is the largest blob.
• Each image pixel is classified as an obstacle or the ground
based on its color appearance.
Limitation
For AUV the floor is neither the largest blub nor mono-color .
Related Work I
B31XP Robotics Project 8
Related Work II
B31XP Robotics Project 9
Single Image Perspective Cue
Algorithm
• Use the Canny edge detector and apply a probabilistic Hough
Transform to find long lines.
• In a corridor environment, the long lines converge towards a
vanishing point at the end of the corridor.
Limitation
Distinct and confined environments should be provided.
Related Work II
B31XP Robotics Project 10
Related Work III
B31XP Robotics Project 11
Stereo Vision
Limitation
Require at least two cameras, and the robot has only one eye!
Monocular Stereo Vision
Limitation
In our task, robot is moving forward!
Algorithm
Assuming Static environment (two frames considered as two
different cameras).
Related Work IV
B31XP Robotics Project 12
Optical Flow
Algorithm
• Optical flow is an algorithm to tell the direction and magnitude change of
the intensity from successive images.
• Points closer to the camera move more quickly across the image plane.
Agenda
• Overview
• Related Work
• Control Processing
• Vision Processing
• Future Work
B31XP Robotics Project 13
Control Processing
B31XP Robotics Project 14
Flow Diagram
Control Processing
B31XP Robotics Project 15
6 DOF
Control Processing
B31XP Robotics Project 16
Ros Driver
• "ardrone_autonomy" :ROS driver for Parrot AR-
Drone quadrocopter
• AR-Drone update frequency at 200Hz
• Driver operates in two modes:
• real-time : publish information instantly
• fixed rate: publish data at a fixed rate
Control Processing
B31XP Robotics Project 17
Sending Control Command
• Publishing an Empty ROS messages to the ff
topics to takeoff/land and rest
– ardrone/takeoff
– ardrone/land
– ardrone/reset
Control Processing
B31XP Robotics Project 18
Sending Control Command
• Publish a message of type geometry_msgs::Twist
to velocity command topic
Control Processing
B31XP Robotics Project 19
Obstacle Avoidance Control
Algorithm
1. Fly in the x-direction
straight.
2. Fly sideways when the
obstacle is found in the
field of view.
Agenda
• Overview
• Related Work
• Control Processing
• Vision Processing
• Future Work
B31XP Robotics Project 20
Vision Processing
B31XP Robotics Project 21
Flowchart
Extract
Features
Current
Image
Filter
Features
Find
Obstacles
Select
Nearest
Obstacle
Estimate Position &
Orientation of
Selected Obstacle
Publish
Flight
Command
Previous
Image
Vision Processing
B31XP Robotics Project 22
Results - Input
After K
frames
Frame X
Frame X+K
Vision Processing
B31XP Robotics Project 23
Results – SURF I
After K
frames
Frame X
Frame X+K
Tomoyuki Mori and Sebastian Scherer, "First Results in
Detecting and Avoiding Frontal Obstacles from a Monocular
Camera for Micro Unmanned Aerial Vehicles," International
Conference on Robotics and Automation, May, 2013
Vision Processing
B31XP Robotics Project 24
Results – SURF II
Matching
Result
Filtered Matching
Result
Tomoyuki Mori and Sebastian Scherer, "First Results in
Detecting and Avoiding Frontal Obstacles from a Monocular
Camera for Micro Unmanned Aerial Vehicles," International
Conference on Robotics and Automation, May, 2013
Vision Processing
B31XP Robotics Project 25
Results – Optical Flow (Sparse)
Features of
1st Frame
Matching
Result
Vision Processing
B31XP Robotics Project 26
Results – Optical Flow (Dense)
Features of
1st Frame
Matching
Result
Qiyuan Qiu, "Reconnaissance Drone," ECE and ME Spring
Senior Design Show and ECE Senior Honors Show, 2013
Vision Processing
B31XP Robotics Project 27
Problems
• Computation time of feature matching -> GPU
processing (CUDA) in ROS!!
• Lack of important features -> Color-based
segmentation for tree trunks
• Background Noise -> Outdoor pre-processing
step (denoising, contrast correction)
• No advantage of using color images ->
Selection of suitable color space
Agenda
• Overview
• Related Work
• Control Processing
• Vision Processing
• Future Work
B31XP Robotics Project 28
Future Work
B31XP Robotics Project 29
B31XP Robotics Project 30

Mais conteúdo relacionado

Destaque

Intern Project- Robotics
Intern Project- RoboticsIntern Project- Robotics
Intern Project- Robotics
Anna Miller
 
Robotic Project
Robotic ProjectRobotic Project
Robotic Project
100640087
 
Quadcopter
QuadcopterQuadcopter
Quadcopter
Ritesh Raj
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentation
lpaviglianiti
 

Destaque (20)

QUADCOPTER
QUADCOPTERQUADCOPTER
QUADCOPTER
 
Quadcopter
QuadcopterQuadcopter
Quadcopter
 
Intern Project- Robotics
Intern Project- RoboticsIntern Project- Robotics
Intern Project- Robotics
 
Quadcopter Technology
Quadcopter TechnologyQuadcopter Technology
Quadcopter Technology
 
Quadcopter
QuadcopterQuadcopter
Quadcopter
 
Robotic Project
Robotic ProjectRobotic Project
Robotic Project
 
Embedded Programming for Quadcopters
Embedded Programming for QuadcoptersEmbedded Programming for Quadcopters
Embedded Programming for Quadcopters
 
Quadcopter
QuadcopterQuadcopter
Quadcopter
 
Synopsis of a Drone ( Quadcopter )
Synopsis of a Drone ( Quadcopter )Synopsis of a Drone ( Quadcopter )
Synopsis of a Drone ( Quadcopter )
 
Quadcopter Talk (Abstractions)
Quadcopter Talk (Abstractions)Quadcopter Talk (Abstractions)
Quadcopter Talk (Abstractions)
 
App Inventor: Ejercicio 2
App Inventor: Ejercicio 2App Inventor: Ejercicio 2
App Inventor: Ejercicio 2
 
Quadcopter designing
Quadcopter designingQuadcopter designing
Quadcopter designing
 
Construction of Quadcopter
Construction of QuadcopterConstruction of Quadcopter
Construction of Quadcopter
 
Quadcopter final report anand
Quadcopter final report anandQuadcopter final report anand
Quadcopter final report anand
 
Artificial Intelligence and Robotics
Artificial Intelligence and RoboticsArtificial Intelligence and Robotics
Artificial Intelligence and Robotics
 
QUAD COPTERS FULL PPT
QUAD COPTERS FULL PPTQUAD COPTERS FULL PPT
QUAD COPTERS FULL PPT
 
thesis-2
thesis-2thesis-2
thesis-2
 
Drone (Quadcopter) full project report by Er. ASHWANI DIXIT
Drone (Quadcopter) full project report by    Er. ASHWANI DIXITDrone (Quadcopter) full project report by    Er. ASHWANI DIXIT
Drone (Quadcopter) full project report by Er. ASHWANI DIXIT
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentation
 
Robotics & Artificial Intelligence
Robotics &  Artificial  IntelligenceRobotics &  Artificial  Intelligence
Robotics & Artificial Intelligence
 

Semelhante a (Progress Presentation) Autonomous Quadcopter Navigation

Sem 2 Presentation
Sem 2 PresentationSem 2 Presentation
Sem 2 Presentation
Shalom Cohen
 
Presentation Object Recognition And Tracking Project
Presentation Object Recognition And Tracking ProjectPresentation Object Recognition And Tracking Project
Presentation Object Recognition And Tracking Project
Prathamesh Joshi
 
라이브드론맵 (Live Drone Map) - 실시간 드론 매핑 솔루션
라이브드론맵 (Live Drone Map) - 실시간 드론 매핑 솔루션라이브드론맵 (Live Drone Map) - 실시간 드론 매핑 솔루션
라이브드론맵 (Live Drone Map) - 실시간 드론 매핑 솔루션
Impyeong Lee
 

Semelhante a (Progress Presentation) Autonomous Quadcopter Navigation (20)

Detecting and Avoiding Frontal Obstacles from a Monocular Camera for Micro Un...
Detecting and Avoiding Frontal Obstacles from a Monocular Camera for Micro Un...Detecting and Avoiding Frontal Obstacles from a Monocular Camera for Micro Un...
Detecting and Avoiding Frontal Obstacles from a Monocular Camera for Micro Un...
 
(Reading Group) First Results in Detecting and Avoiding Frontal Obstacles fro...
(Reading Group) First Results in Detecting and Avoiding Frontal Obstacles fro...(Reading Group) First Results in Detecting and Avoiding Frontal Obstacles fro...
(Reading Group) First Results in Detecting and Avoiding Frontal Obstacles fro...
 
Luigy Bertaglia Bortolo - Poster Final
Luigy Bertaglia Bortolo - Poster FinalLuigy Bertaglia Bortolo - Poster Final
Luigy Bertaglia Bortolo - Poster Final
 
Sem 2 Presentation
Sem 2 PresentationSem 2 Presentation
Sem 2 Presentation
 
Transformer in Vision
Transformer in VisionTransformer in Vision
Transformer in Vision
 
fyp presentation of group 43011 final.pptx
fyp presentation of group 43011 final.pptxfyp presentation of group 43011 final.pptx
fyp presentation of group 43011 final.pptx
 
SIMULTANEOUS MAPPING AND NAVIGATION FOR RENDEZVOUS IN SPACE APPLICATIONS
 SIMULTANEOUS MAPPING AND NAVIGATION FOR RENDEZVOUS IN SPACE APPLICATIONS  SIMULTANEOUS MAPPING AND NAVIGATION FOR RENDEZVOUS IN SPACE APPLICATIONS
SIMULTANEOUS MAPPING AND NAVIGATION FOR RENDEZVOUS IN SPACE APPLICATIONS
 
Pandora Robotics Team - 2007 to 2015 - ECE, AUTH
Pandora Robotics Team - 2007 to 2015 - ECE, AUTHPandora Robotics Team - 2007 to 2015 - ECE, AUTH
Pandora Robotics Team - 2007 to 2015 - ECE, AUTH
 
Deep learning based object detection
Deep learning based object detectionDeep learning based object detection
Deep learning based object detection
 
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...
 
Presentation Object Recognition And Tracking Project
Presentation Object Recognition And Tracking ProjectPresentation Object Recognition And Tracking Project
Presentation Object Recognition And Tracking Project
 
Ics2311 l01 display technologies & interactive devices
Ics2311 l01 display technologies & interactive devicesIcs2311 l01 display technologies & interactive devices
Ics2311 l01 display technologies & interactive devices
 
Report
ReportReport
Report
 
A-13 Iomp-1.pptx
A-13 Iomp-1.pptxA-13 Iomp-1.pptx
A-13 Iomp-1.pptx
 
라이브드론맵 (Live Drone Map) - 실시간 드론 매핑 솔루션
라이브드론맵 (Live Drone Map) - 실시간 드론 매핑 솔루션라이브드론맵 (Live Drone Map) - 실시간 드론 매핑 솔루션
라이브드론맵 (Live Drone Map) - 실시간 드론 매핑 솔루션
 
Vision Based Autonomous Mobile Robot Navigation
Vision Based Autonomous Mobile Robot NavigationVision Based Autonomous Mobile Robot Navigation
Vision Based Autonomous Mobile Robot Navigation
 
Deep Learning Hardware: Past, Present, & Future
Deep Learning Hardware: Past, Present, & FutureDeep Learning Hardware: Past, Present, & Future
Deep Learning Hardware: Past, Present, & Future
 
jai krishna.ppt.pptx
jai krishna.ppt.pptxjai krishna.ppt.pptx
jai krishna.ppt.pptx
 
Calibration Issues in FRC: Camera, Projector, Kinematics based Hybrid Approac...
Calibration Issues in FRC: Camera, Projector, Kinematics based Hybrid Approac...Calibration Issues in FRC: Camera, Projector, Kinematics based Hybrid Approac...
Calibration Issues in FRC: Camera, Projector, Kinematics based Hybrid Approac...
 
CV_Chap 6 Motion Representation
CV_Chap 6 Motion RepresentationCV_Chap 6 Motion Representation
CV_Chap 6 Motion Representation
 

Mais de Mohamed Elawady

Mais de Mohamed Elawady (18)

You and Your Research -- LLMs Perspective
You and Your Research -- LLMs PerspectiveYou and Your Research -- LLMs Perspective
You and Your Research -- LLMs Perspective
 
Robotics Vision in Industry: Indonesia
Robotics Vision in Industry: IndonesiaRobotics Vision in Industry: Indonesia
Robotics Vision in Industry: Indonesia
 
Wavelet-based Reflection Symmetry Detection via Textural and Color Histograms
Wavelet-based Reflection Symmetry Detection via Textural and Color HistogramsWavelet-based Reflection Symmetry Detection via Textural and Color Histograms
Wavelet-based Reflection Symmetry Detection via Textural and Color Histograms
 
Multiple Reflection Symmetry Detection via Linear-Directional Kernel Density ...
Multiple Reflection Symmetry Detection via Linear-Directional Kernel Density ...Multiple Reflection Symmetry Detection via Linear-Directional Kernel Density ...
Multiple Reflection Symmetry Detection via Linear-Directional Kernel Density ...
 
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...
 
Global Bilateral Symmetry Detection Using Multiscale Mirror Histograms
Global Bilateral Symmetry Detection Using Multiscale Mirror HistogramsGlobal Bilateral Symmetry Detection Using Multiscale Mirror Histograms
Global Bilateral Symmetry Detection Using Multiscale Mirror Histograms
 
Exploring Global Reflection Symmetry in Visual Arts
Exploring Global Reflection Symmetry in Visual ArtsExploring Global Reflection Symmetry in Visual Arts
Exploring Global Reflection Symmetry in Visual Arts
 
Underwater sparse image classification using deep convolutional neural networks
Underwater sparse image classification using deep convolutional neural networksUnderwater sparse image classification using deep convolutional neural networks
Underwater sparse image classification using deep convolutional neural networks
 
Robust principal axes determination for point-based shapes
Robust principal axes determination for point-based shapesRobust principal axes determination for point-based shapes
Robust principal axes determination for point-based shapes
 
Leafsnap: classification
Leafsnap: classificationLeafsnap: classification
Leafsnap: classification
 
Breast Lesion Segmentation in Ultrasound Images
Breast Lesion Segmentation in Ultrasound ImagesBreast Lesion Segmentation in Ultrasound Images
Breast Lesion Segmentation in Ultrasound Images
 
(Local Culture - Catalan) Info about Egypt
(Local Culture - Catalan) Info about Egypt(Local Culture - Catalan) Info about Egypt
(Local Culture - Catalan) Info about Egypt
 
(Msc Thesis) Sparse Coral Classification Using Deep Convolutional Neural Netw...
(Msc Thesis) Sparse Coral Classification Using Deep Convolutional Neural Netw...(Msc Thesis) Sparse Coral Classification Using Deep Convolutional Neural Netw...
(Msc Thesis) Sparse Coral Classification Using Deep Convolutional Neural Netw...
 
(Reading Group) Saliency Detection: A Boolean Map Approach
(Reading Group) Saliency Detection: A Boolean Map Approach(Reading Group) Saliency Detection: A Boolean Map Approach
(Reading Group) Saliency Detection: A Boolean Map Approach
 
(Reading Group) Automatic Detection of Action Potentials in a Noisy Neural Re...
(Reading Group) Automatic Detection of Action Potentials in a Noisy Neural Re...(Reading Group) Automatic Detection of Action Potentials in a Noisy Neural Re...
(Reading Group) Automatic Detection of Action Potentials in a Noisy Neural Re...
 
Lost Civilization: NUBIA
Lost Civilization: NUBIALost Civilization: NUBIA
Lost Civilization: NUBIA
 
Programming contests and competitions
Programming contests and competitionsProgramming contests and competitions
Programming contests and competitions
 
[Tech Talks] IT Celebrities: Industry Oriented
[Tech Talks] IT Celebrities: Industry Oriented[Tech Talks] IT Celebrities: Industry Oriented
[Tech Talks] IT Celebrities: Industry Oriented
 

Último

Verification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptxVerification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptx
chumtiyababu
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
ssuser89054b
 
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak HamilCara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Kandungan 087776558899
 
Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - NeometrixIntegrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
Neometrix_Engineering_Pvt_Ltd
 

Último (20)

HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARHAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
 
PE 459 LECTURE 2- natural gas basic concepts and properties
PE 459 LECTURE 2- natural gas basic concepts and propertiesPE 459 LECTURE 2- natural gas basic concepts and properties
PE 459 LECTURE 2- natural gas basic concepts and properties
 
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
 
Work-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptxWork-Permit-Receiver-in-Saudi-Aramco.pptx
Work-Permit-Receiver-in-Saudi-Aramco.pptx
 
School management system project Report.pdf
School management system project Report.pdfSchool management system project Report.pdf
School management system project Report.pdf
 
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
 
Verification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptxVerification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptx
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
Computer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to ComputersComputer Lecture 01.pptxIntroduction to Computers
Computer Lecture 01.pptxIntroduction to Computers
 
Online electricity billing project report..pdf
Online electricity billing project report..pdfOnline electricity billing project report..pdf
Online electricity billing project report..pdf
 
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak HamilCara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
 
Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - NeometrixIntegrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
 
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptxOrlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx
 
Hostel management system project report..pdf
Hostel management system project report..pdfHostel management system project report..pdf
Hostel management system project report..pdf
 
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLEGEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
COST-EFFETIVE  and Energy Efficient BUILDINGS ptxCOST-EFFETIVE  and Energy Efficient BUILDINGS ptx
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
 

(Progress Presentation) Autonomous Quadcopter Navigation

  • 1. Autonomous Quadcopter Navigation Group: Waka Waka H. Kidane, I. Sadek, M. Elawady Supervisor: Prof. Y. Petillot 1B31XP Robotics Project
  • 2. Agenda • Overview • Related Work • Control Processing • Vision Processing • Future Work B31XP Robotics Project 2
  • 3. Agenda • Overview • Related Work • Control Processing • Vision Processing • Future Work B31XP Robotics Project 3
  • 4. Overview B31XP Robotics Project 4 Problem Definition Detecting and avoiding frontal obstacles using quad-rotor Ar.drone 2
  • 5. Overview B31XP Robotics Project 5 Indoor 420g HD Camera 720P 30FPS Outdoor 320g Ultrasound Sensor Very Light and High Resistance Plastic Specific Propeller What is Ar.Drone?
  • 6. Agenda • Overview • Related Work • Control Processing • Vision Processing • Future Work B31XP Robotics Project 6
  • 7. Related Work I B31XP Robotics Project 7 Blob Based Obstacle Avoidance Algorithm • Assuming the floor as only one pattern or one color. • The blob repressing the floor is the largest blob. • Each image pixel is classified as an obstacle or the ground based on its color appearance. Limitation For AUV the floor is neither the largest blub nor mono-color .
  • 8. Related Work I B31XP Robotics Project 8
  • 9. Related Work II B31XP Robotics Project 9 Single Image Perspective Cue Algorithm • Use the Canny edge detector and apply a probabilistic Hough Transform to find long lines. • In a corridor environment, the long lines converge towards a vanishing point at the end of the corridor. Limitation Distinct and confined environments should be provided.
  • 10. Related Work II B31XP Robotics Project 10
  • 11. Related Work III B31XP Robotics Project 11 Stereo Vision Limitation Require at least two cameras, and the robot has only one eye! Monocular Stereo Vision Limitation In our task, robot is moving forward! Algorithm Assuming Static environment (two frames considered as two different cameras).
  • 12. Related Work IV B31XP Robotics Project 12 Optical Flow Algorithm • Optical flow is an algorithm to tell the direction and magnitude change of the intensity from successive images. • Points closer to the camera move more quickly across the image plane.
  • 13. Agenda • Overview • Related Work • Control Processing • Vision Processing • Future Work B31XP Robotics Project 13
  • 14. Control Processing B31XP Robotics Project 14 Flow Diagram
  • 16. Control Processing B31XP Robotics Project 16 Ros Driver • "ardrone_autonomy" :ROS driver for Parrot AR- Drone quadrocopter • AR-Drone update frequency at 200Hz • Driver operates in two modes: • real-time : publish information instantly • fixed rate: publish data at a fixed rate
  • 17. Control Processing B31XP Robotics Project 17 Sending Control Command • Publishing an Empty ROS messages to the ff topics to takeoff/land and rest – ardrone/takeoff – ardrone/land – ardrone/reset
  • 18. Control Processing B31XP Robotics Project 18 Sending Control Command • Publish a message of type geometry_msgs::Twist to velocity command topic
  • 19. Control Processing B31XP Robotics Project 19 Obstacle Avoidance Control Algorithm 1. Fly in the x-direction straight. 2. Fly sideways when the obstacle is found in the field of view.
  • 20. Agenda • Overview • Related Work • Control Processing • Vision Processing • Future Work B31XP Robotics Project 20
  • 21. Vision Processing B31XP Robotics Project 21 Flowchart Extract Features Current Image Filter Features Find Obstacles Select Nearest Obstacle Estimate Position & Orientation of Selected Obstacle Publish Flight Command Previous Image
  • 22. Vision Processing B31XP Robotics Project 22 Results - Input After K frames Frame X Frame X+K
  • 23. Vision Processing B31XP Robotics Project 23 Results – SURF I After K frames Frame X Frame X+K Tomoyuki Mori and Sebastian Scherer, "First Results in Detecting and Avoiding Frontal Obstacles from a Monocular Camera for Micro Unmanned Aerial Vehicles," International Conference on Robotics and Automation, May, 2013
  • 24. Vision Processing B31XP Robotics Project 24 Results – SURF II Matching Result Filtered Matching Result Tomoyuki Mori and Sebastian Scherer, "First Results in Detecting and Avoiding Frontal Obstacles from a Monocular Camera for Micro Unmanned Aerial Vehicles," International Conference on Robotics and Automation, May, 2013
  • 25. Vision Processing B31XP Robotics Project 25 Results – Optical Flow (Sparse) Features of 1st Frame Matching Result
  • 26. Vision Processing B31XP Robotics Project 26 Results – Optical Flow (Dense) Features of 1st Frame Matching Result Qiyuan Qiu, "Reconnaissance Drone," ECE and ME Spring Senior Design Show and ECE Senior Honors Show, 2013
  • 27. Vision Processing B31XP Robotics Project 27 Problems • Computation time of feature matching -> GPU processing (CUDA) in ROS!! • Lack of important features -> Color-based segmentation for tree trunks • Background Noise -> Outdoor pre-processing step (denoising, contrast correction) • No advantage of using color images -> Selection of suitable color space
  • 28. Agenda • Overview • Related Work • Control Processing • Vision Processing • Future Work B31XP Robotics Project 28

Notas do Editor

  1. Ref: Appearance-Based Obstacle Detection with Monocular Color Vision