Slides used during my session "How to fly a drone with 20 lines of code and use some AI" for the Global AI Tour event. Virtual Mode for Buenos Aires, Argentina.

2. Bruno Capuano
Innovation Lead @Avanade
@elbruno | http://elbruno.com
Let’s code a drone to follow faces!
Using AI, Python, containers and more.

3. @elbruno
Excessive use
of crappy
animations
and demos!
https://wallup.net/dark-horror-evil-sign-text-zombie/

4. @elbruno
Optional knowledge
Python understanding
Cognitive Services
Face Recognition concepts
Docker and Containers Concepts
No TCP / UDP

5. @elbruno
Required Knowledge

6. @elbruno
DJI Tello
https://www.amazon.com/Tello-CP-PT-00000252-01-Quadcopter-Drone/dp/B07BDHJJTH

7. @elbruno
Intel Processor,
Professional processing
yields high-quality
footage.
Flight Time: 13 minutes Image Transmission
Distance: 100 meters
HD Transmission: 720pSmart Switching: 2
Antennas
Auto Takeoff/Landing
DJI Tello
Lift off or land with a
single tap.
Low Battery
Protection
Alerts go off when
your battery gets
low.
Fail-safe Protection
Land safely, even if
you lose connection.
Vision Positioning
System
Smart technology
that facilitates
precise hovering.

8. @elbruno
DJI Tello - Drone Programming
Mobile Scratch Programming
Move-Based Control
Programming Simulator
SDK
DIY Accessories
https://www.ryzerobotics.com/tello

9. @elbruno
DJI Tello - Tello SDK 2.0 User Guide.pdf
https://dl-cdn.ryzerobotics.com/downloads/Tello/Tello%20SDK%202.0%20User%20Guide.pdf

10. @elbruno
UDP vs TCP

11. @elbruno
DJI Tello - Tello SDK 2.0 User Guide.pdf
https://dl-cdn.ryzerobotics.com/downloads/Tello/Tello%20SDK%202.0%20User%20Guide.pdf

12. @elbruno1
Connect to Drone and Share
Network
Cable
Wireless
Connection
Lynsys Velop Node Gaming / Work PC DJI Tello Drone

13. @elbruno
Let’s connect
MakeMagicHappen();
https://www.avanade.com/AI

14. @elbruno
DJI Tello - Tello SDK 2.0 User Guide.pdf
https://dl-cdn.ryzerobotics.com/downloads/Tello/Tello%20SDK%202.0%20User%20Guide.pdf

15. @elbruno
SDK Description
2 main actions
Send Commands
Read Commands
Flow
1st Command >> “command”
2nd Command >> “battery?”

16. @elbruno
Demo: Hello World !!!
or get the battery charge %
MakeMagicHappen();
https://www.avanade.com/AI

17. @elbruno
Drone Camera Feed
Stream available via UDP
udp://192.168.10.1:11111
Didn’t work with VLC 
Cool tool: FFmpeg
.ffplay.exe -i
udp://192.168.10.1:11111
https://elbruno.com/2020/02/17/coding4fun-how-to-control-your-drone-with-20-lines-of-code-7-n/

18. @elbruno
Demo: Camera OpenCV
MakeMagicHappen();
https://www.avanade.com/AI

19. @elbruno
State-of-the-art face
detection demo
(Courtesy Boris Babenko)

20. @elbruno
Face Detection / Recognition
FACE
DETECTION
DETECT FACIAL
FEATURES
FACE
RECOGNITION
OBJECT
RECOGNITION

21. @elbruno
Face Detection / Recognition
FACE
DETECTION
DETECT FACIAL
FEATURES
FACE
RECOGNITION
OBJECT
RECOGNITION

22. @elbruno
Viola/Jones (2001) Object Detection Framework
The algorithm has four stages:
• Haar Feature Selection
• Creating an Integral Image
• Adaboost Training
• Cascading Classifiers
Haar Features
- The eye region is darker than the upper-cheeks.
- The nose bridge region is brighter than the
eyes
Supported by OpenCV !
https://en.wikipedia.org/wiki/Viola%E2%80%93Jones_object_detection_framework

23. @elbruno
Viola/Jones (2001) Object Detection Framework
https://en.wikipedia.org/wiki/Viola%E2%80%93Jones_object_detection_framework

24. @elbruno
Demo: Face Detection using
HaarCascades and OpenCV
MakeMagicHappen();
https://www.avanade.com/AI

25. @elbruno
Prepare Your Data Build & Train Run
Build your own custom machine learning models

26. @elbruno

27. @elbruno
Demo: Object Recognition
using Custom Vision Models
MakeMagicHappen();
https://www.avanade.com/AI

28. @elbruno
Introduction to the
drone. Features and
how-to of the SDK
Drone SDK
Analyze the drone camera
feed using a custom object
recognition model created
with http://customvision.ai
CustomVision.AI
with Containers
How to use OpenCV
to access the Drone
Camera feed via UDP
feed.
Drone Camera
Use Haar Cascades
files to perform face
detection using
OpenCV from the
drone camera feed.
Face Detection
with OpenCV
Quick Recap

29. @elbruno2
Resources
DJI Tello Drone,
https://www.amazon.com/Tello-CP-PT-00000252-01-Quadcopter-Drone/dp/B07BDHJJTH
Ryze Tello SDK, https://www.ryzerobotics.com/tello
My Blog – 20 lines to control your drone,
https://elbruno.com/2020/02/17/coding4fun-how-to-control-your-drone-with-20-lines-of-code-7-n/
Viola Jones, Object Detection Framework,
https://en.wikipedia.org/wiki/Viola%E2%80%93Jones_object_detection_framework
Cognitive Services Custom Vision, https://customvision.ai
Damian Tello, Python DJI SDK, https://github.com/damiafuentes/DJITelloPy

30. @elbruno
Resources
EASY WAY TO INSTALL
OPENCV AND TENSORFLOW
WITH ANACONDA
HTTPS://ELBRUNO.COM/202
0/05/12/PYTHON-EASY-
WAY-TO-INSTALL-OPENCV-
AND-TENSORFLOW-WITH-
ANACONDA/
PIXELLIB IS A LIBRARY FOR
PERFORMING
SEGMENTATION OF IMAGES
HTTPS://GITHUB.COM/AYOO
LAOLAFENWA/PIXELLIB
WINDOWS TERMINAL AND
ANACONDA. AND HOW TO
START AN ANACONDA
VIRTUAL ENVIRONMENT
HTTPS://ELBRUNO.COM/202
0/05/13/WINDOWS10-
WINDOWSTERMINAL-AND-
ANACONDA-BONUS-START-
AN-ANACONDA-VIRTUAL-
ENVIRONMENT/
FLIP WHEN A FACE IS
DETECTED
HTTPS://ELBRUNO.COM/202
0/03/18/CODING4FUN-
HOW-TO-CONTROL-YOUR-
DRONE-WITH-20-LINES-OF-
CODE-12-N/
INSTANCE SEGMENTATION
HTTPS://ELBRUNO.COM/202
0/05/21/CODING4FUN-
HOW-TO-CONTROL-YOUR-
DRONE-WITH-20-LINES-OF-
CODE-20-N/

31. Bruno Capuano
Innovation Lead @Avanade
@elbruno | http://elbruno.com
Q&A
Thanks!