DSP-IP deep learning syllabus

1. 2 Beni Berman st, Netanya, Israel | www.dsp-ip.com | info@dsp-ip.com | 0545313092
‫מעשית‬ ‫עמוקה‬ ‫למידה‬
–
‫תוכנית‬
‫מודולרית‬ ‫הכשרה‬
‫פוקוס‬
‫מ‬
‫היא‬ ‫התוכנית‬ ‫טרת‬
‫הנ‬ ‫האלגוריתמי‬ ‫הידע‬ ‫בין‬ ‫הפער‬ ‫גישור‬
‫אק‬ ‫בקורסים‬ ‫למד‬
‫ד‬
( ‫ובאינטרנט‬ ‫מיים‬
Stanford,
deeplearning.ai, MIT
)
‫ההיטק‬ ‫חברות‬ ‫עי‬ ‫הנדרשות‬ ‫למיומנויות‬
.
‫התוכנית‬ ‫במסגרת‬
‫נלמדים‬
‫פיתוח‬ ‫כלי‬
‫מתחום‬ ‫עבודה‬ ‫ושיטות‬ ‫תוכנות‬ ,
‫העמוקה‬ ‫הלמידה‬
.‫בתעשיה‬ ‫בשימוש‬ ‫הנמצאים‬
‫של‬ ‫הם‬ ‫שנבחרו‬ ‫הפיתוח‬ ‫כלי‬
,NVIDIA
‫ה‬
‫בעולם‬ ‫המובילה‬ ‫חברה‬
‫בפיתוח‬
GPU
‫עמוקה‬ ‫ללמידה‬ ‫תוכנה‬ ‫וכלי‬
‫ושל‬
AWS
‫ש‬
‫לתוכנית‬ ‫התורמות‬ ‫חברות‬ ‫תי‬
‫לתוכנית‬
,‫ענן‬ ‫שעות‬
‫פיתוח‬ ‫בכלי‬
,
‫קו‬
‫רסים‬
‫חומרה‬ ‫וכרטיסי‬
‫יותר‬ ‫איכותית‬ ‫עבודה‬ ‫למצוא‬ ‫לבוגרים‬ ‫לסייע‬ ‫מנת‬ ‫על‬ ‫לחדשנות‬ ‫הרשות‬ ‫בחסות‬ ‫התוכנית‬ ‫כן‬ ‫כמו‬
‫התוכנית‬
‫בחינם‬ ‫בעולם‬ ‫מהטובים‬ ‫מרצים‬ ‫עי‬ ‫למצוא‬ ‫ניתן‬ ‫זאת‬ ‫את‬ ,‫עמוקה‬ ‫בלמידה‬ ‫אלגוריתמי‬ ‫ידע‬ ‫מלמדת‬ ‫אינה‬
,‫באינטרנט‬
‫אלגורי‬ ‫ידע‬ ‫מניחה‬
‫תמי‬
‫קיי‬
‫ם‬
‫טובה‬ ‫עצמי‬ ‫לימוד‬ ‫ויכולת‬
‫פערים‬ ‫שיסגרו‬
‫אלגוריתמיים‬
(
‫קיימים‬ ‫אם‬
)
‫עבודה‬ ‫ושיטות‬ ‫כלי‬ ‫ומלמדת‬
.
‫הנלמדים‬ ‫הנושאים‬ ‫בין‬
• Latest industry tools to train, optimize and deploy models on embedded / cloud
platforms.
• Working with cloud GPU instances and containers
• Working with IoT platforms
Requirements
Candidate must poses a software/ computer / electric engineering degree and a few deep
learning vision courses such as stanford 231n and Coursera deeplearning.ai
• Good understanding of python programing, OOP and data cleaning
• Understanding of network programming and training process
• Ability to explain concepts of classifier detector segmentor and box detector
• Control of basic OpenCV, Numpy and pandas functions

2. 2 Beni Berman st, Netanya, Israel | www.dsp-ip.com | info@dsp-ip.com | 0545313092
Syllabus
Mandatory
The basics: Linux, Basic Scripting, python OOP
• Intro to Linux bash commands
• C++, make, OpenCV with C++
• Scripting with python: OOP
• Group project: Basic Automation script / Make
DL / ML Basics
• Data cleaning
• Data exploration
• Basic CNNs: classifier / BBOX detector / Segmentation network
• Project: Implementing one of the networks
Basic Building blocks
• Image and audio sampling
• Image Formats & Color Spaces
• Image & video compression
• Communication & Streaming protocols
NVIDIA basics
• Gstreamer - programming gstreamer pipe
• Nvidia DeepStream video processing course
• Cloud academy – docker course
• Basic projects: DeepStream on Jetson Nano
Intro to MLOps Docker & cloud
• Cloud Academy courses: Docker & Kubernetes
• NVIDIA NGC
• Introduction to AWS
• Cloud Academy Courses: IAM, S3, EC2, Lambda
• Setting NVIDIA AMI Instance controlling it
Sensors
• 2D Camera Structure (shutter ISP sensor, filter)
• Camera Calibration
• Passive stereo camera
• IR Projectors / Active stereo
• Project: Camera control / camera calibration and image fixing

3. 2 Beni Berman st, Netanya, Israel | www.dsp-ip.com | info@dsp-ip.com | 0545313092
Topics from the list below according to industrial project:
Medical Specialization
• Medical Image classification
• Medical Image Augmentation with GAN
• Data Acceleration with NVIDIA DALI
• Medical data and LSTM
• Internship related to biomedical
Video Analytics and analysis specializing
• NVIDIA TensorRT optimization
• NVIDIA TLT – Transfer Learning
• Advance video analytics projects
a. Parking lot
b. people counting
c. virtual lines
d. Secondary inference
• Internship related to video analytics
NLP Speech and conversational AI specialization
• Intro to NLP, basic NLP libraries
• NVIDIA Speech and Sound models
• NLP & Transformers
• NVIDIA Conversational AI
• Internship in NLP / conversational AI
Robotics / autonomous cars specializing
• ROS
• Gazibo and simulations
• ISAAC
• Robotic arm programming
• SLAM
• Robotic Car
• Internship in Autonomous robot/car/drone