SlideShare uma empresa Scribd logo
1 de 26
Deep Dive into Azure
Automated Machine
Learning
Vivek Raja P S
Student
Microsoft Certified Azure Data Scientist, AI Engineer, Data Engineer Associate
Source: Tribune India, May 31, 2020
A little about myself...
● From Tamil Nadu, India
● Final year CS Undergrad (2020)
● 5x Microsoft Certified
● Microsoft Certified Data Scientist Associate, AI
Engineer Associate, Data Engineer Associate, Azure
Fundamentals
● 15x Hackathon Winner
● Active Speaker and Mentor (AI & Cloud) - 30+ sessions
● Published 3 research papers, 1 patent (in review)
● Loves to play guitar and hardcore metal fan
Agenda
● Introduction to Machine Learning
● What is AutoML (Automated Machine Learning) ?
● AutoML versus Conventional ML practices
● Intro to Azure Automated Machine Learning
● Hands-on demo
● Learning resources
● Conclusion
Introduction to
Machine Learning
What is Machine Learning?
Machine learning (ML) is the process of using
mathematical models of data to help a computer
learn without direct instruction.
It’s considered a subset of artificial intelligence
(AI). Machine learning uses algorithms to identify
patterns within data, and those patterns are then
used to create a data model that can make
predictions.
What is Machine Learning?
To be put into simple words,
Machine Learning Techniques
Supervised learning (Input - Target pairs)
Addressing datasets with labels or structure, data acts as a teacher and “trains” the machine,
increasing in its ability to make a prediction or decision.
Unsupervised learning (Input data only)
Addressing datasets without any labels or structure, finding patterns and relationships by grouping
data into clusters.
Reinforcement learning (Reward/Penalty based learning)
Replacing the human operator, an agent—a computer program acting on behalf of someone or
something—helps determine outcome based upon a feedback loop.
Benefits of Machine Learning
● Uncover insight
● Improve data integrity
● Enhance user experience
● Reduce risk
● Anticipate customer behavior
● Lower costs
Overview of Stages in Machine Learning
Data Collection &
Preprocessing
● Identify data
source
● Data collection
● Data
Transformation
● Anomaly
Detection
● Cleaning the
data
● Domain
understanding
Train the model
● Splitting the data
● Selecting the
model
● Training
● Hyper-parameter
tuning
Validate the model
● Validating on test
dataset
● Evaluating results
● Finalising the data
model
Interpret the results
● Prediction
● Model monitoring
● Visualizations
What is AutoML?
(Automated Machine Learning)
What is AutoML?
Automated machine learning, also referred to as automated ML or
AutoML, is the process of automating the time consuming, iterative tasks
of machine learning model development. It allows data scientists, analysts,
and developers to build ML models with high scale, efficiency, and
productivity all while sustaining model quality.
AutoML process
AutoML
Vs
Conventional ML Practices
Benefits of AutoML
● Implement ML solutions without extensive
programming knowledge
● Save time and resources
● Leverage data science best practices
● Provide agile problem-solving
When to use AutoML?
● A non-programmer or non-professional data
scientist wants to leverage the power of ML
● Handling too complex data
● Lack of data domain knowledge
● Quick Implementation
● Building complex model with huge number of
parameters to finetune
Introduction to
Azure Automated
Machine Learning
How Azure AutoML works?
During training, Azure Machine Learning creates a number of pipelines in
parallel that try different algorithms and parameters for you.
The service iterates through ML algorithms paired with feature selections,
where each iteration produces a model with a training score.
The higher the score, the better the model is considered to "fit" your data.
It will stop once it hits the exit criteria defined in the experiment.
How Azure AutoML works?
Identify ML problem
and Platform
ML problem:
classification,
forecasting, or
regression
Platform:
Azure ML Studio
(limited code)
Python SDK
Data and
Compute
source
Data Source: Numpy
arrays or Pandas
dataframe
Compute Source:
local computer,
Azure Machine
Learning Computes,
remote VMs, or
Azure Databricks
dictumst. Mauri
s nec convallis quam
dolor at. Morbi iaculis
Config AutoML
parameters
Iterations over
different models,
hyperparameter
settings, advanced
preprocessing/featuri
zation, metrics
dictumst. Mauris nec
convallis quam dolor
at. Morbi iaculis nec
dolor lorem dapibus.
convallis quam dolor
at. Morbi iaculis nec
dolor lorem dapibus.
Submit the run
Logged run
information contains
metrics
The training run
produces a Python
serialized object
(.pkl file) that
contains the model
and data
preprocessing.
dictumst. Mauris nec
convallis quam dolor
at. Morbi iaculis nec
dolor lorem dapibus.
Steps to design Azure AutoML
Feature Engineering by Azure AutoML
Feature engineering is the process of using domain knowledge of the
data by eliminating overfitting and imbalanced data to create features that
help ML algorithms learn better
Automated machine learning featurization steps (feature normalization,
handling missing data, converting text to numeric, etc.) become part of the
underlying model. When using the model for predictions, the same
featurization steps applied during training are applied to your input data
automatically.
You can also add your own feature engineering technique
Ensemble Models
Hands on Demo
Learning Resources
Basics of Machine Learning: https://medium.com/@vivekraja98/machine-
learning-for-beginners-187178d1326d
https://azure.microsoft.com/en-us/overview/what-is-machine-learning-
platform/#:~:text=Machine%20learning%20(ML)%20is%20the,computer%20learn%
20without%20direct%20instruction.&text=Machine%20learning%20uses%20algorit
hms%20to,model%20that%20can%20make%20predictions.
Azure free account:
https://azure.microsoft.com/en-in/free/
Automated Machine Learning:
https://docs.microsoft.com/en-in/azure/machine-learning/concept-automated-
ml#how-automl-works
Open for QnA
Let’s connect
Email ID: vivekraja98@gmail.com
Linkedin: @Vivek Raja P S GitHub: @Vivek0712 Twitter: @vivekraja007

Mais conteúdo relacionado

Mais procurados

Microsoft Introduction to Automated Machine Learning
Microsoft Introduction to Automated Machine LearningMicrosoft Introduction to Automated Machine Learning
Microsoft Introduction to Automated Machine LearningSetu Chokshi
 
Machine Learning & Amazon SageMaker
Machine Learning & Amazon SageMakerMachine Learning & Amazon SageMaker
Machine Learning & Amazon SageMakerAmazon Web Services
 
AutoML - The Future of AI
AutoML - The Future of AIAutoML - The Future of AI
AutoML - The Future of AINing Jiang
 
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon TranslateBuild Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon TranslateAmazon Web Services
 
How to fine-tune and develop your own large language model.pptx
How to fine-tune and develop your own large language model.pptxHow to fine-tune and develop your own large language model.pptx
How to fine-tune and develop your own large language model.pptxKnoldus Inc.
 
Automated Machine Learning
Automated Machine LearningAutomated Machine Learning
Automated Machine LearningYuriy Guts
 
Module 3 - QuickSight Overview
Module 3 - QuickSight OverviewModule 3 - QuickSight Overview
Module 3 - QuickSight OverviewLam Le
 
Azure Machine Learning tutorial
Azure Machine Learning tutorialAzure Machine Learning tutorial
Azure Machine Learning tutorialGiacomo Lanciano
 
End-to-End Machine Learning with Amazon SageMaker
End-to-End Machine Learning with Amazon SageMakerEnd-to-End Machine Learning with Amazon SageMaker
End-to-End Machine Learning with Amazon SageMakerSungmin Kim
 
[Machine Learning 15minutes! #61] Azure OpenAI Service
[Machine Learning 15minutes! #61] Azure OpenAI Service[Machine Learning 15minutes! #61] Azure OpenAI Service
[Machine Learning 15minutes! #61] Azure OpenAI ServiceNaoki (Neo) SATO
 
Automated Machine Learning
Automated Machine LearningAutomated Machine Learning
Automated Machine Learningsafa cimenli
 
MLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle
MLOps Virtual Event | Building Machine Learning Platforms for the Full LifecycleMLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle
MLOps Virtual Event | Building Machine Learning Platforms for the Full LifecycleDatabricks
 
Databricks Overview for MLOps
Databricks Overview for MLOpsDatabricks Overview for MLOps
Databricks Overview for MLOpsDatabricks
 
MLOps Virtual Event: Automating ML at Scale
MLOps Virtual Event: Automating ML at ScaleMLOps Virtual Event: Automating ML at Scale
MLOps Virtual Event: Automating ML at ScaleDatabricks
 
Oracle Cloud Infrastructure – Storage
Oracle Cloud Infrastructure – StorageOracle Cloud Infrastructure – Storage
Oracle Cloud Infrastructure – StorageMarketingArrowECS_CZ
 

Mais procurados (20)

Microsoft Introduction to Automated Machine Learning
Microsoft Introduction to Automated Machine LearningMicrosoft Introduction to Automated Machine Learning
Microsoft Introduction to Automated Machine Learning
 
Machine Learning & Amazon SageMaker
Machine Learning & Amazon SageMakerMachine Learning & Amazon SageMaker
Machine Learning & Amazon SageMaker
 
What is MLOps
What is MLOpsWhat is MLOps
What is MLOps
 
MLOps.pptx
MLOps.pptxMLOps.pptx
MLOps.pptx
 
Amazon SageMaker
Amazon SageMakerAmazon SageMaker
Amazon SageMaker
 
AutoML - The Future of AI
AutoML - The Future of AIAutoML - The Future of AI
AutoML - The Future of AI
 
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon TranslateBuild Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
 
Azure ML Studio
Azure ML StudioAzure ML Studio
Azure ML Studio
 
How to fine-tune and develop your own large language model.pptx
How to fine-tune and develop your own large language model.pptxHow to fine-tune and develop your own large language model.pptx
How to fine-tune and develop your own large language model.pptx
 
Automated Machine Learning
Automated Machine LearningAutomated Machine Learning
Automated Machine Learning
 
Module 3 - QuickSight Overview
Module 3 - QuickSight OverviewModule 3 - QuickSight Overview
Module 3 - QuickSight Overview
 
Azure Machine Learning tutorial
Azure Machine Learning tutorialAzure Machine Learning tutorial
Azure Machine Learning tutorial
 
End-to-End Machine Learning with Amazon SageMaker
End-to-End Machine Learning with Amazon SageMakerEnd-to-End Machine Learning with Amazon SageMaker
End-to-End Machine Learning with Amazon SageMaker
 
introduction Azure OpenAI by Usama wahab khan
introduction  Azure OpenAI by Usama wahab khanintroduction  Azure OpenAI by Usama wahab khan
introduction Azure OpenAI by Usama wahab khan
 
[Machine Learning 15minutes! #61] Azure OpenAI Service
[Machine Learning 15minutes! #61] Azure OpenAI Service[Machine Learning 15minutes! #61] Azure OpenAI Service
[Machine Learning 15minutes! #61] Azure OpenAI Service
 
Automated Machine Learning
Automated Machine LearningAutomated Machine Learning
Automated Machine Learning
 
MLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle
MLOps Virtual Event | Building Machine Learning Platforms for the Full LifecycleMLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle
MLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle
 
Databricks Overview for MLOps
Databricks Overview for MLOpsDatabricks Overview for MLOps
Databricks Overview for MLOps
 
MLOps Virtual Event: Automating ML at Scale
MLOps Virtual Event: Automating ML at ScaleMLOps Virtual Event: Automating ML at Scale
MLOps Virtual Event: Automating ML at Scale
 
Oracle Cloud Infrastructure – Storage
Oracle Cloud Infrastructure – StorageOracle Cloud Infrastructure – Storage
Oracle Cloud Infrastructure – Storage
 

Semelhante a Getting Started with Azure AutoML

Automated machine learning - Global AI night 2019
Automated machine learning - Global AI night 2019Automated machine learning - Global AI night 2019
Automated machine learning - Global AI night 2019Marco Zamana
 
GDG DEvFest Hellas 2020 - Automated ML - Panagiotis Papaemmanouil
GDG DEvFest Hellas 2020 -  Automated ML - Panagiotis PapaemmanouilGDG DEvFest Hellas 2020 -  Automated ML - Panagiotis Papaemmanouil
GDG DEvFest Hellas 2020 - Automated ML - Panagiotis PapaemmanouilPanagiotis Papaemmanouil
 
Walk through of azure machine learning studio new features
Walk through of azure machine learning studio new featuresWalk through of azure machine learning studio new features
Walk through of azure machine learning studio new featuresLuca Zavarella
 
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...Luca Zavarella
 
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Bhakthi Liyanage
 
201909 Automated ML for Developers
201909 Automated ML for Developers201909 Automated ML for Developers
201909 Automated ML for DevelopersMark Tabladillo
 
AI hype or reality
AI  hype or realityAI  hype or reality
AI hype or realityAwantik Das
 
201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0Mark Tabladillo
 
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...Andrew Ly
 
Machine Learning Contents.pptx
Machine Learning Contents.pptxMachine Learning Contents.pptx
Machine Learning Contents.pptxNaveenkushwaha18
 
DevOps and Machine Learning (Geekwire Cloud Tech Summit)
DevOps and Machine Learning (Geekwire Cloud Tech Summit)DevOps and Machine Learning (Geekwire Cloud Tech Summit)
DevOps and Machine Learning (Geekwire Cloud Tech Summit)Jasjeet Thind
 
Webinar: Machine Learning para Microcontroladores
Webinar: Machine Learning para MicrocontroladoresWebinar: Machine Learning para Microcontroladores
Webinar: Machine Learning para MicrocontroladoresEmbarcados
 
Machine learning for sensor Data Analytics
Machine learning for sensor Data AnalyticsMachine learning for sensor Data Analytics
Machine learning for sensor Data AnalyticsMATLABISRAEL
 
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdfSlides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdfvitm11
 
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in PracticeGDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in PracticeJames Anderson
 
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmeaIntroduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmeaSandesh Rao
 
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEAIntroduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEASandesh Rao
 

Semelhante a Getting Started with Azure AutoML (20)

Aws autopilot
Aws autopilotAws autopilot
Aws autopilot
 
Automated machine learning - Global AI night 2019
Automated machine learning - Global AI night 2019Automated machine learning - Global AI night 2019
Automated machine learning - Global AI night 2019
 
Machine learning
Machine learningMachine learning
Machine learning
 
GDG DEvFest Hellas 2020 - Automated ML - Panagiotis Papaemmanouil
GDG DEvFest Hellas 2020 -  Automated ML - Panagiotis PapaemmanouilGDG DEvFest Hellas 2020 -  Automated ML - Panagiotis Papaemmanouil
GDG DEvFest Hellas 2020 - Automated ML - Panagiotis Papaemmanouil
 
Walk through of azure machine learning studio new features
Walk through of azure machine learning studio new featuresWalk through of azure machine learning studio new features
Walk through of azure machine learning studio new features
 
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
 
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
 
201909 Automated ML for Developers
201909 Automated ML for Developers201909 Automated ML for Developers
201909 Automated ML for Developers
 
AI hype or reality
AI  hype or realityAI  hype or reality
AI hype or reality
 
201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0
 
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
 
Machine Learning Contents.pptx
Machine Learning Contents.pptxMachine Learning Contents.pptx
Machine Learning Contents.pptx
 
DevOps and Machine Learning (Geekwire Cloud Tech Summit)
DevOps and Machine Learning (Geekwire Cloud Tech Summit)DevOps and Machine Learning (Geekwire Cloud Tech Summit)
DevOps and Machine Learning (Geekwire Cloud Tech Summit)
 
Webinar: Machine Learning para Microcontroladores
Webinar: Machine Learning para MicrocontroladoresWebinar: Machine Learning para Microcontroladores
Webinar: Machine Learning para Microcontroladores
 
Lecture-6-7.pptx
Lecture-6-7.pptxLecture-6-7.pptx
Lecture-6-7.pptx
 
Machine learning for sensor Data Analytics
Machine learning for sensor Data AnalyticsMachine learning for sensor Data Analytics
Machine learning for sensor Data Analytics
 
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdfSlides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
 
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in PracticeGDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
 
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmeaIntroduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
 
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEAIntroduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
 

Mais de Vivek Raja P S

Model Drift Monitoring using Tensorflow Model Analysis
Model Drift Monitoring using Tensorflow Model AnalysisModel Drift Monitoring using Tensorflow Model Analysis
Model Drift Monitoring using Tensorflow Model AnalysisVivek Raja P S
 
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...Vivek Raja P S
 
Getting Started with Containers
Getting Started with ContainersGetting Started with Containers
Getting Started with ContainersVivek Raja P S
 
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...Vivek Raja P S
 
Strategies and Roadmap to win any Hackathon
Strategies and Roadmap to win any HackathonStrategies and Roadmap to win any Hackathon
Strategies and Roadmap to win any HackathonVivek Raja P S
 
AI/ ML solutions to tackle COVID-19
AI/ ML solutions to tackle COVID-19AI/ ML solutions to tackle COVID-19
AI/ ML solutions to tackle COVID-19Vivek Raja P S
 

Mais de Vivek Raja P S (7)

Model Drift Monitoring using Tensorflow Model Analysis
Model Drift Monitoring using Tensorflow Model AnalysisModel Drift Monitoring using Tensorflow Model Analysis
Model Drift Monitoring using Tensorflow Model Analysis
 
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
 
Getting Started with Containers
Getting Started with ContainersGetting Started with Containers
Getting Started with Containers
 
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
 
Tensorflow Ecosystem
Tensorflow EcosystemTensorflow Ecosystem
Tensorflow Ecosystem
 
Strategies and Roadmap to win any Hackathon
Strategies and Roadmap to win any HackathonStrategies and Roadmap to win any Hackathon
Strategies and Roadmap to win any Hackathon
 
AI/ ML solutions to tackle COVID-19
AI/ ML solutions to tackle COVID-19AI/ ML solutions to tackle COVID-19
AI/ ML solutions to tackle COVID-19
 

Último

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfhans926745
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 

Último (20)

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 

Getting Started with Azure AutoML

  • 1. Deep Dive into Azure Automated Machine Learning Vivek Raja P S Student Microsoft Certified Azure Data Scientist, AI Engineer, Data Engineer Associate
  • 2. Source: Tribune India, May 31, 2020
  • 3. A little about myself... ● From Tamil Nadu, India ● Final year CS Undergrad (2020) ● 5x Microsoft Certified ● Microsoft Certified Data Scientist Associate, AI Engineer Associate, Data Engineer Associate, Azure Fundamentals ● 15x Hackathon Winner ● Active Speaker and Mentor (AI & Cloud) - 30+ sessions ● Published 3 research papers, 1 patent (in review) ● Loves to play guitar and hardcore metal fan
  • 4. Agenda ● Introduction to Machine Learning ● What is AutoML (Automated Machine Learning) ? ● AutoML versus Conventional ML practices ● Intro to Azure Automated Machine Learning ● Hands-on demo ● Learning resources ● Conclusion
  • 6. What is Machine Learning? Machine learning (ML) is the process of using mathematical models of data to help a computer learn without direct instruction. It’s considered a subset of artificial intelligence (AI). Machine learning uses algorithms to identify patterns within data, and those patterns are then used to create a data model that can make predictions.
  • 7. What is Machine Learning? To be put into simple words,
  • 8. Machine Learning Techniques Supervised learning (Input - Target pairs) Addressing datasets with labels or structure, data acts as a teacher and “trains” the machine, increasing in its ability to make a prediction or decision. Unsupervised learning (Input data only) Addressing datasets without any labels or structure, finding patterns and relationships by grouping data into clusters. Reinforcement learning (Reward/Penalty based learning) Replacing the human operator, an agent—a computer program acting on behalf of someone or something—helps determine outcome based upon a feedback loop.
  • 9. Benefits of Machine Learning ● Uncover insight ● Improve data integrity ● Enhance user experience ● Reduce risk ● Anticipate customer behavior ● Lower costs
  • 10. Overview of Stages in Machine Learning Data Collection & Preprocessing ● Identify data source ● Data collection ● Data Transformation ● Anomaly Detection ● Cleaning the data ● Domain understanding Train the model ● Splitting the data ● Selecting the model ● Training ● Hyper-parameter tuning Validate the model ● Validating on test dataset ● Evaluating results ● Finalising the data model Interpret the results ● Prediction ● Model monitoring ● Visualizations
  • 11. What is AutoML? (Automated Machine Learning)
  • 12. What is AutoML? Automated machine learning, also referred to as automated ML or AutoML, is the process of automating the time consuming, iterative tasks of machine learning model development. It allows data scientists, analysts, and developers to build ML models with high scale, efficiency, and productivity all while sustaining model quality.
  • 15. Benefits of AutoML ● Implement ML solutions without extensive programming knowledge ● Save time and resources ● Leverage data science best practices ● Provide agile problem-solving
  • 16. When to use AutoML? ● A non-programmer or non-professional data scientist wants to leverage the power of ML ● Handling too complex data ● Lack of data domain knowledge ● Quick Implementation ● Building complex model with huge number of parameters to finetune
  • 18. How Azure AutoML works? During training, Azure Machine Learning creates a number of pipelines in parallel that try different algorithms and parameters for you. The service iterates through ML algorithms paired with feature selections, where each iteration produces a model with a training score. The higher the score, the better the model is considered to "fit" your data. It will stop once it hits the exit criteria defined in the experiment.
  • 20. Identify ML problem and Platform ML problem: classification, forecasting, or regression Platform: Azure ML Studio (limited code) Python SDK Data and Compute source Data Source: Numpy arrays or Pandas dataframe Compute Source: local computer, Azure Machine Learning Computes, remote VMs, or Azure Databricks dictumst. Mauri s nec convallis quam dolor at. Morbi iaculis Config AutoML parameters Iterations over different models, hyperparameter settings, advanced preprocessing/featuri zation, metrics dictumst. Mauris nec convallis quam dolor at. Morbi iaculis nec dolor lorem dapibus. convallis quam dolor at. Morbi iaculis nec dolor lorem dapibus. Submit the run Logged run information contains metrics The training run produces a Python serialized object (.pkl file) that contains the model and data preprocessing. dictumst. Mauris nec convallis quam dolor at. Morbi iaculis nec dolor lorem dapibus. Steps to design Azure AutoML
  • 21. Feature Engineering by Azure AutoML Feature engineering is the process of using domain knowledge of the data by eliminating overfitting and imbalanced data to create features that help ML algorithms learn better Automated machine learning featurization steps (feature normalization, handling missing data, converting text to numeric, etc.) become part of the underlying model. When using the model for predictions, the same featurization steps applied during training are applied to your input data automatically. You can also add your own feature engineering technique
  • 24. Learning Resources Basics of Machine Learning: https://medium.com/@vivekraja98/machine- learning-for-beginners-187178d1326d https://azure.microsoft.com/en-us/overview/what-is-machine-learning- platform/#:~:text=Machine%20learning%20(ML)%20is%20the,computer%20learn% 20without%20direct%20instruction.&text=Machine%20learning%20uses%20algorit hms%20to,model%20that%20can%20make%20predictions. Azure free account: https://azure.microsoft.com/en-in/free/ Automated Machine Learning: https://docs.microsoft.com/en-in/azure/machine-learning/concept-automated- ml#how-automl-works
  • 26. Let’s connect Email ID: vivekraja98@gmail.com Linkedin: @Vivek Raja P S GitHub: @Vivek0712 Twitter: @vivekraja007