2020 01 21 Data Platform Geeks - Machine Learning.Net
•Transferir como PPTX, PDF•
1 gostou•377 visualizações
This document provides an overview of getting started with ML.Net, a machine learning framework for .NET developers. It discusses ML.Net's capabilities including being proven at scale, open source, and cross-platform. It also summarizes common machine learning scenarios that can be implemented with ML.Net like customer segmentation, recommendations, and predictive maintenance. Finally, it outlines the typical machine learning workflow in ML.Net of loading data, extracting features, training a model, and evaluating performance.
Recomendados
Recomendados
Mais conteúdo relacionado
Semelhante a 2020 01 21 Data Platform Geeks - Machine Learning.Net
Semelhante a 2020 01 21 Data Platform Geeks - Machine Learning.Net (20)
Mais de Bruno Capuano
Mais de Bruno Capuano (20)
Último
Último (20)
2020 01 21 Data Platform Geeks - Machine Learning.Net
- 1. www.DataPlatformGeeks.com | www.SQLServerGeeks.com @TheDataGeeks | @SQLServerGeeks | admin@DataPlatformGeeks.com Getting started with ML.Net Bruno Capuano (@elbruno) Microsoft AI MVP Canada Innovation Lead at Avanade
- 2. DESKTOP CLOUDWEB MOBILE ML .NET IoTGAMING Your platform for building anything
- 3. Windows 10 (Windows Defender) Power Point (Design Ideas) Excel (Chart Recommendations) Bing Ads (Ad Predictions) + more Azure Stream Analytics (Anomaly Detection) Power BI (Key Influencers) ML.NET is proven at scale, enterprise ready
- 4. Proven & Extensible Open Source & Cross platform dot.net/ml Build your own Developer Focused ML.NET is a machine learning framework made for .NET developers
- 5. And many more examples @ https://github.com/dotnet/machinelearning-samples Customer segmentation Recommendations Predictive maintenance Forecasting Issue Classification Ranking news/topics Image classification Sentiment Analysis Machine Learning scenarios with ML.NET
- 6. Easy / Less Control Full Control / Harder Vision Speech Language Knowledge SearchLabs TextAnalyticsAPI client = new TextAnalyticsAPI(); client.AzureRegion = AzureRegions.Westus; client.SubscriptionKey = "1bf33391DeadFish"; client.Sentiment( new MultiLanguageBatchInput( new List<MultiLanguageInput>() { new MultiLanguageInput("en","0", "This is a great vacuum cleaner") })); e.g. Sentiment Analysis using Azure Cognitive Services 96% positive Pre-built machine learning models
- 7. Easy / Less Control Full Control / Harder TextAnalyticsAPI client = new TextAnalyticsAPI(); client.AzureRegion = AzureRegions.Westus; client.SubscriptionKey = "1bf33391DeadFish"; client.Sentiment( new MultiLanguageBatchInput( new List<MultiLanguageInput>() { new MultiLanguageInput("en","0", "This vacuum cleaner sucks so much dirt") })); e.g. Sentiment Analysis using Azure Cognitive Services 9% positive Vision Speech Language Knowledge SearchLabs Limitations with pre-built machine learning models
- 8. Easy / Less Control Full Control / Harder TextAnalyticsAPI client = new TextAnalyticsAPI(); client.AzureRegion = AzureRegions.Westus; client.SubscriptionKey = "1bf33391DeadFish"; client.Sentiment( new MultiLanguageBatchInput( new List<MultiLanguageInput>() { new MultiLanguageInput("en","0", "This vacuum cleaner sucks so much dirt") })); e.g. Sentiment Analysis using Azure Cognitive Services 9% positive Vision Speech Language Knowledge SearchLabs Limitations with pre-built machine learning models
- 9. Load Data Extract Features Model Consumption Train Model Evaluate Model Prepare Your Data Build & Train Run Machine Leaning workflow
- 10. Getting Started with Sentiment Analysis
- 11. Comment Toxic? (Sentiment) ==RUDE== Dude, you are rude … 1 == OK! == IM GOING TO VANDALIZE … 1 I also found use of the word "humanists” confusing … 0 Oooooh thank you Mr. DietLime … 0 Wikipedia detox data at https://figshare.com/articles/Wikipedia_Talk_Labels_Personal_Attacks/4054689 Features (input) Label (output) Sentiment Analysis
- 12. Is this A or B? Is this a toxic comment? Yes or no Sentiment analysis explained
- 13. Prepare Your Data Example Comment Toxic? (Sentiment) ==RUDE== Dude, you are rude … 1 == OK! == IM GOING TO VANDALIZE … 1 I also found use of the word "humanists” confusing … 0 Oooooh thank you Mr. DietLime … 0 Important concepts: Data
- 14. Prepare Your Data Text Featurizer Featurized Text [0.76, 0.65, 0.44, …] [0.98, 0.43, 0.54, …] [0.35, 0.73, 0.46, …] [0.39, 0, 0.75, …] Example Text ==RUDE== Dude, you are rude … == OK! == IM GOING TO VANDALIZE … I also found use of the word "humanists” … Oooooh thank you Mr. DietLime … Important concepts: Transformer
- 15. Build & Train Example Estimator Comment Toxic? (Sentiment) ==RUDE== Dude, you … 1 == OK! == IM GOING … 1 I also found use of the … 0 Oooooh thank you Mr. … 0 Important concepts: Estimator
- 16. Comment ==RUDE== Dude, you … Prediction Function Predicted Label – Toxic? (Sentiment) 1 Run Example Important concepts: Prediction Function
- 18. AutoML and Model Builder
- 19. AutoML Model Builder ML.NET Tooling ML.NET CLI global tool accelerates productivity
- 20. How much is the taxi fare for 1 passenger going from Burlington to Toronto? ML.NET CLI global tool accelerates productivity AutoML with ML.NET
- 21. Criterion Loss Min Samples Split Min Samples Leaf XYZ Parameter 1 Parameter 2 Parameter 3 Parameter 4 … Distance Trip time Car type Passengers Time of day … Gradient Boosted Nearest Neighbors SGD Bayesian Regression LGBM … Distance Gradient Boosted Model Car type Passengers Getting started w/machine learning can be hard ML.NET takes the guess work out of data prep, feature selection & hyperparameter tuning Which algorithm? Which parameters?Which features? Getting started w/machine learning can be hard
- 22. N Neighbors Weights Metric P ZYX Criterion Loss Min Samples Split Min Samples Leaf XYZ Which algorithm? Which parameters?Which features? Distance Trip time Car type Passengers Time of day … Gradient Boosted Nearest Neighbors SGD Bayesian Regression LGBM … Nearest Neighbors Model Iterate Gradient BoostedDistance Car brand Year of make Car type Passengers Trip time Getting started w/machine learning can be hard ML.NET takes the guess work out of data prep, feature selection & hyperparameter tuning Getting started w/machine learning can be hard
- 23. Which algorithm? Which parameters?Which features? Iterate Getting started w/machine learning can be hard ML.NET takes the guess work out of data prep, feature selection & hyperparameter tuning Getting started w/machine learning can be hard
- 24. 25%40%70% 25% 95% 25% 25% 25% 25% 40% 40% 40% 40% 70% 70% 70%Enter data Define goals Apply constraints Input Intelligently test multiple models in parallel Optimized model 95% ML.NET accelerates model development
- 25. 70%95% Feature importance Distance Trip time Car type Passengers Time of day 0 1 Model B (70%) Distance 0 1 Trip time Car type Passengers Time of day Feature importance Model A (95%) ML.NET accelerates model development with model explainability ML.NET accelerates model development
- 26. # STEP 1: Load data IDataView trainingDataView = mlContext.Data.LoadFromTextFile<TaxiTrip>( ... ) IDataView testDataView = mlContext.Data.LoadFromTextFile<TaxiTrip>( ... ) ConsoleHelper.ShowDataViewInConsole(mlContext, trainingDataView) # STEP 2: Initialize user-defined progress handler that AutoML will invoke after each model var progressHandler = new RegressionExperimentProgressHandler() # STEP 3: Run AutoML regression experiment ExperimentResult<RegressionMetrics> experimentResult = mlContext.Auto() .CreateRegressionExperiment(ExperimentTime) .Execute(trainingDataView, LabelColumnName, progressHandler: progressHandler) PrintTopModels(experimentResult) # STEP 4: Evaluate the model on test data RunDetail<RegressionMetrics> best = experimentResult.BestRun ITransformer trainedModel = best.Model IDataView predictions = trainedModel.Transform(testDataView) # STEP 5: Save trained model to a .ZIP file mlContext.Model.Save(trainedModel, trainingDataView.Schema, ModelPath)
- 29. Getting started with ML.Net Bruno Capuano (@elbruno) Microsoft AI MVP Canada Innovation Lead at Avanade
Notas do Editor
- .NET is a great tech stack for building a wide variety of applications. There is ASP.NET for web development, Xamarin for mobile development and with ML.NET we are trying to make .NET great for Machine Learning.
- Even though we just recently released ML.NET at Build this year, ML.NET has been used at Microsoft heavily for over a decade by iconic MS products. Bing Ads uses ML.NET for add-click predictions Excel uses ML.NET for chart recommendations PowerPoint uses ML.NET for Design Ideas Windows10 uses ML.NET for Windows Defender
- 4
- 5
- 6
- 7
- 8
- 9
- 11
- 13
- 14
- 15
- 16
- ML.NET provides tooling that makes it easy to use. In particular, 2 really valuable tools are: AutoML and Model Builder What is AutoML? It is an API that accelerates model development for you. A lot of developers do not have the experience required to build or train Machine Learning models. With AutoML, the process of finding the best algorithm, is automated! Model Builder on the other hand provides an easy to understand visual interface to build, train, and deploy custom machine learning models. Prior machine learning expertise is not required. It also supports AutoML Rememeber depending on your data, giving you the error of each of the models and you can then decide which model to use. Most people just use the model with the least error. And we will see it in action soon.
- To demonstrate what AutoML is, let’s consider that we want to provide a service that allows users to predict taxi fare before they book or call a taxi. How can we build this feature/service?
- A data scientist’s job is to find the best algorithm that will do taxi fare prediction. Let’s says we have a dataset that contains information such as trip distance, trip time, number of passengers, time of day of the trip etc. A data scientist will spend a lot of time trying to decide which of these pieces of information is important when predicting taxi fare. In ML, there are so many algorithms and are generally referred to as trainers, for example linear regression, convolutional neural network etc The data scientist will try one algorithm at a time, picking features as he desires, and then wait to see how the model performs. In this case, this model only scored 30% based on number of bad predictions it made.
- Microsoft Envision 2016
- Microsoft Envision 2016
- Microsoft Envision 2016
- 25
- ML.NET is an end to end solution for your Machine Learning needs. The steps taken: We loaded data, which we already do! We initialized a progress handler which would help track each model tried! We then ran AutoML which tried many different models and returned back to us the top models! We picked the best preforming model and evaluated it on test data! Finally, we saved the model for future use. Very few lines of code needed. No model building expertise is needed. There’s throurough documentation on the ML.NET site and there also many samples provided – you might find what you need there and code provided to you.