AWS Machine Learning Big Data NYC
•
1 gostou•932 visualizações
Presentation of the AWS Machine Learning platform at the Global Big Data conference - NYC 2017 Oct 24 - Alexis Perrier
Recomendados
Recomendados
Mais conteúdo relacionado
Semelhante a AWS Machine Learning Big Data NYC
Semelhante a AWS Machine Learning Big Data NYC (20)
Último
Último (20)
AWS Machine Learning Big Data NYC
- 3. ▸ AWS Machine Learning : predictive analytics ▸ Simple, efficient but somewhat limited ▸ Auto-ML on AWS marketplace AWS MACHINE LEARNING PLAN
- 4. DATA SCIENCE TAKE TIME AND RESOURCES
- 5. 10 FALLACIES OF DATA SCIENCE Shane Brennan https://medium.com/towards-data-science/the-ten-fallacies-of-data-science-9b2af78a1862 1. Exists 2. Accessible 3. Consistent 4. Relevant 5. Understandable 6. Processable 7. Reproducibility 8. Compliance and security 9. Results are understood 10.Expected outcomes Data scientist ROI Access Massage Train Models ProductionPresentation The plan
- 6. “AWS WANTS TO PUT MACHINE LEARNING IN REACH OF ANY DEVELOPER“ April 2015 - Techcrunch MACHINE LEARNING AS A SERVICE
- 8. AWS MACHINE LEARNING WHAT IT DOES ▸ Supervised Predictive Analytics ▸ On structured data and text, ▸ Outcome as function of variables, ground truth known on subset WHAT IT DOES NOT ▸ Unsupervised learning ▸ Reinforcement learning ▸ Deep learning
- 9. WORK FLOW - AWS ML PROJECT Create a datasource from S3, RDS or Redshift Transform the data with recipes (opt) Train a Model Evaluate Create endpoints 3 1 2 4 5
- 10. DATASOURCE AWS extracts the schema AWS analyses the data Provides simple visualization Offers default transformation S3 Redshift RDS (CLI - SDK only) 3 1 2 4
- 11. TITANIC DATASET - DEFAULT SCHEMA
- 12. TITANIC DATASET - SIMPLE ANALYSIS
- 13. SCHEMA, RECIPES AND FEATURES ▸ From the data, AWS suggests the optimal transformations - recipe ▸ 7 transformations are available ▸ Text: N-gram, Orthogonal Sparse Bigram, Lowercase, Punctuation ▸ TF-IDF by default, no stop words, no POS, Lemma, … ▸ Categorical: Cartesian product ▸ Numeric: Normalization, Quantile Binning ▸ QB: non linearities in continuous, numeric to categorical ▸ Recipe is downloadable
- 14. TITANIC DATASET - DATA TRANSFORMATION
- 15. TITANIC DATASET - DATA TRANSFORMATION
- 16. TRAIN YOUR MODEL STOCHASTIC GRADIENT DESCENT One model to rule them all ▸ Simple ▸ Regularization ▸ Epochs ▸ Shuffling ▸ That’s it!
- 17. STOCHASTIC GRADIENT DESCENT - TUNING Epochs Shuffling Regularization
- 18. Stochastic Gradient in scikit-learn
- 19. CONVERGENCE - POWERFUL QUANTILE BINNING Accuracy Accuracy
- 20. EVALUATION
- 21. EVALUATION
- 22. TEXT END POINT - STREAMING
- 23. AWS INTEGRATION
- 25. STRONG POINTS ▸ Powerful modeling: SGD + quantile binning ▸ AWS ecosystem ▸ Multiple sources (S3, RDS, Redshift) ▸ Simple to setup and use ▸ Great for benchmarking ▸ No need for production code! ▸ CLI - SDKs (python, …)
- 26. ROOM FOR IMPROVEMENTS ‣ No cross validation! ‣ Can’t export your trained models* ‣ No scripting (*) Stealing Machine Learning Models via prediction APIs http://www.cs.unc.edu/~reiter/papers/2016/USENIX.pdf ▸ Limited data visualization ▸ Limited feature engineering ▸ SGD model only: no forests, SVMs, Bayes, … ▸ No deep learning (EC2)
- 27. STILL A NEED FOR DOMAIN EXPERTISE AND FEATURE ENGINEERING GREAT TIME SAVER BUT
- 28. AUTO-ML ON AWS
- 29. Modeling is simplified But feature engineering still needs attention 3 1 2 Feature engineering Include all available datasets Feature importance
- 30. ‣ Feature importance ‣ Composite features surfacing ‣ Complementary dataset integration AUTOMATIC FEATURE ENGINEERING Smart (Not naive) Bayesian Optimization
- 31. ON AWS MARKETPLACE EC2 INSTANCE
- 32. DATA EXPLORATION - FEATURE SELECTION
- 34. AND ITERATE
- 35. + ‣ Reduced TTM + TCO ‣ Less resources ‣ Powerful benchmarking ‣ Fast iterations ‣ Holistic data integration
- 36. Jerry Hargrove @awsgeek https://www.awsgeek.com/posts/amazon-machine-learning-summary