The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM - Enterprise Deep Learning.pdf
1. TensorFlow Serving, Deep
Learning on Mobile, and
Deeplearning4j on the JVM
Sam Putnam
6/8/2017
Want to learn live in New York?
I am teaching the Deploying Deep
Learning Track at Deep Learning Conf®
Tickets are available now:
www.DeepLearningConf.com
3. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
Deep Learning on Mobile
4. Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
Deeplearning4j on the JVM
5. Part 1 of 3
TensorFlow Serving
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
6. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Exporting Your Model
http://www.nqbao.com/blog/2017/02/tensorflow-exporting-model-for-serving/
6/8/2017
7. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Question Answering at Zendesk
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
8. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Training to Production
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
9. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Inception V1 (GoogLeNet) ‘14
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
https://www.quora.com/What-is-the-vanishing-gradient-problem
think
Oxford’s VGG 16
https://arxiv.org/pdf/1409.4842.pdf
10. TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://research.googleblog.com/2016/08/improving-inception-and-image.html
6/8/2017
Inception V3 ’15 (2x deep, ~2x memory)
Softmax
https://www.youtube.com/watch?v=gNhogKJ_q7U
11. Part 2 of 3
Deep Learning on Mobile
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
12. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deploying TensorFlow to Android (presumably works - I
don’t know because I have an iOS device)
Deep Learning on Mobile
https://chatbotslife.com/deploying-a-tensorflow-model-to-android-69d04d1b0cba
6/8/2017
13. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Inception
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
https://youtu.be/XxDbKlIomhc
14. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
YOLO
https://youtu.be/OUdN4srAtRA
15. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
MobileNets
https://youtu.be/0vBsU__JTlA
16. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
MNIST (of course)
https://youtu.be/EL78-Rgoyfw
17. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
.dat or .bin files
https://github.com/LunarFlash/convolutional-neural-network-image-recognition
https://www.youtube.com/watch?v=EYP7099z6kk
6/8/2017
18. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Speech Recognition and API call
https://github.com/marcdown/SayWhat https://www.youtube.com/watch?v=uM4Gav8Tk8A&feature=youtu.be
6/8/2017
19. Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Live Video Captioning
https://github.com/zats/SpeechRecognition https://www.youtube.com/watch?v=Xt8o3dlH7uQ
6/8/2017
20. Part 3 of 3
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
21. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deeplearning4j is a Deep Learning
Framework that runs on the JVM
https://deeplearning4j.org/
6/8/2017
22. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Today in the DL4j Gitter
https://gitter.im/deeplearning4j/deeplearning4j
6/8/2017
23. Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
DL4j Integrates with Spark for Distributed Deep Learning
https://www.slideshare.net/jpatanooga/deep-learning-with-dl4j-hadoop-summit-2015/17
6/8/2017
24. Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
From S3 to DL4j to Spark
https://dzone.com/articles/deep-learning-on-the-jvm
6/8/2017
25. Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Python Java for Training, Java for Deploy
https://youtu.be/R3lzuXPbybY?t=5m41s
6/8/2017
26. Thank you
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Sam@EDeepLearning.com
Thank you to Google, Yoni Tsafir, Skymind, Bat Nguyen, ZenDesk, Others
who have published diagrams and photos. Slides are for today only.
Always looking for new members & new locations in Cambridge, US or
NYC & new speakers to present on Deep Learning in Production topics
https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77
6/8/2017