SlideShare uma empresa Scribd logo
1 de 26
Baixar para ler offline
TensorFlow Serving, Deep
Learning on Mobile, and
Deeplearning4j on the JVM
Sam Putnam
6/8/2017
Want to learn live in New York?
I am teaching the Deploying Deep
Learning Track at Deep Learning Conf®
Tickets are available now:
www.DeepLearningConf.com
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
Deep Learning on Mobile
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
Deeplearning4j on the JVM
Part 1 of 3
TensorFlow Serving
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Exporting Your Model
http://www.nqbao.com/blog/2017/02/tensorflow-exporting-model-for-serving/
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Question Answering at Zendesk
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Training to Production
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Inception V1 (GoogLeNet) ‘14
https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b
6/8/2017
https://www.quora.com/What-is-the-vanishing-gradient-problem
think
Oxford’s VGG 16
https://arxiv.org/pdf/1409.4842.pdf
TensorFlow Serving
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://research.googleblog.com/2016/08/improving-inception-and-image.html
6/8/2017
Inception V3 ’15 (2x deep, ~2x memory)
Softmax
https://www.youtube.com/watch?v=gNhogKJ_q7U
Part 2 of 3
Deep Learning on Mobile
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deploying TensorFlow to Android (presumably works - I
don’t know because I have an iOS device)
Deep Learning on Mobile
https://chatbotslife.com/deploying-a-tensorflow-model-to-android-69d04d1b0cba
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Inception
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
https://youtu.be/XxDbKlIomhc
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
YOLO
https://youtu.be/OUdN4srAtRA
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
MobileNets
https://youtu.be/0vBsU__JTlA
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
https://github.com/hollance/Forge
6/8/2017
http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/
MNIST (of course)
https://youtu.be/EL78-Rgoyfw
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
.dat or .bin files
https://github.com/LunarFlash/convolutional-neural-network-image-recognition
https://www.youtube.com/watch?v=EYP7099z6kk
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Speech Recognition and API call
https://github.com/marcdown/SayWhat https://www.youtube.com/watch?v=uM4Gav8Tk8A&feature=youtu.be
6/8/2017
Deep Learning on Mobile
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Live Video Captioning
https://github.com/zats/SpeechRecognition https://www.youtube.com/watch?v=Xt8o3dlH7uQ
6/8/2017
Part 3 of 3
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Deeplearning4j is a Deep Learning
Framework that runs on the JVM
https://deeplearning4j.org/
6/8/2017
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Today in the DL4j Gitter
https://gitter.im/deeplearning4j/deeplearning4j
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
DL4j Integrates with Spark for Distributed Deep Learning
https://www.slideshare.net/jpatanooga/deep-learning-with-dl4j-hadoop-summit-2015/17
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
From S3 to DL4j to Spark
https://dzone.com/articles/deep-learning-on-the-jvm
6/8/2017
Deeplearning4j on the JVM
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Python Java for Training, Java for Deploy
https://youtu.be/R3lzuXPbybY?t=5m41s
6/8/2017
Thank you
TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam
Sam@EDeepLearning.com
Thank you to Google, Yoni Tsafir, Skymind, Bat Nguyen, ZenDesk, Others
who have published diagrams and photos. Slides are for today only.
Always looking for new members & new locations in Cambridge, US or
NYC & new speakers to present on Deep Learning in Production topics
https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77
6/8/2017

Mais conteúdo relacionado

Mais procurados

A Introduction to the World of Node, Javascript & Selenium
A Introduction to the World of Node, Javascript & SeleniumA Introduction to the World of Node, Javascript & Selenium
A Introduction to the World of Node, Javascript & SeleniumJames Eisenhauer
 
Better Swift from the Foundation up #tryswiftnyc17 09-06
Better Swift from the Foundation up #tryswiftnyc17 09-06Better Swift from the Foundation up #tryswiftnyc17 09-06
Better Swift from the Foundation up #tryswiftnyc17 09-06Carl Brown
 
Write Better JavaScript
Write Better JavaScriptWrite Better JavaScript
Write Better JavaScriptKevin Whinnery
 
Cross Platform Mobile Development in C#
Cross Platform Mobile Development in C#Cross Platform Mobile Development in C#
Cross Platform Mobile Development in C#James Montemagno
 
Desenvolvimento moderno de aplicativos android
Desenvolvimento moderno de aplicativos androidDesenvolvimento moderno de aplicativos android
Desenvolvimento moderno de aplicativos androidDiego Figueredo
 
Rooted con 2020 - from the heaven to hell in the CI - CD
Rooted con 2020 - from the heaven to hell in the CI - CDRooted con 2020 - from the heaven to hell in the CI - CD
Rooted con 2020 - from the heaven to hell in the CI - CDDaniel Garcia (a.k.a cr0hn)
 
Continuous Integration @ MeetMagento Germany 2015
Continuous Integration @ MeetMagento Germany 2015Continuous Integration @ MeetMagento Germany 2015
Continuous Integration @ MeetMagento Germany 2015Aleksey Razbakov
 
Provisioning environments. A simplistic approach
Provisioning  environments. A simplistic approachProvisioning  environments. A simplistic approach
Provisioning environments. A simplistic approachEder Roger Souza
 
Prototype 151 Api
Prototype 151 ApiPrototype 151 Api
Prototype 151 Apiguestc360a2
 

Mais procurados (11)

A Introduction to the World of Node, Javascript & Selenium
A Introduction to the World of Node, Javascript & SeleniumA Introduction to the World of Node, Javascript & Selenium
A Introduction to the World of Node, Javascript & Selenium
 
Better Swift from the Foundation up #tryswiftnyc17 09-06
Better Swift from the Foundation up #tryswiftnyc17 09-06Better Swift from the Foundation up #tryswiftnyc17 09-06
Better Swift from the Foundation up #tryswiftnyc17 09-06
 
Write Better JavaScript
Write Better JavaScriptWrite Better JavaScript
Write Better JavaScript
 
12 tricks to avoid hackers breaks your CI / CD
12 tricks to avoid hackers breaks your  CI / CD12 tricks to avoid hackers breaks your  CI / CD
12 tricks to avoid hackers breaks your CI / CD
 
Cross Platform Mobile Development in C#
Cross Platform Mobile Development in C#Cross Platform Mobile Development in C#
Cross Platform Mobile Development in C#
 
Desenvolvimento moderno de aplicativos android
Desenvolvimento moderno de aplicativos androidDesenvolvimento moderno de aplicativos android
Desenvolvimento moderno de aplicativos android
 
Rooted con 2020 - from the heaven to hell in the CI - CD
Rooted con 2020 - from the heaven to hell in the CI - CDRooted con 2020 - from the heaven to hell in the CI - CD
Rooted con 2020 - from the heaven to hell in the CI - CD
 
Continuous Integration @ MeetMagento Germany 2015
Continuous Integration @ MeetMagento Germany 2015Continuous Integration @ MeetMagento Germany 2015
Continuous Integration @ MeetMagento Germany 2015
 
Provisioning environments. A simplistic approach
Provisioning  environments. A simplistic approachProvisioning  environments. A simplistic approach
Provisioning environments. A simplistic approach
 
Sonatype DevSecOps Leadership forum 2020
Sonatype DevSecOps Leadership forum 2020Sonatype DevSecOps Leadership forum 2020
Sonatype DevSecOps Leadership forum 2020
 
Prototype 151 Api
Prototype 151 ApiPrototype 151 Api
Prototype 151 Api
 

Destaque

Neural Networks with Google TensorFlow
Neural Networks with Google TensorFlowNeural Networks with Google TensorFlow
Neural Networks with Google TensorFlowDarshan Patel
 
On-device machine learning: TensorFlow on Android
On-device machine learning: TensorFlow on AndroidOn-device machine learning: TensorFlow on Android
On-device machine learning: TensorFlow on AndroidYufeng Guo
 
Introducing TensorFlow: The game changer in building "intelligent" applications
Introducing TensorFlow: The game changer in building "intelligent" applicationsIntroducing TensorFlow: The game changer in building "intelligent" applications
Introducing TensorFlow: The game changer in building "intelligent" applicationsRokesh Jankie
 
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...Andrew Gardner
 
Large Scale Deep Learning with TensorFlow
Large Scale Deep Learning with TensorFlow Large Scale Deep Learning with TensorFlow
Large Scale Deep Learning with TensorFlow Jen Aman
 

Destaque (7)

Machine Intelligence at Google Scale: TensorFlow
Machine Intelligence at Google Scale: TensorFlowMachine Intelligence at Google Scale: TensorFlow
Machine Intelligence at Google Scale: TensorFlow
 
Neural Networks with Google TensorFlow
Neural Networks with Google TensorFlowNeural Networks with Google TensorFlow
Neural Networks with Google TensorFlow
 
On-device machine learning: TensorFlow on Android
On-device machine learning: TensorFlow on AndroidOn-device machine learning: TensorFlow on Android
On-device machine learning: TensorFlow on Android
 
Introducing TensorFlow: The game changer in building "intelligent" applications
Introducing TensorFlow: The game changer in building "intelligent" applicationsIntroducing TensorFlow: The game changer in building "intelligent" applications
Introducing TensorFlow: The game changer in building "intelligent" applications
 
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
 
Large Scale Deep Learning with TensorFlow
Large Scale Deep Learning with TensorFlow Large Scale Deep Learning with TensorFlow
Large Scale Deep Learning with TensorFlow
 
Google TensorFlow Tutorial
Google TensorFlow TutorialGoogle TensorFlow Tutorial
Google TensorFlow Tutorial
 

Semelhante a TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM - Enterprise Deep Learning.pdf

Vikeshp
VikeshpVikeshp
VikeshpMdAsu1
 
[DevDay2018] Javascript on the Rise - By Trang Tran, Co-founder & Manager at ...
[DevDay2018] Javascript on the Rise - By Trang Tran, Co-founder & Manager at ...[DevDay2018] Javascript on the Rise - By Trang Tran, Co-founder & Manager at ...
[DevDay2018] Javascript on the Rise - By Trang Tran, Co-founder & Manager at ...DevDay.org
 
Groovy for Java Developers
Groovy for Java DevelopersGroovy for Java Developers
Groovy for Java DevelopersPeter Ledbrook
 
7 Reasons Why React Native Development is a Good Choice for Long – Term
7 Reasons Why React Native Development is a Good Choice for Long – Term7 Reasons Why React Native Development is a Good Choice for Long – Term
7 Reasons Why React Native Development is a Good Choice for Long – TermOrion Infosolutions
 
Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Lea...
Deploying Enterprise Deep Learning Masterclass Preview -  Enterprise Deep Lea...Deploying Enterprise Deep Learning Masterclass Preview -  Enterprise Deep Lea...
Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Lea...Sam Putnam [Deep Learning]
 
Windows Phone 7.5 Mango - What's New
Windows Phone 7.5 Mango - What's NewWindows Phone 7.5 Mango - What's New
Windows Phone 7.5 Mango - What's NewSascha Corti
 
8 Principles for Enabling Build/Measure/Learn: Lean Engineering in Action
8 Principles for Enabling Build/Measure/Learn: Lean Engineering in Action8 Principles for Enabling Build/Measure/Learn: Lean Engineering in Action
8 Principles for Enabling Build/Measure/Learn: Lean Engineering in ActionBill Scott
 
What is Django | Django Tutorial for Beginners | Python Django Training | Edu...
What is Django | Django Tutorial for Beginners | Python Django Training | Edu...What is Django | Django Tutorial for Beginners | Python Django Training | Edu...
What is Django | Django Tutorial for Beginners | Python Django Training | Edu...Edureka!
 
How to xcode in teams (without killing anyone) - #supengineering
How to xcode in teams (without killing anyone) - #supengineeringHow to xcode in teams (without killing anyone) - #supengineering
How to xcode in teams (without killing anyone) - #supengineeringJames Campbell
 
İstanbul Javaday 2017
İstanbul Javaday 2017İstanbul Javaday 2017
İstanbul Javaday 2017Erdem Gunay
 
User Group Meeting PaperVision3D
User Group Meeting PaperVision3DUser Group Meeting PaperVision3D
User Group Meeting PaperVision3DAlmog Koren
 
Follow these reasons to know java’s importance
Follow these reasons to know java’s importanceFollow these reasons to know java’s importance
Follow these reasons to know java’s importancenishajj
 
NativeScript Developer Day Keynote - Todd Anglin & Burke Holland
NativeScript Developer Day Keynote - Todd Anglin & Burke HollandNativeScript Developer Day Keynote - Todd Anglin & Burke Holland
NativeScript Developer Day Keynote - Todd Anglin & Burke HollandBrian Rinaldi
 
Deep Learning: Session 3 : How to succeed
Deep Learning: Session 3 : How to succeedDeep Learning: Session 3 : How to succeed
Deep Learning: Session 3 : How to succeedRajagopal A
 
iPhone Web Development
iPhone Web DevelopmentiPhone Web Development
iPhone Web DevelopmentAndy Peters
 
Introduction to Xamarin Development
Introduction to Xamarin DevelopmentIntroduction to Xamarin Development
Introduction to Xamarin DevelopmentIsham Mohamed Iqbal
 
Challenges and solutions for mobile application testing and continuous integr...
Challenges and solutions for mobile application testing and continuous integr...Challenges and solutions for mobile application testing and continuous integr...
Challenges and solutions for mobile application testing and continuous integr...Asaf Saar
 

Semelhante a TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM - Enterprise Deep Learning.pdf (20)

Vikeshp
VikeshpVikeshp
Vikeshp
 
[DevDay2018] Javascript on the Rise - By Trang Tran, Co-founder & Manager at ...
[DevDay2018] Javascript on the Rise - By Trang Tran, Co-founder & Manager at ...[DevDay2018] Javascript on the Rise - By Trang Tran, Co-founder & Manager at ...
[DevDay2018] Javascript on the Rise - By Trang Tran, Co-founder & Manager at ...
 
Groovy for Java Developers
Groovy for Java DevelopersGroovy for Java Developers
Groovy for Java Developers
 
7 Reasons Why React Native Development is a Good Choice for Long – Term
7 Reasons Why React Native Development is a Good Choice for Long – Term7 Reasons Why React Native Development is a Good Choice for Long – Term
7 Reasons Why React Native Development is a Good Choice for Long – Term
 
Rishabha singhcv
Rishabha singhcvRishabha singhcv
Rishabha singhcv
 
Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Lea...
Deploying Enterprise Deep Learning Masterclass Preview -  Enterprise Deep Lea...Deploying Enterprise Deep Learning Masterclass Preview -  Enterprise Deep Lea...
Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Lea...
 
Windows Phone 7.5 Mango - What's New
Windows Phone 7.5 Mango - What's NewWindows Phone 7.5 Mango - What's New
Windows Phone 7.5 Mango - What's New
 
8 Principles for Enabling Build/Measure/Learn: Lean Engineering in Action
8 Principles for Enabling Build/Measure/Learn: Lean Engineering in Action8 Principles for Enabling Build/Measure/Learn: Lean Engineering in Action
8 Principles for Enabling Build/Measure/Learn: Lean Engineering in Action
 
What is Django | Django Tutorial for Beginners | Python Django Training | Edu...
What is Django | Django Tutorial for Beginners | Python Django Training | Edu...What is Django | Django Tutorial for Beginners | Python Django Training | Edu...
What is Django | Django Tutorial for Beginners | Python Django Training | Edu...
 
Dean4j@Njug5
Dean4j@Njug5Dean4j@Njug5
Dean4j@Njug5
 
How to xcode in teams (without killing anyone) - #supengineering
How to xcode in teams (without killing anyone) - #supengineeringHow to xcode in teams (without killing anyone) - #supengineering
How to xcode in teams (without killing anyone) - #supengineering
 
İstanbul Javaday 2017
İstanbul Javaday 2017İstanbul Javaday 2017
İstanbul Javaday 2017
 
User Group Meeting PaperVision3D
User Group Meeting PaperVision3DUser Group Meeting PaperVision3D
User Group Meeting PaperVision3D
 
DevFest Kuwait 2020 - GDG Kuwait
DevFest Kuwait 2020 - GDG KuwaitDevFest Kuwait 2020 - GDG Kuwait
DevFest Kuwait 2020 - GDG Kuwait
 
Follow these reasons to know java’s importance
Follow these reasons to know java’s importanceFollow these reasons to know java’s importance
Follow these reasons to know java’s importance
 
NativeScript Developer Day Keynote - Todd Anglin & Burke Holland
NativeScript Developer Day Keynote - Todd Anglin & Burke HollandNativeScript Developer Day Keynote - Todd Anglin & Burke Holland
NativeScript Developer Day Keynote - Todd Anglin & Burke Holland
 
Deep Learning: Session 3 : How to succeed
Deep Learning: Session 3 : How to succeedDeep Learning: Session 3 : How to succeed
Deep Learning: Session 3 : How to succeed
 
iPhone Web Development
iPhone Web DevelopmentiPhone Web Development
iPhone Web Development
 
Introduction to Xamarin Development
Introduction to Xamarin DevelopmentIntroduction to Xamarin Development
Introduction to Xamarin Development
 
Challenges and solutions for mobile application testing and continuous integr...
Challenges and solutions for mobile application testing and continuous integr...Challenges and solutions for mobile application testing and continuous integr...
Challenges and solutions for mobile application testing and continuous integr...
 

Último

Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerThousandEyes
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsArshad QA
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number SystemsJheuzeDellosa
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendArshad QA
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...OnePlan Solutions
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01
 
Active Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfActive Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfCionsystems
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfkalichargn70th171
 

Último (20)

Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number Systems
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and Backend
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
Active Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfActive Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdf
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
Exploring iOS App Development: Simplifying the Process
Exploring iOS App Development: Simplifying the ProcessExploring iOS App Development: Simplifying the Process
Exploring iOS App Development: Simplifying the Process
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
 

TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM - Enterprise Deep Learning.pdf

  • 1. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017 Want to learn live in New York? I am teaching the Deploying Deep Learning Track at Deep Learning Conf® Tickets are available now: www.DeepLearningConf.com
  • 2. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017 TensorFlow Serving
  • 3. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017 Deep Learning on Mobile
  • 4. Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017 Deeplearning4j on the JVM
  • 5. Part 1 of 3 TensorFlow Serving TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017
  • 6. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Exporting Your Model http://www.nqbao.com/blog/2017/02/tensorflow-exporting-model-for-serving/ 6/8/2017
  • 7. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Question Answering at Zendesk https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b 6/8/2017
  • 8. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Training to Production https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b 6/8/2017
  • 9. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Inception V1 (GoogLeNet) ‘14 https://medium.com/zendesk-engineering/how-zendesk-serves-tensorflow-models-in-production-751ee22f0f4b 6/8/2017 https://www.quora.com/What-is-the-vanishing-gradient-problem think Oxford’s VGG 16 https://arxiv.org/pdf/1409.4842.pdf
  • 10. TensorFlow Serving TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam https://research.googleblog.com/2016/08/improving-inception-and-image.html 6/8/2017 Inception V3 ’15 (2x deep, ~2x memory) Softmax https://www.youtube.com/watch?v=gNhogKJ_q7U
  • 11. Part 2 of 3 Deep Learning on Mobile Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017
  • 12. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Deploying TensorFlow to Android (presumably works - I don’t know because I have an iOS device) Deep Learning on Mobile https://chatbotslife.com/deploying-a-tensorflow-model-to-android-69d04d1b0cba 6/8/2017
  • 13. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Inception https://github.com/hollance/Forge 6/8/2017 http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/ https://youtu.be/XxDbKlIomhc
  • 14. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam https://github.com/hollance/Forge 6/8/2017 http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/ YOLO https://youtu.be/OUdN4srAtRA
  • 15. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam https://github.com/hollance/Forge 6/8/2017 http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/ MobileNets https://youtu.be/0vBsU__JTlA
  • 16. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam https://github.com/hollance/Forge 6/8/2017 http://machinethink.net/blog/forge-neural-network-toolkit-for-metal/ MNIST (of course) https://youtu.be/EL78-Rgoyfw
  • 17. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam .dat or .bin files https://github.com/LunarFlash/convolutional-neural-network-image-recognition https://www.youtube.com/watch?v=EYP7099z6kk 6/8/2017
  • 18. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Speech Recognition and API call https://github.com/marcdown/SayWhat https://www.youtube.com/watch?v=uM4Gav8Tk8A&feature=youtu.be 6/8/2017
  • 19. Deep Learning on Mobile TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Live Video Captioning https://github.com/zats/SpeechRecognition https://www.youtube.com/watch?v=Xt8o3dlH7uQ 6/8/2017
  • 20. Part 3 of 3 Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam 6/8/2017
  • 21. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Deeplearning4j is a Deep Learning Framework that runs on the JVM https://deeplearning4j.org/ 6/8/2017
  • 22. TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Today in the DL4j Gitter https://gitter.im/deeplearning4j/deeplearning4j 6/8/2017
  • 23. Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam DL4j Integrates with Spark for Distributed Deep Learning https://www.slideshare.net/jpatanooga/deep-learning-with-dl4j-hadoop-summit-2015/17 6/8/2017
  • 24. Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam From S3 to DL4j to Spark https://dzone.com/articles/deep-learning-on-the-jvm 6/8/2017
  • 25. Deeplearning4j on the JVM TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Python Java for Training, Java for Deploy https://youtu.be/R3lzuXPbybY?t=5m41s 6/8/2017
  • 26. Thank you TensorFlow Serving, Deep Learning on Mobile, and Deeplearning4j on the JVM Sam Putnam Sam@EDeepLearning.com Thank you to Google, Yoni Tsafir, Skymind, Bat Nguyen, ZenDesk, Others who have published diagrams and photos. Slides are for today only. Always looking for new members & new locations in Cambridge, US or NYC & new speakers to present on Deep Learning in Production topics https://www.slideshare.net/anirudhkoul/squeezing-deep-learning-into-mobile-phones/77 6/8/2017