Recomendados
Recomendados
Mais conteúdo relacionado
Mais procurados
Mais procurados (17)
Semelhante a Nimbix AI Cloud and PowerAI
Semelhante a Nimbix AI Cloud and PowerAI (20)
Último
Último (20)
Nimbix AI Cloud and PowerAI
- 1. Supercomputing Made Superhuman AI Cloud and PowerAI Leo Reiter, CTO, Nimbix, Inc. 25 March 2018
- 2. About Nimbix • Founded in 2010 • “day 1” GPU accelerated on-demand compute offering • Headquartered in Dallas, TX – Customers in 68 countries • Leading global provider of turnkey, compute-intensive and accelerated cloud services (HPC and AI) • Partnered with IBM in 2016 as the first global public cloud provider to deliver turn-key service on the Minsky platform • Extending the IBM Cloud to deliver POWER9 (Q2 ‘2018) • IBM North America Leadership Award 2017 Top Strategic Service Provider – Nimbix, Inc. © 2018 Nimbix, Inc.
- 3. Nimbix’s raison d’être © 2018 Nimbix, Inc. End of Moore’s Law Insane amount of data to process (and growing)
- 4. Nimbix’s raison d’être © 2018 Nimbix, Inc. End of Moore’s Law Insane amount of data to process (and growing) Containers
- 5. Nimbix’s raison d’être © 2018 Nimbix, Inc. End of Moore’s Law Insane amount of data to process (and growing) Containers
- 6. Nimbix’s raison d’être © 2018 Nimbix, Inc. End of Moore’s Law Insane amount of data to process (and growing) Containers
- 7. Wait.. What’s “Minsky”? • OpenPOWER IBM S822LC for HPC and AI • 2 POWER 8 CPUs, 512GB+ RAM, 4x P100 GPUs, NVLink, InfiniBand • Succeeded by IBM AC922 for HPC and AI • 2 POWER 9 CPUs, 512GB+ RAM, 4x (or 6x) V100 GPUs, NVLink, InfiniBand • ORNL “Summit” HPC node, also in Nimbix Cloud! • Which means? Linear scale with insane bandwidth and incredibly low latency! • Just “slide right” in the Nimbix Cloud to scale out © 2018 Nimbix, Inc.
- 8. Wait.. What’s HPC got to do with AI? A LOT! HPC and AI are converging, thanks to the benefits of tightly coupled scale-out training and low latency fabrics More on this later… © 2018 Nimbix, Inc.
- 9. AI Explained (and demystified) What? compute that recognizes an input as part of a class or category and then responds with an action © 2018 Nimbix, Inc.
- 10. AI Explained (and demystified) What? compute that recognizes an input as part of a class or category and then responds with an action How? Learning(training) and inference(recommendation) © 2018 Nimbix, Inc.
- 11. AI Explained (and demystified) What? compute that recognizes an input as part of a class or category and then responds with an action How? Learning(training) and inference(recommendation) Why now? Data size, scope, velocity, variability © 2018 Nimbix, Inc.
- 12. AI Explained (and demystified) What? compute that recognizes an input as part of a class or category and then responds with an action How? Learning(training) and inference(recommendation) Why now? Data size, scope, velocity, variability What’s it for? Everything from recommending products to identifying handwriting and more © 2018 Nimbix, Inc.
- 13. AI Explained (and demystified) What? compute that recognizes an input as part of a class or category and then responds with an action How? Learning(training) and inference(recommendation) Why now? Data size, scope, velocity, variability What’s it for? Everything from recommending products to identifying handwriting and more Cloud is a powerful enablement platform for AI! © 2018 Nimbix, Inc.
- 14. Strong AI vs Weak AI Strong AI: • Consciousness • Sentience • Artificial Life • Generally topics of dystopian science fiction • For the time being, best left to Hollywood and futurists. © 2018 Nimbix, Inc.
- 15. Strong AI vs Weak AI Weak AI – Narrow AI • Narrowly focused in terms of topic and ability • No intelligence, self-awareness, or creativity • Able to solve a pre-defined set of problems in a prescribed manner © 2018 Nimbix, Inc.
- 16. 2018 is About [Narrow] AI © 2018 Nimbix, Inc. From Gartner’s Top 10 Strategic Technology Trends for 2018: AI Foundations: • “Narrow AI” – highly scoped machine-learning solutions that target specific tasks Intelligent Apps and Analytics: • Over the next few years every application and service will incorporate AI at some level • Key to augmenting and increasing productivity, not replacing people Source: https://www.gartner.com/smarterwithgartner/gartner-top-10-strategic-technology-trends-for-2018/
- 17. Narrow AI Goodness © 2018 Nimbix, Inc. Won’t hunt us down from the future
- 18. Narrow AI Goodness © 2018 Nimbix, Inc. Won’t hunt us down from the future Won’t kill the crew to “save the mission”
- 19. Narrow AI Goodness © 2018 Nimbix, Inc. Won’t hunt us down from the future Won’t kill the crew to save the mission Won’t enslave us in a simulation to harvest us for energy
- 20. Narrow AI Goodness Won’t hunt us down from the future Won’t kill the crew to save the mission Won’t enslave us in a simulation to harvest us for energy Won’t replace human beings! © 2018 Nimbix, Inc.
- 21. Narrow AI Goodness Will unleash human innovation by: Augmenting human abilities • Automate the mundane, let us focus on higher order stuff Making our daily lives easier • Process data for us, recommend what we should do about it Making our lives safer • Identify dangers and warn us • Take careful action quickly • Remember: machines fail when they break, but humans fail all the time © 2018 Nimbix, Inc. More on this here: http://www.leoreiter.com/2018/02/limits-automation-comes-next/
- 22. AI Infrastructure on Nimbix Cloud • IBM POWER with PowerAI • Vertically integrated for high bandwidth, low latency, and scale-out • IBM PowerAI • NVIDIA DGX • High density x86-based GPUs with scale-out capabilities • NVIDIA optimized software catalog • x86 CPUs (including Skylake) • Scale-out capabilities and economics for testing and inference • Xilinx FPGAs • Low latency, reduced precision inference capabilities (coming soon) • Xilinx SDAccel tools for OpenCL development © 2018 Nimbix, Inc.
- 23. You Can Build the Future, End-to-End Trained in cloud GPUs Tested on cloud FPGA, Deployed on edge FPGA © 2018 Nimbix, Inc.
- 24. AI Software Catalog on Nimbix Cloud © 2018 Nimbix, Inc. • Dozens of turnkey, point-and click workflows • Extensible with PushToCompute™
- 25. PowerAI on Nimbix Vertically integrated systems for AI unleashed on the first and only vertically integrated cloud for AI and HPC © 2018 Nimbix, Inc. + + The “no compromise” combination for AI research, extensible development, and production at scale
- 26. PowerAI on Nimbix: No Compromise • Fastest AI Architecture • IBM “Minsky” and POWER9 • P100 and V100 GPUs • NVLink (keeps GPU memory fed) • DDL • Large memory • JARVICE runs work on bare-metal – native speed, no overhead © 2018 Nimbix, Inc.
- 27. PowerAI on Nimbix: No Compromise • Fastest AI Architecture • Supercomputing performance • Nimbix Cloud HPC architecture with Reconfigurable Cloud Computing • JARVICE supercomputing cloud operating system • Containers on bare-metal • InfiniBand fabric • GPUs (with NVLink) and FPGAs © 2018 Nimbix, Inc.
- 28. PowerAI on Nimbix: No Compromise • Fastest AI Architecture • Supercomputing performance • Containerized and extensible • Docker base images • Open source tools in GitHub • Developer community • Rich documentation and examples • Nimbix and partner sources • CI/CD for POWER © 2018 Nimbix, Inc.
- 29. One AI Cloud, All of Your Needs © 2018 Nimbix, Inc. • Research • Analysis
- 30. One AI Cloud, All of Your Needs © 2018 Nimbix, Inc. • Research • Analysis • Algorithm Development • Training with DDL
- 31. One AI Cloud, All of Your Needs © 2018 Nimbix, Inc. • Research • Analysis • Algorithm Development • Training with DDL • Custom Workflows • App Development (ISV)
- 32. Case Study: OSU Cowen Lab • Project collects water column image samples at sea • Preprocessing on Minsky aboard ship (100+TB data to 3+TB) • Cloud to Edge Architecture • PowerAI in Nimbix Cloud used to identify gnus species of plankton: • Indicates effects of ocean temperature, salinity climate change • Results: • 10x faster processing than on other clouds • Modern containerized deployment easier to manage than IaaS © 2018 Nimbix, Inc.
- 33. • Driver awareness/fatigue monitoring via onboard camera • Facial recognition software in cars • Dubai taxi • Dubai police • Route monitoring for armored cars via onboard cameras • Dubai armored car delivery, ensure parcels delivered and routes • Identifies parcels/bags • Identifies things going in and out of truck • Compares against manifest • Human trafficking detection in Libya Examines eye movement to determine distracted/fatigued driving Anti-theft, anti-shrinkage, loss prevention Use Case: Acacus – Transportation in MEA © 2018 Nimbix, Inc.
- 34. Others… • Large consulting company using Nimbix Cloud to develop voice/speech recognition models for call centers • Multi-national training group using Nimbix Cloud to teach AI courses and computing courses • National Institutes of Health using Nimbix Cloud to develop automated diagnostics based upon image classification and recognition © 2018 Nimbix, Inc.
- 35. Example: NPAs in Indian Market OpenPOWER Academia team prototype with PowerAI on Nimbix Cloud highlights: • Data preparation • DL frameworks • Neural network design • Model accuracy and training © 2018 Nimbix, Inc.
- 36. Example: NPAs in Indian Market © 2018 Nimbix, Inc.
- 37. Coming Soon… • Launch PowerAI from the IBM Cloud: • Use your IBM account to purchase PowerAI on powerful, point-and-click simple Nimbix infrastructure • Access existing training data from IBM Cloud Object Storage (COS), with no transfer fees Available Q2 2018 – US South Region, with future global expansion © 2018 Nimbix, Inc.
- 38. Thank you Freedom to: • Discover • Invent • “Game-change” • Without fighting platforms and tools • And without compromise PowerAI on the Nimbix Cloud! © 2018 Nimbix, Inc. https://developer.ibm.com/linuxonpower/deep-learning-powerai/try-powerai/
Notas do Editor
- I’m technologist, not a scientist, but I design and enable technology for human beings, including scientists I’m from Texas – we do actually have technology there
- No platform out there to address this problem in an efficient way Moore’s law as it applies to scale up Data processing and analytics (big data) was en vogue at the time, but this gradually morphed into data science and AI
- - 3 principles - Self-service, on-demand Cloud to democratize
- Sim, oil+gas, media, biocomputing, ML/DL, analytics
- Define to avoid THINK question at end!
- Mention 10% or so of the use cases on Summit will be AI
- So just in case I make it to the end and someone asks “what’s AI”…
- Admit this deep learning focused
- Of course self driving cars never kill drivers nor hit pedestrians, that must just be a sick joke
- A lot of cultural and socioeconomic anxiety about this
- Self driving cars killing people aside, we’ll see examples of AI used to identify safety violations in work sites, predict equipment failures, etc.
- - Choice, in a nutshell (can’t democratize without offering choice) All these rival system architectures coexist and are user selectable at runtime for just about any workflow, or part of a broader workflow E.g. you wouldn’t use FPGA’s for training neural networks, but they sure can help with low latency inference on real-time data
- Edge may be self driving car, mobile device, etc.
- In 2018 nothing interesting really happens without software, so… If you can write a Dockerfile, you can customize any workflow or build your own from scratch You can even deploy your custom workflows in the marketplace and make money off of them if you like (assuming someone finds them interesting enough to pay for)
- Talk about 50% utilization on GPUs
- Talk about GPU direct RDMA as well
- Species identification indicates salinity and temperature and is used to study effects of climate change
- Very strategic