Artificial intelligence and machine learning technologies are transforming key industries like manufacturing, finance, retail, and healthcare. Edge computing and federated learning are emerging approaches that can help address challenges around data privacy, bandwidth constraints, and latency. Edge AI runs optimized models directly on devices to analyze data and only send results rather than raw data. Federated learning leverages local AI models across edge devices to improve performance while keeping sensitive data private. Together these approaches help make AI more scalable, responsive and privacy-preserving for industries.
AI for Manufacturing (Machine Vision, Edge AI, Federated Learning)
1. 2020 Lenovo & byteLAKE public. All rights reserved.
AI for Manufacturing
Machine Vision, Edge AI, Federated Learning
Robert Daigle | AI Innovation & Business Leader, Lenovo USA
Marcin Rojek | Co Founder, byteLAKE
www.byteLAKE.com/en/Cognitive-Services
2. What is AI?
Artificial Intelligence
A program able to perform tasks
normally associated with human intelligence
Machine Learning
A program that can perform
tasks without explicit programming
Deep Learning
A program that uses
artificial neural networks
to learn data representations
and perform tasks
without explicit programming
NLP
Robotics
Vision
CatDog
Training
Dog
Training Data Model
Development
Learn
New Data
Inference
Model
Deployment
Predict
PREDICTION: Dog
CNN RNN
classificationRegression
• DL requires Large data sets for training
• DL is computationally intensive
Accelerators are typically used for training & inferencing
• 30% of AI inferencing will be at the edge
• Real-time inferencing needs low latency
moving compute closer to the data
3. Who’s leveraging AI today.
3
Enterprise Buy
Verticals SMB
Enterprise DIY
Innovators Vertical
Early Adopters
& Early Majority
• Limited skills
• Limited data curation
• Experimental DIY
• Buy solutions
Cloud
Big 10 T1 CSP
Innovators
• In-house talent
• Massive datasets
• DIY/Build solutions
• Disrupters T2 HS
Emerging Tech
OEM
Start Ups
Research
Big HPC Universities
Consumers
• AI solutions delivered
indirectly to consumers
*IDC AI Spending guide 03/2020 **McKinsey AI Adoption Survey 11/2018
18%
Production
31%
PoC
51%
Not started
Current state of
Enterprise AI
4. 2020 Lenovo & byteLAKE public. All rights reserved. 4
MANUFACTURING
FINANCE
RETAIL
HEALTH
AI is Transforming Key Industries
• Predictive Maintenance / Digital Twin
• Quality Control / Visual Inspection
• Demand forecasting
• Inventory management, supply chain & logistics
• Production line, robotics & process optimization
• Loss Prevention
• Logistics / Shelf restocking
• Omni-channel & in-store analytics
• customer engagement / sales automation
• Check-out automation
• Shopping recommendation & merchandising
• Transaction payment systems
• Credit decisions & Risk Management
• Fraud detection & Threat Intelligence
• Algorithmic trading
• Process automation
• Personalized banking / customer service & sales automation
• Regulatory intelligence
• Medical Imaging / diagnosis treatment
• Clinical decisions support (CDS)
• Customer service agents
• Process & back office automation
• Inventory mgmt, supply chain & logistics
4 industries
Account for
57% of AI
use-cases
5. The Evolution of Enterprise AI
2020 Lenovo & byteLAKE public. All rights reserved. *McKinsey 19 **IDC 20
Deep Learning
& Accelerated Computing
Edge AI
& Real-time Analytics
Federated
Learning
of AI hardware will
be at the edge.*
28%
Edge AI
By 2025
Connected devices,
generating
41M
IoT Data
of data. **
79ZB
6. Key highlights
• Algorithms optimization
– making the most of hardware components
– optimal usage of precious resources
– faster results at the lowest possible energy consumption
• Detecting shapes & patterns
• Advanced data analytics
• Sending results rather than raw, unprocessed data
What is Edge AI?
➢ highly optimized AI engines to analyze text,
image, video, sound and time series data
➢ running directly on-devices (AI inferencing)
7. ✓Enables Scalability
(Decentralizes AI services & makes it easier to expand the IoT ecosystems)
✓Enables real-time AI experience
(By using modern low power, high performance, small form factor accelerators)
✓Solves round-trip latencies
(Deploying AI directly on the device enables faster response time)
✓Eliminates intermittent connectivity related issues
(No need for sending the data from the device to external AI services and waiting for results)
✓Reduce total cost of ownership
(AI-enabled devices pre-process the data and send the results to external services vs raw data)
✓Data can stay locally on the device
(Having AI on the device allows for sending the data to external storages selectively)
Benefits of Edge AI
2020 Lenovo & byteLAKE public. All rights reserved.
9. AI is Transforming Retail
Deploying at 3000+ Retail stores
Could be due
to scan errors.
Up to
40%
Of shrinkage
Identify scan errors in Real-time
ticket switching, double scanning & mis-scanning
Improve the customer experience
Remediate errors in real-time, improving CX
Increase throughput
Address issues quicker with real-time notifications
Computer Vision
for Loss Prevention.
Over $100B a year is
lost due to shrinkage.
2020 Lenovo & byteLAKE public. All rights reserved.
11. Leverages local AI models across Edge Devices
What is AI Federated Learning?
2019 Lenovo. All rights reserved.
Federated
Learning
AI Models
Not source data
Edge AI
Inferencing
Data Privacy
Connected Edge Devices
Deriving intelligence
from device data
Improving performance
@ the edge.
Why is it important?
• Reduce network bandwidth
constraints
• Ensure privacy
• Better personalization
of predictions
16. ✓Enables Scalability
(Decentralized AI enables IoT/devices to learn from each other)
✓Solves low-throughput and high-latency challenges
(Local AI models provide real time response and lower power consumption)
✓Improves accuracy
(Have smarter models via aggregation of many local models)
✓Reduces training time
(Benefit from local training and already trained models in the neighborhood)
✓Lowers the cost of training
(Bringing data from all devices is expensive)
✓Ensures privacy
(Sensitive data stays local)
White Paper
Benefits of Federated Learning
2020 Lenovo & byteLAKE public. All rights reserved.
17. Bringing AI to manufacturing
Removing the complexity of delivering a complete solution
Data Collection
SW
Manufacturing
Quality Control
We need to improve
our quality without
slowing our
production down.
We’ll get an AI
system!
18. Bringing AI to manufacturing
Removing the complexity of delivering a complete solution
AI Consultants
SW Engineers &
AI Consultants
Data Wranglers Data Scientist AI engineer
IoT/Edge
Devices
Big Data & Data
Mgmt. SW
Big Data & Data
Mgmt. HW
Data Collection
SW
Model Dev & Mgmt. SW DevOps SW
Model Dev & Mgmt. HW DevOps HW
Find
Solution
Awareness,
Demo, PoC
Data
Collection
Extracting,
storing,
retrieving
Data
Cleaning
Cleaning,
formatting,
labeling
Model
Development
&
Management
Model
Tuning &
Retraining
Application
Development
&
Deployment
Manufacturing
Quality Control
19. Bringing AI to manufacturing
Removing the complexity of delivering a complete solution
AI Consultants
SW Engineers &
AI Consultants
Data Wranglers Data Scientist AI engineer
IoT/Edge
Devices
Big Data & Data
Mgmt. SW
Big Data & Data
Mgmt. HW
Data Collection
SW
Model Dev & Mgmt. SW DevOps SW
Model Dev & Mgmt. HW DevOps HW
Find
Solution
Awareness,
Demo, PoC
Data
Collection
Extracting,
storing,
retrieving
Data
Cleaning
Cleaning,
formatting,
labeling
Model
Development
&
Management
Model
Tuning &
Retraining
Application
Development
&
Deployment
Abstract the complexity
for our customers by
bringing together our
ecosystem of partners.
• Customized solutions
• Reduced cost of deployment
• Access to innovative technology
21. AI for Big Data
AI
Model
Train
Prepare
Finding answers hidden in Big Data
• Improve Client Experience
(analyze past interactions / behaviors to enable
personalized decisions)
• Predict outcomes and trends
(detect anomalies or suspicious behaviors, patterns
and make recommendations)
• Process Automation
(document process automation, conversational
chatbots, automating complex and repetitive tasks)
• Better Decisions
(Machine Learning, Deep Learning powered)
22. AI for Big Data, how it works
Expert System
AI Engine
AI
Model
Update Model
New data processing, calibration, improving
Train & Configure
AI model preparation, neural network configuration
Input Data
Preparation, cleaning, formatting, normalization
AI Model
Update
Time
Constant Improving
AI Engine
24. 24
AI Partners
Visual inspection for
quality control
Image diagnosis
Improving patient
care
Virtual agents
improving customer
services
Predictive
maintenance for
production up-time
Fraud detection
mitigating losses &
risk
AI use cases
We need AI!
“I read an article in
Forbes and if we don’t
have an AI strategy,
we’re going to fall
behind the
competition!”
Data sources
Additional
sources
SensorsDevices
Big Data
AI-enabled
applications
AI development
Successful AI strategy
25. byteLAKE is a bespoke AI & HPC
software company developing
dynamic solutions for enterprises.
Explore new possibilities with our
products (AI for CFD, AI OCR for
invoices w/o templates & more) and
services. www.byteLAKE.com
Learn more about byteLAKE & Lenovo
Lenovo is building comprehensive AI
solutions with our ecosystem of
partners that operate on our award-
winning AI hardware portfolio. Start
your AI journey in the Lenovo AI
Innovation Center.
www.Lenovo.com/AI
28. AI
• highly optimized AI engines to analyze
text, image, video, sound and time
series data.
• Detecting shapes & patterns.
• Complex tasks automation.
• IoT/ edge, Cloud, on-premise.
HPC
• accelerating time to results and
adapting complex algorithms to GPU,
FPGA, many-CPU architectures.
• From single nodes to clusters.
Meet byteLAKE
AI and HPC Experts Your software partner
for AI & HPC projects
Experts in adapting
& optimizing
software for
Select Products
AI for CFD.
Ultra fast results,
radically lower TCO.
New possibilities.
Objects Detection
Edge AI and real time
computer vision.
56x faster AI training.
R&I • R&D • Licensing
29. Products and Services
Cognitive AutomationEdge AI
Services
HPC
Products
CFD Suite
AI for CFD / Fluid Dynamics
Brainello
AI OCR for invoices, no templates
Ewa Guard
Machine Vision
Cognitive Services
AI for Manufacturing, Big Data
Green Computing
(FPGA, GPU)
Intelligent
Restaurant
Incubation
30. CFD Suite
Collection of innovative AI Models
for computational fluid dynamics.
byteLAKE.com/en/CFDSuite
Product Launch
November 2020
AI for CFD
Computational Fluid Dynamics
31. brainello
• Documents processing automation
• 1800 invoices processed / hour !
• No templates needed. AI powered.
• Learning over time
32. Lenovo’s AI Inference Portfolio (Edge AI)
ThinkSystem SR630
Benefits
• Tensor cores
• GPUs: 2x PCIe Gen3 singlewide
accelerators – T4
• 2x Xeon
• High speed interconnects – 200Gb
HDR, 100GbE or EDR
• Enterprise management – BMC/XCC
• NVIDIA EGX Certified - Pending
Usage:
• Computer vision, large data stream
ingest, edge environments, HCI
supporting diverse workloads,
ThinkSystem SR670 & SR650
Benefits
• Tensor cores
• 3-4x PCIe Gen3 Doublewide
Accelerators - V100 (V100S,
RTX6000 & RTX8000 in plan)
• 5-8x PCIe Gen3 singlewide
accelerators – T4
• 2x 205W Xeon SP Gen2
• High speed interconnects for
cluster/scale-out – 200Gb HDR,
100GbE or EDR
• Enterprise management – BMC/XCC
• NVIDIA NGC & EGX Certified
• LiCO Ready
Usage:
• Dense inferencing workloads in DC or
micro DC, Computer vision, large data
stream ingest, edge environments,
HCI supporting diverse workloads,
ThinkSystem SE350
Benefits
• Tensor cores
• GPU - PCIe Gen3 singlewide
accelerators – T4
• Xeon class - 16 core Xeon D
• 10GbE, Wifi & LTE connectivity
• Enterprise & remote management –
BMC/XCC
• NVIDIA EGX Certified
• Highly secure – fully encrypted &
tamper detection
• Ruggedized - up to 55°C
environment
Usage:
• Computer vision, large data stream
ingest, edge environments, HCI
supporting diverse workloads,
Tiny
Benefits
• GPU P1000
• Lower cost
• Ruggedized
Usage:
• Computer vision, data ingest,
edge environments
Nano IoT, EPC300, IoT500
Benefits
• Wired and Wireless
connectivity: WiFi / WAN
Enabled 4G/LTE/LoRa/NB-IoT
• Ruggedized: IP65 level Dust
Proof, -20-60c Extended OP
temp, MIL-STD-810G, Railway
EN50121 certified
• Fanless
• Greengrass, Win10 IoT,
Ubnuntu support
33. Lenovo’s AI Training Portfolio
ThinkStation P520
ThinkStation P920
Benefits
• LiCO Ready*
• NVIDIA NGC Certified
• Supports enterprise grade
GPUs including GV100 &
RTX 6000 & 8000
Usage
Start fast, lower cost than
cloud
*Pending LiCO support
ThinkSystem SR670
Benefits
• 4x PCIe Gen3 Doublewide Accelerators - V100
(V100S, RTX6000 & RTX8000 in plan)
• 8x PCIe Gen3 singlewide accelerators – T4
• 2x 205W Xeon SP Gen2
• High speed interconnects for cluster/scale-out
– 200Gb HDR, 100GbE or EDR
• Enterprise management – BMC/XCC
• NVIDIA NGC & EGX Certified
• LiCO Ready
• Cluster-ready Scalable solution
• Multi-user, multi-job support
Usage
ML & Deep Learning training,
ThinkSystem SR650
Benefits
• 2x PCIe Gen3 Doublewide Accelerators - V100
(V100S, RTX6000 & RTX8000 in plan)
• 5x PCIe Gen3 singlewide accelerators – T4
• 2x 205W Xeon SP Gen2
• High speed interconnects for cluster/scale-out
– 200Gb HDR, 100GbE or EDR
• Enterprise management – BMC/XCC
• LiCO Ready
• Cluster-ready Scalable solution
• Multi-user, multi-job support
Usage
Mixed workloads,
34. Lenovo ThinkSystem SR670
34
▪ Ultimate HPC/AI Building Block
▪ Modular Four GPU Server
▪ Optimized for:
▪ AI - ML/DL + VDI workloads
▪ All types of HPC Workloads
▪ New NVIDIA Tesla T4
▪ 8 GPU Support
▪ Optimized for
▪ AI Performance/$/watt
▪ Outstanding AI Inference
▪ Visualization (VDI)
▪ Expanded Support
NEW!