SlideShare uma empresa Scribd logo
1 de 16
Baixar para ler offline
FPGA-BasedSensorIntegration
andCommunicationProtocols
forAutomatedRobotControlin
LinearWelding
Cristiano Steffens,Valquíria Hüttner, Bruno Leonardo,
Vagner Rosa, and Silvia Silva da Costa Botelho
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
1
Universidade Federal do
Rio Grande – FURG
Centro de Ciências
Computacionais
Introduction
 What?
 Linear Welding robotization through MachineVision
 Programmable Logic
 Why?
 Linear Welding activities can not be programmed
 Teach and Playback is not an option
 Welding is an unhealthy work
 Goals
 Robot control / Automated Actuation
 Power source and wire feed control
 Vision Based Measurement system
 Runtime recognition of the groove dimensions and welding
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
2
Typical linear
welding robot
installation
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
3
Operational
prototype
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
4
Sensors
 Continuous Rotation Potentiometers
 Hall Effect Encoders
 Optical Encoders
 VoltageTransducer
 CurrentTransducer
 Camera (5MP)
 Analog Signals are decoded using an 8-bit ADC
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
5
Overview of
DigitalControl
System
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
6
ImageCapture
Module
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
7
Image
Preprocessing
Module
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
8
SDRAM
Control
Module
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
9
Modbus
protocol
structure
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
10
Results:
Compilation
Report
Specification Description
FPGA Device EP4CE22F17C6
Total Logic Elements 6,351 / 22,320 (28%)
Combinational Functions 5,720 / 22,320 (26%)
Dedicated logic registers 3,378 / 22,320 (15%)
FPGA PLLs 1/4 (24%)
I/O pins (external) 111 / 154 (72%)
Embedded Multiplier 9-bit 0 / 132 (0%)
Total memory bits 42,992 / 608,256(7%)
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
11
Results:
Image
Processing
throughout
theVBM
system
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
12
Results:
Measurement
[mm] of the
VBM system
when applied
to a ½ inch
thick steel
plate
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
13
Estimated
Production
Costs
Description USD
DE0-Nano Development and Education Board 79,00
5 Mega Pixel DigitalCamera Package 80,00
SparkFun FTDI Basic Breakout 15,00
Raspberry Pi 2 Model B + SD Card 60,00
Shielded Cables andTerminals 200,00
Discrete Electronic Components 100,00
Shields and Cases 150,00
Software Licences 0,00
Total 684,00
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
14
What’s next?
 Closed Loop control of the welding parameters
 Improved actuation (PID or RMRAC)
 Floating Point Operations
 Electrical Protection
 Mechanical Protection
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding
15
Thank you!
FPGA-Based Sensor Integration and Communication Protocols for
Automated Robot Control in LinearWelding
CristianoSteffens@furg.br
Thanks to:
10/13/2016
FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in
Linear Welding 16

Mais conteúdo relacionado

Semelhante a FPGA-based sensor integration and communication protocols for automated

IRJET - Toll and Vehicle Rules Automation System
IRJET - Toll and Vehicle Rules Automation SystemIRJET - Toll and Vehicle Rules Automation System
IRJET - Toll and Vehicle Rules Automation SystemIRJET Journal
 
Petrol Pipe Line Telemonitoring Design
Petrol Pipe Line Telemonitoring DesignPetrol Pipe Line Telemonitoring Design
Petrol Pipe Line Telemonitoring DesignIJERA Editor
 
Final presentation [dissertation project], 20192 esv0002
Final presentation [dissertation project], 20192 esv0002Final presentation [dissertation project], 20192 esv0002
Final presentation [dissertation project], 20192 esv0002MOHAMMED FURQHAN
 
E-License System With RTO Controle Room Management System
E-License System With RTO Controle Room Management SystemE-License System With RTO Controle Room Management System
E-License System With RTO Controle Room Management SystemIRJET Journal
 
IRJET- IoT Based E-Challan Automation for RTO using RFID
IRJET-  	  IoT Based E-Challan Automation for RTO using RFIDIRJET-  	  IoT Based E-Challan Automation for RTO using RFID
IRJET- IoT Based E-Challan Automation for RTO using RFIDIRJET Journal
 
IRJET- Vehicle Accident Prevention System
IRJET-  	  Vehicle Accident Prevention SystemIRJET-  	  Vehicle Accident Prevention System
IRJET- Vehicle Accident Prevention SystemIRJET Journal
 
IRJET- Building Monitoring using Wireless System
IRJET- Building Monitoring using Wireless SystemIRJET- Building Monitoring using Wireless System
IRJET- Building Monitoring using Wireless SystemIRJET Journal
 
AURORA-Well Monitoring.pdf
AURORA-Well Monitoring.pdfAURORA-Well Monitoring.pdf
AURORA-Well Monitoring.pdfssuser905b17
 
IED-Aurora-SRP.pdf
IED-Aurora-SRP.pdfIED-Aurora-SRP.pdf
IED-Aurora-SRP.pdfssuser905b17
 
IRJET- Design and Implementation of PID Controller using HDL on FPGA
IRJET- 	  Design and Implementation of PID Controller using HDL on FPGAIRJET- 	  Design and Implementation of PID Controller using HDL on FPGA
IRJET- Design and Implementation of PID Controller using HDL on FPGAIRJET Journal
 
IRJET- Design and Implementation of High Speed FPGA Configuration using SBI
IRJET- Design and Implementation of High Speed FPGA Configuration using SBIIRJET- Design and Implementation of High Speed FPGA Configuration using SBI
IRJET- Design and Implementation of High Speed FPGA Configuration using SBIIRJET Journal
 
Robotics Coursecntnt
Robotics CoursecntntRobotics Coursecntnt
Robotics CoursecntntAhamed Satham
 
Virtual Twins: Modeling Trends and Challenges Ahead
Virtual Twins: Modeling Trends and Challenges AheadVirtual Twins: Modeling Trends and Challenges Ahead
Virtual Twins: Modeling Trends and Challenges AheadBrain IoT Project
 
Basics of PLC
Basics of PLCBasics of PLC
Basics of PLCmohit oza
 
Automated Driving Test and Issuing Of Driving Licenses
Automated Driving Test and Issuing Of Driving LicensesAutomated Driving Test and Issuing Of Driving Licenses
Automated Driving Test and Issuing Of Driving LicensesIRJET Journal
 
Vlsics040307DESIGN AND IMPLEMENTATION OF CAR PARKING SYSTEM ON FPGA
Vlsics040307DESIGN AND IMPLEMENTATION OF CAR PARKING SYSTEM ON FPGAVlsics040307DESIGN AND IMPLEMENTATION OF CAR PARKING SYSTEM ON FPGA
Vlsics040307DESIGN AND IMPLEMENTATION OF CAR PARKING SYSTEM ON FPGAVLSICS Design
 
Webinar on PROFIBUS Network Maintenance
Webinar on PROFIBUS Network MaintenanceWebinar on PROFIBUS Network Maintenance
Webinar on PROFIBUS Network MaintenanceSadatulla Zishan
 

Semelhante a FPGA-based sensor integration and communication protocols for automated (20)

IRJET - Toll and Vehicle Rules Automation System
IRJET - Toll and Vehicle Rules Automation SystemIRJET - Toll and Vehicle Rules Automation System
IRJET - Toll and Vehicle Rules Automation System
 
Petrol Pipe Line Telemonitoring Design
Petrol Pipe Line Telemonitoring DesignPetrol Pipe Line Telemonitoring Design
Petrol Pipe Line Telemonitoring Design
 
Ullas_CV
Ullas_CVUllas_CV
Ullas_CV
 
PROFINET network diagnostics and support - May 2020 - Peter Thomas
PROFINET network diagnostics and support - May 2020 - Peter ThomasPROFINET network diagnostics and support - May 2020 - Peter Thomas
PROFINET network diagnostics and support - May 2020 - Peter Thomas
 
Final presentation [dissertation project], 20192 esv0002
Final presentation [dissertation project], 20192 esv0002Final presentation [dissertation project], 20192 esv0002
Final presentation [dissertation project], 20192 esv0002
 
E-License System With RTO Controle Room Management System
E-License System With RTO Controle Room Management SystemE-License System With RTO Controle Room Management System
E-License System With RTO Controle Room Management System
 
IRJET- IoT Based E-Challan Automation for RTO using RFID
IRJET-  	  IoT Based E-Challan Automation for RTO using RFIDIRJET-  	  IoT Based E-Challan Automation for RTO using RFID
IRJET- IoT Based E-Challan Automation for RTO using RFID
 
IRJET- Vehicle Accident Prevention System
IRJET-  	  Vehicle Accident Prevention SystemIRJET-  	  Vehicle Accident Prevention System
IRJET- Vehicle Accident Prevention System
 
IRJET- Building Monitoring using Wireless System
IRJET- Building Monitoring using Wireless SystemIRJET- Building Monitoring using Wireless System
IRJET- Building Monitoring using Wireless System
 
AURORA-Well Monitoring.pdf
AURORA-Well Monitoring.pdfAURORA-Well Monitoring.pdf
AURORA-Well Monitoring.pdf
 
IED-Aurora-SRP.pdf
IED-Aurora-SRP.pdfIED-Aurora-SRP.pdf
IED-Aurora-SRP.pdf
 
IRJET- Design and Implementation of PID Controller using HDL on FPGA
IRJET- 	  Design and Implementation of PID Controller using HDL on FPGAIRJET- 	  Design and Implementation of PID Controller using HDL on FPGA
IRJET- Design and Implementation of PID Controller using HDL on FPGA
 
IRJET- Design and Implementation of High Speed FPGA Configuration using SBI
IRJET- Design and Implementation of High Speed FPGA Configuration using SBIIRJET- Design and Implementation of High Speed FPGA Configuration using SBI
IRJET- Design and Implementation of High Speed FPGA Configuration using SBI
 
Robotics Coursecntnt
Robotics CoursecntntRobotics Coursecntnt
Robotics Coursecntnt
 
Virtual Twins: Modeling Trends and Challenges Ahead
Virtual Twins: Modeling Trends and Challenges AheadVirtual Twins: Modeling Trends and Challenges Ahead
Virtual Twins: Modeling Trends and Challenges Ahead
 
3160914
31609143160914
3160914
 
Basics of PLC
Basics of PLCBasics of PLC
Basics of PLC
 
Automated Driving Test and Issuing Of Driving Licenses
Automated Driving Test and Issuing Of Driving LicensesAutomated Driving Test and Issuing Of Driving Licenses
Automated Driving Test and Issuing Of Driving Licenses
 
Vlsics040307DESIGN AND IMPLEMENTATION OF CAR PARKING SYSTEM ON FPGA
Vlsics040307DESIGN AND IMPLEMENTATION OF CAR PARKING SYSTEM ON FPGAVlsics040307DESIGN AND IMPLEMENTATION OF CAR PARKING SYSTEM ON FPGA
Vlsics040307DESIGN AND IMPLEMENTATION OF CAR PARKING SYSTEM ON FPGA
 
Webinar on PROFIBUS Network Maintenance
Webinar on PROFIBUS Network MaintenanceWebinar on PROFIBUS Network Maintenance
Webinar on PROFIBUS Network Maintenance
 

Mais de Cristiano Rafael Steffens

CONVOLUTIONAL NEURAL NETWORKS: The workhorse of image and video
CONVOLUTIONAL NEURAL NETWORKS: The workhorse of image and videoCONVOLUTIONAL NEURAL NETWORKS: The workhorse of image and video
CONVOLUTIONAL NEURAL NETWORKS: The workhorse of image and videoCristiano Rafael Steffens
 
A pipelined approach to deal with image distortion in computer vision - BRACI...
A pipelined approach to deal with image distortion in computer vision - BRACI...A pipelined approach to deal with image distortion in computer vision - BRACI...
A pipelined approach to deal with image distortion in computer vision - BRACI...Cristiano Rafael Steffens
 
A CNN BASED MODEL TO RESTORE ILL EXPOSED IMAGES
A CNN BASED MODEL TO RESTORE ILL EXPOSED IMAGESA CNN BASED MODEL TO RESTORE ILL EXPOSED IMAGES
A CNN BASED MODEL TO RESTORE ILL EXPOSED IMAGESCristiano Rafael Steffens
 
Can Exposure, Noise and Compression affect Image Recognition? An Assessment o...
Can Exposure, Noise and Compression affect Image Recognition? An Assessment o...Can Exposure, Noise and Compression affect Image Recognition? An Assessment o...
Can Exposure, Noise and Compression affect Image Recognition? An Assessment o...Cristiano Rafael Steffens
 
MODELAGEM DAS DINÂMICAS DA FORMAÇÃO DA GOTA E TRANSFERÊNCIA DE MASSA EM PROCE...
MODELAGEM DAS DINÂMICAS DA FORMAÇÃO DA GOTA E TRANSFERÊNCIA DE MASSA EM PROCE...MODELAGEM DAS DINÂMICAS DA FORMAÇÃO DA GOTA E TRANSFERÊNCIA DE MASSA EM PROCE...
MODELAGEM DAS DINÂMICAS DA FORMAÇÃO DA GOTA E TRANSFERÊNCIA DE MASSA EM PROCE...Cristiano Rafael Steffens
 
UMA ABORDAGEM COMPARATIVA ENTRE MICROCONTROLADORES: ARDUINO MEGA X ARDUINO DU...
UMA ABORDAGEM COMPARATIVA ENTRE MICROCONTROLADORES: ARDUINO MEGA X ARDUINO DU...UMA ABORDAGEM COMPARATIVA ENTRE MICROCONTROLADORES: ARDUINO MEGA X ARDUINO DU...
UMA ABORDAGEM COMPARATIVA ENTRE MICROCONTROLADORES: ARDUINO MEGA X ARDUINO DU...Cristiano Rafael Steffens
 
Lars 2016 A Texture Driven Approach for Visible Spectrum Fire Detection
Lars 2016 A Texture Driven Approach for Visible Spectrum Fire DetectionLars 2016 A Texture Driven Approach for Visible Spectrum Fire Detection
Lars 2016 A Texture Driven Approach for Visible Spectrum Fire DetectionCristiano Rafael Steffens
 
ICRA 2016 - Interactive section Presentation
ICRA 2016 - Interactive section PresentationICRA 2016 - Interactive section Presentation
ICRA 2016 - Interactive section PresentationCristiano Rafael Steffens
 
Vision-Based System for Welding Groove Measurements for Robotic Welding Appli...
Vision-Based System for Welding Groove Measurements for Robotic Welding Appli...Vision-Based System for Welding Groove Measurements for Robotic Welding Appli...
Vision-Based System for Welding Groove Measurements for Robotic Welding Appli...Cristiano Rafael Steffens
 
Simpósio Unicruz: OpenCV + Python (parte 1)
Simpósio Unicruz: OpenCV + Python (parte 1)Simpósio Unicruz: OpenCV + Python (parte 1)
Simpósio Unicruz: OpenCV + Python (parte 1)Cristiano Rafael Steffens
 
Welding Groove Mapping: Image Acquisition and Processing on Shiny Surfaces - ...
Welding Groove Mapping: Image Acquisition and Processing on Shiny Surfaces - ...Welding Groove Mapping: Image Acquisition and Processing on Shiny Surfaces - ...
Welding Groove Mapping: Image Acquisition and Processing on Shiny Surfaces - ...Cristiano Rafael Steffens
 
Automated control module based on VBM for shipyard welding applications: Stud...
Automated control module based on VBM for shipyard welding applications: Stud...Automated control module based on VBM for shipyard welding applications: Stud...
Automated control module based on VBM for shipyard welding applications: Stud...Cristiano Rafael Steffens
 
An Unconstrained Dataset for Non-stationary Video Based Fire Detection
An Unconstrained Dataset for Non-stationary Video Based Fire DetectionAn Unconstrained Dataset for Non-stationary Video Based Fire Detection
An Unconstrained Dataset for Non-stationary Video Based Fire DetectionCristiano Rafael Steffens
 
Introdução ao processamento de imagens com OpenCV (cont)
Introdução ao processamento de imagens com OpenCV (cont)Introdução ao processamento de imagens com OpenCV (cont)
Introdução ao processamento de imagens com OpenCV (cont)Cristiano Rafael Steffens
 
Um Sistema De Detecção De Fogo Baseado Em Vídeo
Um Sistema De Detecção De Fogo Baseado Em VídeoUm Sistema De Detecção De Fogo Baseado Em Vídeo
Um Sistema De Detecção De Fogo Baseado Em VídeoCristiano Rafael Steffens
 
Um sistema de detecção de chamas utilizando RF e SVM (Short Version)
Um sistema de detecção de chamas utilizando RF e SVM (Short Version)Um sistema de detecção de chamas utilizando RF e SVM (Short Version)
Um sistema de detecção de chamas utilizando RF e SVM (Short Version)Cristiano Rafael Steffens
 

Mais de Cristiano Rafael Steffens (20)

CONVOLUTIONAL NEURAL NETWORKS: The workhorse of image and video
CONVOLUTIONAL NEURAL NETWORKS: The workhorse of image and videoCONVOLUTIONAL NEURAL NETWORKS: The workhorse of image and video
CONVOLUTIONAL NEURAL NETWORKS: The workhorse of image and video
 
A pipelined approach to deal with image distortion in computer vision - BRACI...
A pipelined approach to deal with image distortion in computer vision - BRACI...A pipelined approach to deal with image distortion in computer vision - BRACI...
A pipelined approach to deal with image distortion in computer vision - BRACI...
 
A CNN BASED MODEL TO RESTORE ILL EXPOSED IMAGES
A CNN BASED MODEL TO RESTORE ILL EXPOSED IMAGESA CNN BASED MODEL TO RESTORE ILL EXPOSED IMAGES
A CNN BASED MODEL TO RESTORE ILL EXPOSED IMAGES
 
Can Exposure, Noise and Compression affect Image Recognition? An Assessment o...
Can Exposure, Noise and Compression affect Image Recognition? An Assessment o...Can Exposure, Noise and Compression affect Image Recognition? An Assessment o...
Can Exposure, Noise and Compression affect Image Recognition? An Assessment o...
 
MODELAGEM DAS DINÂMICAS DA FORMAÇÃO DA GOTA E TRANSFERÊNCIA DE MASSA EM PROCE...
MODELAGEM DAS DINÂMICAS DA FORMAÇÃO DA GOTA E TRANSFERÊNCIA DE MASSA EM PROCE...MODELAGEM DAS DINÂMICAS DA FORMAÇÃO DA GOTA E TRANSFERÊNCIA DE MASSA EM PROCE...
MODELAGEM DAS DINÂMICAS DA FORMAÇÃO DA GOTA E TRANSFERÊNCIA DE MASSA EM PROCE...
 
UMA ABORDAGEM COMPARATIVA ENTRE MICROCONTROLADORES: ARDUINO MEGA X ARDUINO DU...
UMA ABORDAGEM COMPARATIVA ENTRE MICROCONTROLADORES: ARDUINO MEGA X ARDUINO DU...UMA ABORDAGEM COMPARATIVA ENTRE MICROCONTROLADORES: ARDUINO MEGA X ARDUINO DU...
UMA ABORDAGEM COMPARATIVA ENTRE MICROCONTROLADORES: ARDUINO MEGA X ARDUINO DU...
 
Lars 2016 A Texture Driven Approach for Visible Spectrum Fire Detection
Lars 2016 A Texture Driven Approach for Visible Spectrum Fire DetectionLars 2016 A Texture Driven Approach for Visible Spectrum Fire Detection
Lars 2016 A Texture Driven Approach for Visible Spectrum Fire Detection
 
Php Math and arrays
Php Math and arraysPhp Math and arrays
Php Math and arrays
 
ICRA 2016 - Interactive section Presentation
ICRA 2016 - Interactive section PresentationICRA 2016 - Interactive section Presentation
ICRA 2016 - Interactive section Presentation
 
Vision-Based System for Welding Groove Measurements for Robotic Welding Appli...
Vision-Based System for Welding Groove Measurements for Robotic Welding Appli...Vision-Based System for Welding Groove Measurements for Robotic Welding Appli...
Vision-Based System for Welding Groove Measurements for Robotic Welding Appli...
 
Simpósio Unicruz: OpenCV + Python (parte 1)
Simpósio Unicruz: OpenCV + Python (parte 1)Simpósio Unicruz: OpenCV + Python (parte 1)
Simpósio Unicruz: OpenCV + Python (parte 1)
 
Welding Groove Mapping: Image Acquisition and Processing on Shiny Surfaces - ...
Welding Groove Mapping: Image Acquisition and Processing on Shiny Surfaces - ...Welding Groove Mapping: Image Acquisition and Processing on Shiny Surfaces - ...
Welding Groove Mapping: Image Acquisition and Processing on Shiny Surfaces - ...
 
Automated control module based on VBM for shipyard welding applications: Stud...
Automated control module based on VBM for shipyard welding applications: Stud...Automated control module based on VBM for shipyard welding applications: Stud...
Automated control module based on VBM for shipyard welding applications: Stud...
 
An Unconstrained Dataset for Non-stationary Video Based Fire Detection
An Unconstrained Dataset for Non-stationary Video Based Fire DetectionAn Unconstrained Dataset for Non-stationary Video Based Fire Detection
An Unconstrained Dataset for Non-stationary Video Based Fire Detection
 
Introdução ao processamento de imagens com OpenCV (cont)
Introdução ao processamento de imagens com OpenCV (cont)Introdução ao processamento de imagens com OpenCV (cont)
Introdução ao processamento de imagens com OpenCV (cont)
 
Introdução OpenCV (Pt-Br) com exemplos
Introdução OpenCV (Pt-Br) com exemplosIntrodução OpenCV (Pt-Br) com exemplos
Introdução OpenCV (Pt-Br) com exemplos
 
Um Sistema De Detecção De Fogo Baseado Em Vídeo
Um Sistema De Detecção De Fogo Baseado Em VídeoUm Sistema De Detecção De Fogo Baseado Em Vídeo
Um Sistema De Detecção De Fogo Baseado Em Vídeo
 
Um sistema de detecção de chamas utilizando RF e SVM (Short Version)
Um sistema de detecção de chamas utilizando RF e SVM (Short Version)Um sistema de detecção de chamas utilizando RF e SVM (Short Version)
Um sistema de detecção de chamas utilizando RF e SVM (Short Version)
 
G xserver curso-actualizgxxev1
G xserver curso-actualizgxxev1G xserver curso-actualizgxxev1
G xserver curso-actualizgxxev1
 
20 pratico cursogxxbr
20 pratico cursogxxbr20 pratico cursogxxbr
20 pratico cursogxxbr
 

Último

9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 

Último (20)

9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 

FPGA-based sensor integration and communication protocols for automated

Notas do Editor

  1. Hello! I am Cristiano Steffens and will be presenting a paper entitled FPGA-Based Sensor Integration and Communication Protocols for Automated Robot Control in Linear Welding. This work was developed with my coleagues Valquíria Huttner and Bruno Leonardo, advised by Professor Vagner Rosa and Professor Sílvia Botelho.
  2. What? Linear Welding robotization through Machine Vision Programmable Logic Why? Linear Welding activities can not be programmed Teach and Playback is not an option Furthermore, the use of robots is adequate for tasks that are taken in hazardous environment and Welding is an unhealthy work Goals Robot control / Automated Actuation Power source and wire feed control Vision Based Measurement system Runtime recognition of the groove dimensions and welding The choice for image sensors is supported by their low-cost, easy integration through standard communication protocols and interfaces, and the possibilities they create
  3. The figure presents the typical welding setup used in shipards. A robot is used to drag the welding torch and perform a movement along the welding groove with a weaving movement to fullfil the joint between two plates. This involves the parameterization of the speed, weaving speed, power source voltage and amperage, as well as the wire feeding speed and the protection gas flow.
  4. The proposed system, composed by image acquisition, image processing and robot controlling, has been implemented as a module to replace the original Control Unit of a BUGO MDS Robot (Fig.1). The original interface is mapped in order to enable an automated control of the tractor and weaver, allowing us to adjust the camera position while the robot travels over the entire rail, and thus map the welding groove properties. A signal conditioning board was developed to manipulate the robot signals towards the voltage levels supported on the GPIO (General-purpose input/output) ports on the FPGA board.
  5. Continuous rotation potentiometers, encoders and hall effect sensors are used as odometry sensors (dead-reckoning) of the tractor and weaver arm. The digital system features a FPGA based hardware/software architecture. The main advantage of the FPGA based approach for our application is that it is designed to integrate hardware and software. Therefore it fulfills all the requirements with a unique development platform. It enables data acquisition and actuation through a single integrated platform.
  6. The project is designed in Altera’s development platform tool Quartus II. The parametrization communication from the FPGA to the camera is established through the Inter-Integrated Circuit (I2C) protocol. The camera sends the image data to the FPGA board using a 12 bit parallel communication for each pixel. Pixel values are sent in sequence, pixel after pixel, in a serial communication. The main function of this module is to generate valid pixels using signals generated by the CMOS sensor. FVAL (valid frame) and LVAL (valid line) are used to control valid pixels. Each generated image presents a horizontal and vertical blank border region which is used for the sensor's synchronization. A PLL -- Phase-Locked Loop -- module, based on ALTPLL developed by Altera, is adopted to control and generate all the clocks for the digital system. PIXCLK is the clock for the Image Capture module. RPOS saves the coordinates how the robot’s position
  7. The image processing module is divided in two sections, BayerToGray and ROI (Region of Interest). The BayerToGray is a preprocessing step that converts the RGB image to gray scale. ROI sets the signal oDVAL when it is in a region of interest. The image is cropped, using only the center part, so we are able to avoid any optical aberrations (which would require more processing time to be corrected)
  8. The SDRAM of our system contains 32 MB divided in 4 memory banks with 8192 lines (12 bit each) and 1024 rows. Signals are used to control access to the banks and select the operation (initialization, reading / writing, refresh and preload). The signals of the SDRAM are organized as follows: BA[0] and BA[1] are a signal used to select the bank; A1 -- A8 and A10 -- A12 are a bus. Together they select the line of memory; A0 -- A9 are a bus, which selects the row; We modeled our SDRAM control using a Finite State Machine as proposed in Levin 2007.
  9. Anytime, the computer can ask for the robot's position, request it to move to a specified position, change the illumination intensity, among other implemented functions. Therefore a Modbus communication protocol was implemented. The protocol works upon a master-slave approach. A request from the master device generates a single response from the slave. The message structure segmented in fixed size parts. Each part of the message has a role: Slave ID: identifies the receptor in the bus. Function Code: requested function or function related with the information sent, including robot control, interfacing with the camera and illumination system. Payload: it is related with requested function, is the data of the message, the parameters. Some functions might not require any payload. Others, as the image for instance have a payload of 76 kilobytes of data to be transmitted without compression. CRC (Cyclic Redundancy Check): is used for the message integrity validation.
  10. Raspberry Pi: The proposed acquisition system provides the data which is used as input for the image processing performed in the VBM system, as in Steffens 2016. On the top part, we can see 5 images the proposed embedded system sends to a computer. To avoid under exposition and saturation we use the HDR Composition, as proposed by Debevec in 2008, which requires the camera's exposure time to be controlled. Fig. C shows the results of the processing that takes place on the Raspberry Pi, where the composed image is processed via Fast LSD, a line detection algorithm proposed by Von Gioi in 2012, to find the groove edges. This image goes through a post-processing and in D, se show the final result.
  11. We show the experimental error of the VBM system measurement over 10 sampling points on the welding plate, separated 40mm from each other. The ground truth (GT) compared to the VBM system measurements, assuming the VBM outputs have already been corrected for all significant systematic effects, shows an average error smaller than 0.2mm. These measurements are latter used to generate the welding execution plan.
  12. In terms of hardware, we propose a low budget solution. The total cost is 684,00 dollars, where 300,00 are used in discrete componentes and shielding. Here, we included na Raspberry Pi to implemente the main image processing algorithms and control. No proprietary software has been used.
  13. In future work we intend to: Develop Closed Loop control of the welding parameters Improve the actuation using a PID or Robust Model Reference Adaptive Control, Which requires the implementation of Floating Point Operations - Also, we will enhance the Electrical Protection and Mechanical Protection
  14. In summary , we presente a functional module to acquire data and actuate a linear welding robot, using a cheap FPGA-based harware and off the shelf electronics. The proposed system can be used to enhance the welding proccess in shipyards and in the heavy steel industries, as well as automate operations that would require human intervention. Thank you!