SlideShare uma empresa Scribd logo
Multi-Robot Systems CSCI 7000-006 Monday, October 4, 2009 NikolausCorrell
Last week Probabilistic models Reactive swarm systems: rate equations Deliberative systems: Master equation Enumerate all possible states Probabilistic state transitions reflect state transitions in the system
Today Examples of swarming systems Coverage Aggregation Parameter calibration System identification
Distributed Boundary Coverage Coverage of every point on the boundary of objects in a specified area Applications: Inspection, Maintenance, Painting, …
Baseline: Randomized Coverage without Localization Search Inspect Translate Avoid Obstacle Wall | Robot Obstacle clear Search Inspect Translate along blade pt Blade 1-pt Tt expired
Probabilistic Model Avoid Obstacle Inspect Search Translate along blade Robotic System Environment
Encountering Probabilities pw pr pb Probability to encounter an object is proportional to Robot speed Sensor range Size of the object and the arena Assumptions Uniform distribution of robots in the environment Robots encounter only one object at a time 1
Macroscopic Equations Every state corresponds to one difference equation Existence of a steady-state distribution can be proven by analyzing the underlying Markov chain
Candidate Model for Swarm Robotic Inspection Robotic System Environment
Model prediction vs. Real Robot Experiments 20 robots 25 robots 30 robots
Aggregation Robots stop probabilistically Probability function of number of neighbors Estimate of neighborhood using infrared sensing Many neighbors, high probability Few neighbors, low probability N. Correll and A. Martinoli. Modeling Self-Organized Aggregation in a Swarm of Miniature Robots. In IEEE 2007 International Conference on Robotics and Automation Workshop on Collective Behaviors inspired by Biological and Biochemical Systems, Rome, Italy, 2007.
Individual Robot Behavior pjoin(Environment) Search Rest pleave(Environment)
Modeling assumptions A robot moves through the environment (random walk) during which it encounters other robots with constant probability The probability to encounter one robot is pc, the probability to encounter a cluster of n robots npc ,[object Object],[object Object]
“Passive” State Transitions j j+1 Example: 4 robots change their state without actually moving
Probabilistic Finite State Machine Robots joining aggregates “Passive” state  transitions
Average Number of Agents in a Cluster of j pcNs(k)jNj(k)pjoin(j) Ns(k)pcNj-1(k)pjoin(j-1)*j j-Aggregate Nj+1(k)pleave(j+1)*j Nj(k)pleave(j)*(j-1) Nj(k)pleave(j)
Temporal evolution of the degree distribution What would happen if the communication range changes and what model parameter would be affected? Realistic simulation (left), model prediction (right). 1500 experiments in Webots, communication range 10cm, arena 1m diameter, 12 individuals.
Encountering probability and communication range 7cm communication range (left), and 12cm communication range (right). 1500 experiments, 12 individuals.
Limitations of Rate Equation approach Estimation of model parameters using geometric properties potentially inaccurate Rate equations yield only the average performance, not its distribution Probabilistic Finite State machine does not capture all properties of the system
Multi-Level Modeling Ss Sa Ss Sa Ss Sa Ss Sa Rate equations (Macroscopic level) Abstraction Level of Detail Multi-agent models (Microscopic level) Realistic simulation Real System
Coverage: Performance Distribution 20 Real Robots Agent-based simulation
Parameter Calibration using realistic simulation
Limitations of parameter calibration Attempt to summarize multi-faceted system dynamics into scalar value Problematic assumptions Uniform distribution Disc-shaped detection ranges Uniform speed … Qualitative better than quantitative prediction
Parameter Estimation Estimating model parameters from real robot experimentation Analytical solutions for linear systems Excite degrees of freedoms separately in experiments Observation  of the system Model prediction
Example: Simple linear system The system’s future states can be predicted by a linear combination of the system’s current states.
Simple linear system Model: Prediction error: Parameters minimizing the prediction error: N(k) : system equationsq      : system parametersn     : length of one experiment
Results Initial guess Experiment Optimal parameterized Model 20 experiments per team size
Upcoming System optimization using probabilistic models Discrete Event System (DES) simulation
Scheduling Monday: Lecture Friday: Course project get-together Tuesday, Wednesday, Thursday: individual meetings October 11-15: IROS conference in St. Louis November 30 – December 11: Project presentations (15 min)
October 5, Probabilistic Modeling II

Mais conteúdo relacionado

Destaque (9)

Multi Robot Swarm Systems
Multi Robot Swarm SystemsMulti Robot Swarm Systems
Multi Robot Swarm Systems
 
SWARM ROBOTICS25
SWARM ROBOTICS25SWARM ROBOTICS25
SWARM ROBOTICS25
 
Seminar
SeminarSeminar
Seminar
 
Swarm intelligence
Swarm intelligenceSwarm intelligence
Swarm intelligence
 
Swarm intelligence
Swarm intelligenceSwarm intelligence
Swarm intelligence
 
swarm robotics
swarm roboticsswarm robotics
swarm robotics
 
Swarm ROBOTICS
Swarm ROBOTICSSwarm ROBOTICS
Swarm ROBOTICS
 
Swarm intelligence
Swarm intelligenceSwarm intelligence
Swarm intelligence
 
Swarm Intelligence - An Introduction
Swarm Intelligence - An IntroductionSwarm Intelligence - An Introduction
Swarm Intelligence - An Introduction
 

Semelhante a October 5, Probabilistic Modeling II

Particle Swarm Optimization Application In Power System
Particle Swarm Optimization Application In Power SystemParticle Swarm Optimization Application In Power System
Particle Swarm Optimization Application In Power System
Ministry of New & Renewable Energy, Govt of India
 
SLAM of Multi-Robot System Considering Its Network Topology
SLAM of Multi-Robot System Considering Its Network TopologySLAM of Multi-Robot System Considering Its Network Topology
SLAM of Multi-Robot System Considering Its Network Topology
toukaigi
 
CS221: HMM and Particle Filters
CS221: HMM and Particle FiltersCS221: HMM and Particle Filters
CS221: HMM and Particle Filters
zukun
 
antcolonyoptimization-130619020831-phpapp01.pdf
antcolonyoptimization-130619020831-phpapp01.pdfantcolonyoptimization-130619020831-phpapp01.pdf
antcolonyoptimization-130619020831-phpapp01.pdf
nrusinhapadhi
 
"An adaptive modular approach to the mining of sensor network ...
"An adaptive modular approach to the mining of sensor network ..."An adaptive modular approach to the mining of sensor network ...
"An adaptive modular approach to the mining of sensor network ...
butest
 

Semelhante a October 5, Probabilistic Modeling II (20)

Particle Swarm Optimization Application In Power System
Particle Swarm Optimization Application In Power SystemParticle Swarm Optimization Application In Power System
Particle Swarm Optimization Application In Power System
 
Characterization of Subsurface Heterogeneity: Integration of Soft and Hard In...
Characterization of Subsurface Heterogeneity: Integration of Soft and Hard In...Characterization of Subsurface Heterogeneity: Integration of Soft and Hard In...
Characterization of Subsurface Heterogeneity: Integration of Soft and Hard In...
 
The Challenges of Probabilistic Thinking (keynote talk at ICFEM 2017)
The Challenges of Probabilistic Thinking (keynote talk at ICFEM 2017)The Challenges of Probabilistic Thinking (keynote talk at ICFEM 2017)
The Challenges of Probabilistic Thinking (keynote talk at ICFEM 2017)
 
November 30, Projects
November 30, ProjectsNovember 30, Projects
November 30, Projects
 
SLAM of Multi-Robot System Considering Its Network Topology
SLAM of Multi-Robot System Considering Its Network TopologySLAM of Multi-Robot System Considering Its Network Topology
SLAM of Multi-Robot System Considering Its Network Topology
 
Bayesian risk assessment of autonomous vehicles
Bayesian risk assessment of autonomous vehiclesBayesian risk assessment of autonomous vehicles
Bayesian risk assessment of autonomous vehicles
 
CS221: HMM and Particle Filters
CS221: HMM and Particle FiltersCS221: HMM and Particle Filters
CS221: HMM and Particle Filters
 
presentation.ppt
presentation.pptpresentation.ppt
presentation.ppt
 
A temporal classifier system using spiking neural networks
A temporal classifier system using spiking neural networksA temporal classifier system using spiking neural networks
A temporal classifier system using spiking neural networks
 
An Improved Quantum-behaved Particle Swarm Optimization Algorithm Based on Ch...
An Improved Quantum-behaved Particle Swarm Optimization Algorithm Based on Ch...An Improved Quantum-behaved Particle Swarm Optimization Algorithm Based on Ch...
An Improved Quantum-behaved Particle Swarm Optimization Algorithm Based on Ch...
 
September 23, Modeling of Gradient-Based Controllers II
September 23, Modeling of Gradient-Based Controllers IISeptember 23, Modeling of Gradient-Based Controllers II
September 23, Modeling of Gradient-Based Controllers II
 
Chaotic ANT System Optimization for Path Planning of the Mobile Robots
Chaotic ANT System Optimization for Path Planning of the Mobile RobotsChaotic ANT System Optimization for Path Planning of the Mobile Robots
Chaotic ANT System Optimization for Path Planning of the Mobile Robots
 
The Joy of SLAM
The Joy of SLAMThe Joy of SLAM
The Joy of SLAM
 
antcolonyoptimization-130619020831-phpapp01.pdf
antcolonyoptimization-130619020831-phpapp01.pdfantcolonyoptimization-130619020831-phpapp01.pdf
antcolonyoptimization-130619020831-phpapp01.pdf
 
Modeling of Granular Mixing using Markov Chains and the Discrete Element Method
Modeling of Granular Mixing using Markov Chains and the Discrete Element MethodModeling of Granular Mixing using Markov Chains and the Discrete Element Method
Modeling of Granular Mixing using Markov Chains and the Discrete Element Method
 
Machine learning applications in aerospace domain
Machine learning applications in aerospace domainMachine learning applications in aerospace domain
Machine learning applications in aerospace domain
 
Ant colony optimization
Ant colony optimizationAnt colony optimization
Ant colony optimization
 
Implementation of the fully adaptive radar framework: Practical limitations
Implementation of the fully adaptive radar framework: Practical limitationsImplementation of the fully adaptive radar framework: Practical limitations
Implementation of the fully adaptive radar framework: Practical limitations
 
"An adaptive modular approach to the mining of sensor network ...
"An adaptive modular approach to the mining of sensor network ..."An adaptive modular approach to the mining of sensor network ...
"An adaptive modular approach to the mining of sensor network ...
 
Two dimensional-cellular-automata
Two dimensional-cellular-automataTwo dimensional-cellular-automata
Two dimensional-cellular-automata
 

Mais de University of Colorado at Boulder

Three-dimensional construction with mobile robots and modular blocks
 Three-dimensional construction with mobile robots and modular blocks Three-dimensional construction with mobile robots and modular blocks
Three-dimensional construction with mobile robots and modular blocks
University of Colorado at Boulder
 

Mais de University of Colorado at Boulder (20)

Three-dimensional construction with mobile robots and modular blocks
 Three-dimensional construction with mobile robots and modular blocks Three-dimensional construction with mobile robots and modular blocks
Three-dimensional construction with mobile robots and modular blocks
 
Template classes and ROS messages
Template classes and ROS messagesTemplate classes and ROS messages
Template classes and ROS messages
 
NLP for Robotics
NLP for RoboticsNLP for Robotics
NLP for Robotics
 
Indoor Localization Systems
Indoor Localization SystemsIndoor Localization Systems
Indoor Localization Systems
 
Vishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random TreesVishal Verma: Rapidly Exploring Random Trees
Vishal Verma: Rapidly Exploring Random Trees
 
Lecture 10: Summary
Lecture 10: SummaryLecture 10: Summary
Lecture 10: Summary
 
Lecture 09: SLAM
Lecture 09: SLAMLecture 09: SLAM
Lecture 09: SLAM
 
Lecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping IILecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping II
 
Lecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping ILecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping I
 
Lecture 06: Features and Uncertainty
Lecture 06: Features and UncertaintyLecture 06: Features and Uncertainty
Lecture 06: Features and Uncertainty
 
Lecture 05
Lecture 05Lecture 05
Lecture 05
 
Lecture 04
Lecture 04Lecture 04
Lecture 04
 
Lecture 03 - Kinematics and Control
Lecture 03 - Kinematics and ControlLecture 03 - Kinematics and Control
Lecture 03 - Kinematics and Control
 
Lecture 02: Locomotion
Lecture 02: LocomotionLecture 02: Locomotion
Lecture 02: Locomotion
 
Lecture 01
Lecture 01Lecture 01
Lecture 01
 
Lectures 11+12: Debates
Lectures 11+12: DebatesLectures 11+12: Debates
Lectures 11+12: Debates
 
Lecture 09: Localization and Mapping III
Lecture 09: Localization and Mapping IIILecture 09: Localization and Mapping III
Lecture 09: Localization and Mapping III
 
Lecture 10: Navigation
Lecture 10: NavigationLecture 10: Navigation
Lecture 10: Navigation
 
Lecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping IILecture 08: Localization and Mapping II
Lecture 08: Localization and Mapping II
 
Lecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping ILecture 07: Localization and Mapping I
Lecture 07: Localization and Mapping I
 

Último

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 

Último (20)

Agentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfAgentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdf
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
Server-Driven User Interface (SDUI) at Priceline
Server-Driven User Interface (SDUI) at PricelineServer-Driven User Interface (SDUI) at Priceline
Server-Driven User Interface (SDUI) at Priceline
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Motion for AI: Creating Empathy in Technology
Motion for AI: Creating Empathy in TechnologyMotion for AI: Creating Empathy in Technology
Motion for AI: Creating Empathy in Technology
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 

October 5, Probabilistic Modeling II

  • 1. Multi-Robot Systems CSCI 7000-006 Monday, October 4, 2009 NikolausCorrell
  • 2. Last week Probabilistic models Reactive swarm systems: rate equations Deliberative systems: Master equation Enumerate all possible states Probabilistic state transitions reflect state transitions in the system
  • 3. Today Examples of swarming systems Coverage Aggregation Parameter calibration System identification
  • 4. Distributed Boundary Coverage Coverage of every point on the boundary of objects in a specified area Applications: Inspection, Maintenance, Painting, …
  • 5. Baseline: Randomized Coverage without Localization Search Inspect Translate Avoid Obstacle Wall | Robot Obstacle clear Search Inspect Translate along blade pt Blade 1-pt Tt expired
  • 6. Probabilistic Model Avoid Obstacle Inspect Search Translate along blade Robotic System Environment
  • 7. Encountering Probabilities pw pr pb Probability to encounter an object is proportional to Robot speed Sensor range Size of the object and the arena Assumptions Uniform distribution of robots in the environment Robots encounter only one object at a time 1
  • 8. Macroscopic Equations Every state corresponds to one difference equation Existence of a steady-state distribution can be proven by analyzing the underlying Markov chain
  • 9. Candidate Model for Swarm Robotic Inspection Robotic System Environment
  • 10. Model prediction vs. Real Robot Experiments 20 robots 25 robots 30 robots
  • 11. Aggregation Robots stop probabilistically Probability function of number of neighbors Estimate of neighborhood using infrared sensing Many neighbors, high probability Few neighbors, low probability N. Correll and A. Martinoli. Modeling Self-Organized Aggregation in a Swarm of Miniature Robots. In IEEE 2007 International Conference on Robotics and Automation Workshop on Collective Behaviors inspired by Biological and Biochemical Systems, Rome, Italy, 2007.
  • 12. Individual Robot Behavior pjoin(Environment) Search Rest pleave(Environment)
  • 13.
  • 14. “Passive” State Transitions j j+1 Example: 4 robots change their state without actually moving
  • 15. Probabilistic Finite State Machine Robots joining aggregates “Passive” state transitions
  • 16. Average Number of Agents in a Cluster of j pcNs(k)jNj(k)pjoin(j) Ns(k)pcNj-1(k)pjoin(j-1)*j j-Aggregate Nj+1(k)pleave(j+1)*j Nj(k)pleave(j)*(j-1) Nj(k)pleave(j)
  • 17. Temporal evolution of the degree distribution What would happen if the communication range changes and what model parameter would be affected? Realistic simulation (left), model prediction (right). 1500 experiments in Webots, communication range 10cm, arena 1m diameter, 12 individuals.
  • 18. Encountering probability and communication range 7cm communication range (left), and 12cm communication range (right). 1500 experiments, 12 individuals.
  • 19. Limitations of Rate Equation approach Estimation of model parameters using geometric properties potentially inaccurate Rate equations yield only the average performance, not its distribution Probabilistic Finite State machine does not capture all properties of the system
  • 20. Multi-Level Modeling Ss Sa Ss Sa Ss Sa Ss Sa Rate equations (Macroscopic level) Abstraction Level of Detail Multi-agent models (Microscopic level) Realistic simulation Real System
  • 21. Coverage: Performance Distribution 20 Real Robots Agent-based simulation
  • 22. Parameter Calibration using realistic simulation
  • 23. Limitations of parameter calibration Attempt to summarize multi-faceted system dynamics into scalar value Problematic assumptions Uniform distribution Disc-shaped detection ranges Uniform speed … Qualitative better than quantitative prediction
  • 24. Parameter Estimation Estimating model parameters from real robot experimentation Analytical solutions for linear systems Excite degrees of freedoms separately in experiments Observation of the system Model prediction
  • 25. Example: Simple linear system The system’s future states can be predicted by a linear combination of the system’s current states.
  • 26. Simple linear system Model: Prediction error: Parameters minimizing the prediction error: N(k) : system equationsq : system parametersn : length of one experiment
  • 27. Results Initial guess Experiment Optimal parameterized Model 20 experiments per team size
  • 28. Upcoming System optimization using probabilistic models Discrete Event System (DES) simulation
  • 29. Scheduling Monday: Lecture Friday: Course project get-together Tuesday, Wednesday, Thursday: individual meetings October 11-15: IROS conference in St. Louis November 30 – December 11: Project presentations (15 min)