SlideShare uma empresa Scribd logo
1 de 31
RatSLAM

Rafael C.P.
RatSLAM



Algoritmo bioinspirado
Baseado nas head, place e grid cells
identificadas no hipocampo dos ratos



Modela com redes neurais dinâmicas



Usa apenas uma web cam como sensor



Roda em tempo real em um notebook



Mapeamento topológico
Modelo Hipocampal









Head Cells: cada
neurônio representa 1
ângulo diferente
Células excitam
células próximas e
inibem células
distantes
Movimento excita e
inibe células
Inibição global
Extremidades são
conectadas
Modelo Hipocampal


O resultado após
várias iterações é um
“pacote” de ativações
próximas, com
formato similar a uma
Gaussiana
Modelo Hipocampal






Local View Cells
excitam Head Cells
Similar ao passo de
de correção de
localização baseada
nos sensores em
robótica
Todo mesmo
racioncínio para
Place Cells, mas 2D
RatSLAM


3 módulos:






Local View Cells:
armazenam templates
de imagens
observadas
Pose Cells: união das
Head Cells com Place
Cells, 3D
Experience Map:
guarda associações e
transições
Pose Cells



Mapa 3D de poses
Cada face do cubo é
ligada com a face
oposta


Permite mapas de
tamanho ilimitado,
mas compartilha
diferentes locais em
uma mesma célula
Pose Cells






Exctitação e inibição
lateral
Aritmética modular
para levar em conta
as extremidades
conectadas
Inibição idêntica à
excitação mas com
sinal oposto e com
inibição global
Pose Cells + Motion


Ao contrário do modelo biológico que incorpora
a informação de movimento através de
excitações e inibições neurais, RatSLAM
simplifica e agiliza o processo simplesmente
deslocando as ativações diretamente, como é
feito comumente em robótica
Local View + Pose Cells




Matriz de
associações é
atualizada com
aprendizado
Hebbiano (fire
together, wire
together)
Local View Cells
excitam as pose cells
através de suas
associações
Experience Map






Guarda associações
de Local View e
Place Cells que
ocorrem
simultaneamente
Guarda também pose
obtida pela odometria
no momento
Transições entre
experiências
guardam variação de
pose
Experience Map






“S” é uma medida de
distância /
similaridade entre 2
experiências
Ao ultrapassar um
limiar, uma nova
experiência é criada
Caso contrário, as
experiências são
atualizadas (correção
da pose)
Visão









Odometria visual
Apenas pedaços das
imagens obtidas são
usados
A: Template Matching
para Local View Cells
B: Estimação de
Rotação
C: Estimação de
velocidade
Rotação




Imagem (tons de
cinza) é reduzida a
um vetor 1D com a
média de intensidade
de cada coluna
Vetores
subsequentes são
comparados com
vários alinhamentos e
o melhor é
selecionado como
estimativa da rotação
Velocidade




Vetores
subsequentes já
alinhados pela
rotação são
comparados
Estimativa de
velocidade dada por
uma função de
distância das
intensidades
absolutas dos vetores
Template Matching


Os vetores de
intensidade alinhados
também são usados
no template matching
Experimento - Setup


Apenas um notebook
com web cam fixado
no topo de um carro



Trajeto de 66km



100min



Área de 3km x 1,6km
Exemplos


Imagens observadas
pelo sistema ao longo
do experimento
Resultados - Loop Closures




Diferença entre
variação de pose
armazenada nas
transições e pose
relativa entre
experiências
Picos = loop closures
Rotação


Estimação de rotação
foi muito boa (o
problema está na
velocidade)
Velocidade






Velocidade estimada
ao longo de um
trecho em que a
velocidade real era
constante
Maior fonte de erro
(40%), mas ainda
tolerável
Outros módulos do
algoritmo
compensam
Pose Cells






Informação das Local
View Cells cria novo
pacote de ativações
Ao longo de 6s esse
pacote se torna
dominante, e a
informação antiga
desaparece
Similar ao passo de
atualização baseada
nos sensores comum
em robótica
Pose Cells




Os mesmos
neurônios
representam mais de
um local no mapa,
devido à natureza
cíclica da rede neural
usada
Outros módulos
acabam corrigindo
ambiguidades
Local View Cells




Novos templates vão
sendo criados e
ativados
Locais já visitados
tornam a ativar
neurônios já
existentes
Local View Cells




Regiões do mapa
com aparência
(visual) similar são
representadas pelas
mesmas Local View
Cells
Interação com os
outros módulos retira
ambiguidade
Processamento
Parâmetros
Resultados
Resultados
Vídeo

http://www.youtube.com/watch?v=-0XSUi69Yvs
Referências


Milford, M.J. and Wyeth, G.F - Mapping a
Suburb With a Single Camera Using a
Biologically Inspired SLAM System - IEEE
TRANSAC TIONS ON ROBOTICS, VOL. 24,
NO. 5, OCTOBER 2008

Mais conteúdo relacionado

Destaque

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Destaque (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Ratslam