SlideShare uma empresa Scribd logo
1 de 16
Neural Decoding
June 7th
Hiroaki hamada
1
• Encoding: (neuron response) = f(stimuli)
• Decoding: (stimuli) = f-1(neuron response)
Inverse problem of Encoding
Bayesian Theorem is commonly used.
1. P[s]: the probability of stimulus s being presented, often called prior probability
2. P[r], r = (r1, … , rN): spike-count firing rates: the probability of response r being
recorded.
3. P[r, s]: the probability of stimulus s being presented and response r being
recorded(Joint probability).
4. P[r|s]: the probability of evoking response r, given that stimulus s was presented.
5. P[s|r]: the conditional probability that stimulus s was presented, given that
response r was recorded.
Neural Decoding
Neural Decoding
P[r] can be calculated from P[r|s] by summing over
all stimulus values weighted by their probabilities.
P[r] = ΣsP[r|s]P[s] and P[s] =
ΣrP[s|r]P[r]
Also, the joint probability P[r|s] times the probability
of the stimulus, or as P[s|r] times the probability of
the response.
P[r, s] = P[r|s]P[s] = P[s|r]P[r]
Bayes theorem:
P[s|r] = P[r|s]P[s]/P[r] or P[r|s]
= P[s|r]P[r]/P[s]
2
Neural Decoding
Probabilities in decoding:
Decoding of intention.
3
Probabilities in decoding
Two datasets are given, and we
decode intention of arm reaching.
4
neuronL neuronR
Firing rate during left trial i Firing rate during right trial i
53.9781
57.6395
56.1187
38.0109
67.3739
…
58.3077
56.3932
38.9440
39.9052
50.7743
…
(remember Capitalization is important for
MATLAB)
Probabilities in decoding
5
Probabilities in decoding
6
Probabilities in decoding
7
Neuron 1 Neuron 2
Movement intention
Assumption (naïve Bayes)
Probabilities in decoding
8
Decoding by Linear Filter
Translation from Observed data to Predicted data:
9
Decoding by Linear Filter
10
Pinball Task
(Serruya et al., Nature, 2002)
Decoding by Particle Filter
Particle filter:
1. A method for approximating the probability density function by multiple samples
2. This is also called as Monte Calo Filter, Boostrap Filter, Sampling/Importance
resampling(SIR) Filter.
3. Independently, Kitagawa and Gordon invented this.
Depending on observed data(we would predict
that data have noise), we try to focus on
expected point by some particles.
11
Reverse Correlation
A way of construct the receptive field.
1. Random patterns of inputs give to the receptive field.
2. Superimpose response patterns of neurons.
3. Reconstruct the receptive field.
The firing rate modulation due to the random stimulus X(t)
12
Reverse Correlation
13
Signal Detection Theory
Decision rule:
Is the signal present or absent in the noisy back ground?
14
The stimulus s1, no stimulus s0
The likelihood ratio
Two possible types of error:
1. Calling the stimulus present when it was not(a
false-alarm or False positive)
2. Calling the stimulus absent when it was
present(a miss or True negative)
ROC curve(a receiver-operating characteristic):
Relationship between a false-alarm and a miss
15

Mais conteúdo relacionado

Mais procurados

Tele4653 l9
Tele4653 l9Tele4653 l9
Tele4653 l9
Vin Voro
 
Practical Spherical Harmonics Based PRT Methods
Practical Spherical Harmonics Based PRT MethodsPractical Spherical Harmonics Based PRT Methods
Practical Spherical Harmonics Based PRT Methods
Naughty Dog
 
SPU Optimizations - Part 2
SPU Optimizations - Part 2SPU Optimizations - Part 2
SPU Optimizations - Part 2
Naughty Dog
 
Tele4653 l6
Tele4653 l6Tele4653 l6
Tele4653 l6
Vin Voro
 
SPU Optimizations-part 1
SPU Optimizations-part 1SPU Optimizations-part 1
SPU Optimizations-part 1
Naughty Dog
 
CVPR2010: Advanced ITinCVPR in a Nutshell: part 6: Mixtures
CVPR2010: Advanced ITinCVPR in a Nutshell: part 6: MixturesCVPR2010: Advanced ITinCVPR in a Nutshell: part 6: Mixtures
CVPR2010: Advanced ITinCVPR in a Nutshell: part 6: Mixtures
zukun
 

Mais procurados (19)

Goodfellow, Bengio, Couville (2016) "Deep Learning", Chap. 6
Goodfellow, Bengio, Couville (2016) "Deep Learning", Chap. 6Goodfellow, Bengio, Couville (2016) "Deep Learning", Chap. 6
Goodfellow, Bengio, Couville (2016) "Deep Learning", Chap. 6
 
Tele4653 l9
Tele4653 l9Tele4653 l9
Tele4653 l9
 
Practical Spherical Harmonics Based PRT Methods
Practical Spherical Harmonics Based PRT MethodsPractical Spherical Harmonics Based PRT Methods
Practical Spherical Harmonics Based PRT Methods
 
Chap 3
Chap 3Chap 3
Chap 3
 
SchNet: A continuous-filter convolutional neural network for modeling quantum...
SchNet: A continuous-filter convolutional neural network for modeling quantum...SchNet: A continuous-filter convolutional neural network for modeling quantum...
SchNet: A continuous-filter convolutional neural network for modeling quantum...
 
SPU Optimizations - Part 2
SPU Optimizations - Part 2SPU Optimizations - Part 2
SPU Optimizations - Part 2
 
Tele4653 l6
Tele4653 l6Tele4653 l6
Tele4653 l6
 
SPU Optimizations-part 1
SPU Optimizations-part 1SPU Optimizations-part 1
SPU Optimizations-part 1
 
Goodfellow, Bengio, Couville (2016) "Deep Learning", Chap. 7
Goodfellow, Bengio, Couville (2016) "Deep Learning", Chap. 7Goodfellow, Bengio, Couville (2016) "Deep Learning", Chap. 7
Goodfellow, Bengio, Couville (2016) "Deep Learning", Chap. 7
 
Dft
DftDft
Dft
 
Tensorflow, deep learning and recurrent neural networks without a ph d
Tensorflow, deep learning and recurrent neural networks   without a ph dTensorflow, deep learning and recurrent neural networks   without a ph d
Tensorflow, deep learning and recurrent neural networks without a ph d
 
CVPR2010: Advanced ITinCVPR in a Nutshell: part 6: Mixtures
CVPR2010: Advanced ITinCVPR in a Nutshell: part 6: MixturesCVPR2010: Advanced ITinCVPR in a Nutshell: part 6: Mixtures
CVPR2010: Advanced ITinCVPR in a Nutshell: part 6: Mixtures
 
Fourier Transforms
Fourier TransformsFourier Transforms
Fourier Transforms
 
A Random Forest using a Multi-valued Decision Diagram on an FPGa
A Random Forest using a Multi-valued Decision Diagram on an FPGaA Random Forest using a Multi-valued Decision Diagram on an FPGa
A Random Forest using a Multi-valued Decision Diagram on an FPGa
 
New Bounds on the Size of Optimal Meshes
New Bounds on the Size of Optimal MeshesNew Bounds on the Size of Optimal Meshes
New Bounds on the Size of Optimal Meshes
 
Zoneout
ZoneoutZoneout
Zoneout
 
Minimax optimal alternating minimization \\ for kernel nonparametric tensor l...
Minimax optimal alternating minimization \\ for kernel nonparametric tensor l...Minimax optimal alternating minimization \\ for kernel nonparametric tensor l...
Minimax optimal alternating minimization \\ for kernel nonparametric tensor l...
 
Naist2015 dec ver1
Naist2015 dec ver1Naist2015 dec ver1
Naist2015 dec ver1
 
Wasserstein GAN
Wasserstein GANWasserstein GAN
Wasserstein GAN
 

Destaque

het Evangelie in de sterren
het Evangelie in de sterrenhet Evangelie in de sterren
het Evangelie in de sterren
goedbericht
 

Destaque (15)

Aula 11
Aula   11Aula   11
Aula 11
 
Sara hagar
Sara hagarSara hagar
Sara hagar
 
Kolosse deel 8
Kolosse deel 8Kolosse deel 8
Kolosse deel 8
 
Johndel Catapang
Johndel CatapangJohndel Catapang
Johndel Catapang
 
de Emmaüsgangers
de Emmaüsgangersde Emmaüsgangers
de Emmaüsgangers
 
Defence
DefenceDefence
Defence
 
Website
WebsiteWebsite
Website
 
Procesos Mentales
Procesos MentalesProcesos Mentales
Procesos Mentales
 
"How to work with a freelance designer" by Alexis Porhiel, Designer & Co-foun...
"How to work with a freelance designer" by Alexis Porhiel, Designer & Co-foun..."How to work with a freelance designer" by Alexis Porhiel, Designer & Co-foun...
"How to work with a freelance designer" by Alexis Porhiel, Designer & Co-foun...
 
David gek
David gekDavid gek
David gek
 
het Evangelie in de sterren
het Evangelie in de sterrenhet Evangelie in de sterren
het Evangelie in de sterren
 
Estrategias de Estudio Apuntes
Estrategias de Estudio ApuntesEstrategias de Estudio Apuntes
Estrategias de Estudio Apuntes
 
Integrate and Fire based neuron model
Integrate and Fire based neuron modelIntegrate and Fire based neuron model
Integrate and Fire based neuron model
 
Cognitive Computing by Professor Gordon Pipa
Cognitive Computing by Professor Gordon PipaCognitive Computing by Professor Gordon Pipa
Cognitive Computing by Professor Gordon Pipa
 
10 mistakes that can kill your growth (and how to avoid them)
10 mistakes that can kill your growth (and how to avoid them)10 mistakes that can kill your growth (and how to avoid them)
10 mistakes that can kill your growth (and how to avoid them)
 

Semelhante a Neural decoding

DESeq Paper Journal club
DESeq Paper Journal club DESeq Paper Journal club
DESeq Paper Journal club
avrilcoghlan
 
A Hierarchical Self-organizing Associative Memory for Machine ...
A Hierarchical Self-organizing Associative Memory for Machine ...A Hierarchical Self-organizing Associative Memory for Machine ...
A Hierarchical Self-organizing Associative Memory for Machine ...
butest
 
Microarray Data Analysis
Microarray Data AnalysisMicroarray Data Analysis
Microarray Data Analysis
yuvraj404
 
Ldb Convergenze Parallele_De barros_01
Ldb Convergenze Parallele_De barros_01Ldb Convergenze Parallele_De barros_01
Ldb Convergenze Parallele_De barros_01
laboratoridalbasso
 
Probability distribution
Probability distributionProbability distribution
Probability distribution
Ranjan Kumar
 
Improved Inference for First-Order Autocorrelation Using Likelihood Analysis
Improved Inference for First-Order Autocorrelation Using Likelihood AnalysisImproved Inference for First-Order Autocorrelation Using Likelihood Analysis
Improved Inference for First-Order Autocorrelation Using Likelihood Analysis
jachno
 

Semelhante a Neural decoding (20)

DESeq Paper Journal club
DESeq Paper Journal club DESeq Paper Journal club
DESeq Paper Journal club
 
Species sampling models in Bayesian Nonparametrics
Species sampling models in Bayesian NonparametricsSpecies sampling models in Bayesian Nonparametrics
Species sampling models in Bayesian Nonparametrics
 
JAISTサマースクール2016「脳を知るための理論」講義03 Network Dynamics
JAISTサマースクール2016「脳を知るための理論」講義03 Network DynamicsJAISTサマースクール2016「脳を知るための理論」講義03 Network Dynamics
JAISTサマースクール2016「脳を知るための理論」講義03 Network Dynamics
 
asymptotics of ABC
asymptotics of ABCasymptotics of ABC
asymptotics of ABC
 
Predictive coding : inhibition in the retina
Predictive coding : inhibition in the retina Predictive coding : inhibition in the retina
Predictive coding : inhibition in the retina
 
A Hierarchical Self-organizing Associative Memory for Machine ...
A Hierarchical Self-organizing Associative Memory for Machine ...A Hierarchical Self-organizing Associative Memory for Machine ...
A Hierarchical Self-organizing Associative Memory for Machine ...
 
Microarray Data Analysis
Microarray Data AnalysisMicroarray Data Analysis
Microarray Data Analysis
 
Introduction to Compressive Sensing
Introduction to Compressive SensingIntroduction to Compressive Sensing
Introduction to Compressive Sensing
 
Introduction to compressive sensing
Introduction to compressive sensingIntroduction to compressive sensing
Introduction to compressive sensing
 
Ldb Convergenze Parallele_De barros_01
Ldb Convergenze Parallele_De barros_01Ldb Convergenze Parallele_De barros_01
Ldb Convergenze Parallele_De barros_01
 
JAISTサマースクール2016「脳を知るための理論」講義04 Neural Networks and Neuroscience
JAISTサマースクール2016「脳を知るための理論」講義04 Neural Networks and Neuroscience JAISTサマースクール2016「脳を知るための理論」講義04 Neural Networks and Neuroscience
JAISTサマースクール2016「脳を知るための理論」講義04 Neural Networks and Neuroscience
 
2주차
2주차2주차
2주차
 
Probability distribution
Probability distributionProbability distribution
Probability distribution
 
Paloma Sanchez MIT Poster
Paloma Sanchez MIT PosterPaloma Sanchez MIT Poster
Paloma Sanchez MIT Poster
 
Finding motif
Finding motifFinding motif
Finding motif
 
Neural Processes
Neural ProcessesNeural Processes
Neural Processes
 
Laplace's Demon: seminar #1
Laplace's Demon: seminar #1Laplace's Demon: seminar #1
Laplace's Demon: seminar #1
 
the ABC of ABC
the ABC of ABCthe ABC of ABC
the ABC of ABC
 
Improved Inference for First-Order Autocorrelation Using Likelihood Analysis
Improved Inference for First-Order Autocorrelation Using Likelihood AnalysisImproved Inference for First-Order Autocorrelation Using Likelihood Analysis
Improved Inference for First-Order Autocorrelation Using Likelihood Analysis
 
random variable and distribution
random variable and distributionrandom variable and distribution
random variable and distribution
 

Último

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 

Neural decoding

  • 2. 1 • Encoding: (neuron response) = f(stimuli) • Decoding: (stimuli) = f-1(neuron response) Inverse problem of Encoding Bayesian Theorem is commonly used. 1. P[s]: the probability of stimulus s being presented, often called prior probability 2. P[r], r = (r1, … , rN): spike-count firing rates: the probability of response r being recorded. 3. P[r, s]: the probability of stimulus s being presented and response r being recorded(Joint probability). 4. P[r|s]: the probability of evoking response r, given that stimulus s was presented. 5. P[s|r]: the conditional probability that stimulus s was presented, given that response r was recorded. Neural Decoding
  • 3. Neural Decoding P[r] can be calculated from P[r|s] by summing over all stimulus values weighted by their probabilities. P[r] = ΣsP[r|s]P[s] and P[s] = ΣrP[s|r]P[r] Also, the joint probability P[r|s] times the probability of the stimulus, or as P[s|r] times the probability of the response. P[r, s] = P[r|s]P[s] = P[s|r]P[r] Bayes theorem: P[s|r] = P[r|s]P[s]/P[r] or P[r|s] = P[s|r]P[r]/P[s] 2
  • 4. Neural Decoding Probabilities in decoding: Decoding of intention. 3
  • 5. Probabilities in decoding Two datasets are given, and we decode intention of arm reaching. 4 neuronL neuronR Firing rate during left trial i Firing rate during right trial i 53.9781 57.6395 56.1187 38.0109 67.3739 … 58.3077 56.3932 38.9440 39.9052 50.7743 … (remember Capitalization is important for MATLAB)
  • 8. Probabilities in decoding 7 Neuron 1 Neuron 2 Movement intention Assumption (naïve Bayes)
  • 10. Decoding by Linear Filter Translation from Observed data to Predicted data: 9
  • 11. Decoding by Linear Filter 10 Pinball Task (Serruya et al., Nature, 2002)
  • 12. Decoding by Particle Filter Particle filter: 1. A method for approximating the probability density function by multiple samples 2. This is also called as Monte Calo Filter, Boostrap Filter, Sampling/Importance resampling(SIR) Filter. 3. Independently, Kitagawa and Gordon invented this. Depending on observed data(we would predict that data have noise), we try to focus on expected point by some particles. 11
  • 13. Reverse Correlation A way of construct the receptive field. 1. Random patterns of inputs give to the receptive field. 2. Superimpose response patterns of neurons. 3. Reconstruct the receptive field. The firing rate modulation due to the random stimulus X(t) 12
  • 15. Signal Detection Theory Decision rule: Is the signal present or absent in the noisy back ground? 14 The stimulus s1, no stimulus s0 The likelihood ratio Two possible types of error: 1. Calling the stimulus present when it was not(a false-alarm or False positive) 2. Calling the stimulus absent when it was present(a miss or True negative) ROC curve(a receiver-operating characteristic): Relationship between a false-alarm and a miss
  • 16. 15