SlideShare uma empresa Scribd logo
1 de 12
Deep Learning of Tissue Specific Speckle
Representations in Optical Coherence
Tomography and Deeper Exploration for
In situ Histology
Debdoot Sheet
@ Department of Electrical Engineering, Indian Institute of Technology Kharagpur, India.
Sri Phani Krishna Karri, Jyotirmoy Chatterjee
@ School of Medical Science and Technology, Indian Institute of Technology Kharagpur,
India
Amin Katouzian, Nassir Navab
@ Chair for Computer Aided Medical Procedures, TU Munich, Germany
Ajoy K. Ray
@ Electronics and Electrical Comm. Engg., Indian Institute of Technology Kharagpur, India.
1ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet
Motivation
• Soft tissues – e.g. skin
– Epithelial
– Connective
– Muscular
– Adipose
• Pathological markers
– Extracellular matrix deposition
– Cellular atypia and dysplasia
– Loss of histo-architecture
– Proliferative changes
• Conventional histology
– Patient discomfort
– 48-72 hours delay in processing
• Alternatives
– Subsurface imaging
• Optical coherence tomography (OCT)
• Challenges with the alternative
– Hard to interpret
– Stochastic uncertainty of speckles
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 2
Epithelium, Papillary
dermis, Dermis, Adipose
Where do we stand now?
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 3
This Paper
Text books
R. K. Das (2012), PhD Thesis
A. Barui (2011), PhD Thesis
D. Sheet et.al., ISBI 2014
State of the Art
• In situ Histology with OCT
– G. van Soest et al., (2010), G.
J. Ughi et al., (2013) –
Cardiovascular OCT
– D. Sheet et al., (2013, 2014) –
Cutaneous wounds, oral
• Challenges
– Heuristic features
• Texture
• Intensity statistics
– Heuristic computational
models
• Transfer learning of speckle
occurrence models
– Incomplete representation
dictionary
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 4
Multi-scale
modeling of
OCT speckles
Training
image
set Ground
truth
Random forest
learning
Multi-scale
modeling of
OCT speckles
Test image
Labeled
tissue
Heuristics in State of Art
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 5
The Solution
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 6
DenoisingAutoEncoder
DenoisingAutoEncoder
LogisticReg.
Unfurling the Deep Network
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 7
Learning of Representations
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 8
Representation of speckle
appearance models learned by DAE1
Learning of Representations
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 9
Sparsity of representations learned by
DAE2
Experiment Design
• Data Collection
– School of Medical Science
and Technology, Indian
Institute of Technology
Kharagpur
– 1300 nm (HPBW 100 nm)
Swept Source OCT System
• OCS 1300 SS, ThorLabs, NJ,
USA
• 8 bit bitmap images
– Histology for ground truth
• HE stained
• Samples
– Mus musculus (small mice)
– 16 healthy skin
– 2 wounds on skin
• DNN architecture
– Patch size – 36 × 36 px
– DAE1 – 400 nodes
– DAE2 – 100 nodes
– Target – Logistic Reg.
• 5 outputs
– Sparsity – 20%
– Mini-batch training
• In situ Histology
Performance
– Epithelium – 96%
– Papillary dermis – 93%
– Dermis – 99%
– Adipose tissue – 98%
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 10
Results in Wounds
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 11
(a) OCT image of wound (b) Ground truth (c) In situ histology
Epithelium, Papillary
dermis, Dermis, Adipose
Epithelium, Papillary
dermis, Dermis, Adipose
Take Home Message
• Photons interact characteristically with different tissues.
– Stochastic similarity exists in speckle appearance.
– Such representations are hard to heuristically encode.
• Deep learning and auto-encoders for computational imaging
– Speckle imaging application viz. OCT tissue characterization
– Hierarchical learning
• Locally embedded representations.
• Sparsity is in learned (auto-encoded) representations.
ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 12
Queries: Debdoot Sheet (debdoot@ee.iitkgp.ernet.in)

Mais conteúdo relacionado

Mais procurados

International Journal of Image Processing (IJIP) Volume (3) Issue (6)
International Journal of Image Processing (IJIP) Volume (3) Issue (6)International Journal of Image Processing (IJIP) Volume (3) Issue (6)
International Journal of Image Processing (IJIP) Volume (3) Issue (6)
CSCJournals
 
Slides for talk at BMES Conference 2011
Slides for talk at BMES Conference 2011Slides for talk at BMES Conference 2011
Slides for talk at BMES Conference 2011
Kriti Sharma
 

Mais procurados (19)

Microarray spot partitioning by autonomously organising maps through contour ...
Microarray spot partitioning by autonomously organising maps through contour ...Microarray spot partitioning by autonomously organising maps through contour ...
Microarray spot partitioning by autonomously organising maps through contour ...
 
Advanced Retinal Imaging
Advanced Retinal ImagingAdvanced Retinal Imaging
Advanced Retinal Imaging
 
AN AUTOMATIC SCREENING METHOD TO DETECT OPTIC DISC IN THE RETINA
AN AUTOMATIC SCREENING METHOD TO DETECT OPTIC DISC IN THE RETINAAN AUTOMATIC SCREENING METHOD TO DETECT OPTIC DISC IN THE RETINA
AN AUTOMATIC SCREENING METHOD TO DETECT OPTIC DISC IN THE RETINA
 
An Automatic ROI of The Fundus Photography
An Automatic ROI of The Fundus Photography An Automatic ROI of The Fundus Photography
An Automatic ROI of The Fundus Photography
 
Introduction to resting state fMRI preprocessing and analysis
Introduction to resting state fMRI preprocessing and analysisIntroduction to resting state fMRI preprocessing and analysis
Introduction to resting state fMRI preprocessing and analysis
 
Optical Coherence Tomography: Technology and applications for neuroimaging
Optical Coherence Tomography: Technology and applications for neuroimagingOptical Coherence Tomography: Technology and applications for neuroimaging
Optical Coherence Tomography: Technology and applications for neuroimaging
 
14 15031 image rec ijeecs 1570310214(edit)
14 15031 image rec ijeecs 1570310214(edit)14 15031 image rec ijeecs 1570310214(edit)
14 15031 image rec ijeecs 1570310214(edit)
 
OCT Monte Carlo & Deep Learning
OCT Monte Carlo & Deep LearningOCT Monte Carlo & Deep Learning
OCT Monte Carlo & Deep Learning
 
Hyperspectral Retinal Imaging
Hyperspectral Retinal ImagingHyperspectral Retinal Imaging
Hyperspectral Retinal Imaging
 
Deep Learning for Biomedical Unstructured Time Series
Deep Learning for Biomedical  Unstructured Time SeriesDeep Learning for Biomedical  Unstructured Time Series
Deep Learning for Biomedical Unstructured Time Series
 
Statistical Feature-based Neural Network Approach for the Detection of Lung C...
Statistical Feature-based Neural Network Approach for the Detection of Lung C...Statistical Feature-based Neural Network Approach for the Detection of Lung C...
Statistical Feature-based Neural Network Approach for the Detection of Lung C...
 
Short intro for retinal biomarkers of Alzheimer’s Disease
Short intro for retinal biomarkers of Alzheimer’s DiseaseShort intro for retinal biomarkers of Alzheimer’s Disease
Short intro for retinal biomarkers of Alzheimer’s Disease
 
International Journal of Image Processing (IJIP) Volume (3) Issue (6)
International Journal of Image Processing (IJIP) Volume (3) Issue (6)International Journal of Image Processing (IJIP) Volume (3) Issue (6)
International Journal of Image Processing (IJIP) Volume (3) Issue (6)
 
Automated brain tumor detection and segmentation from mri images using adapti...
Automated brain tumor detection and segmentation from mri images using adapti...Automated brain tumor detection and segmentation from mri images using adapti...
Automated brain tumor detection and segmentation from mri images using adapti...
 
IRJET- Survey based on Detection of Optic Disc in Retinal Images using Segmen...
IRJET- Survey based on Detection of Optic Disc in Retinal Images using Segmen...IRJET- Survey based on Detection of Optic Disc in Retinal Images using Segmen...
IRJET- Survey based on Detection of Optic Disc in Retinal Images using Segmen...
 
Classification of neovascularization using convolutional neural network model
Classification of neovascularization using convolutional neural network modelClassification of neovascularization using convolutional neural network model
Classification of neovascularization using convolutional neural network model
 
Automatic detection of optic disc and blood vessels from retinal images using...
Automatic detection of optic disc and blood vessels from retinal images using...Automatic detection of optic disc and blood vessels from retinal images using...
Automatic detection of optic disc and blood vessels from retinal images using...
 
Survey on Segmentation of Partially Overlapping Objects
Survey on Segmentation of Partially Overlapping ObjectsSurvey on Segmentation of Partially Overlapping Objects
Survey on Segmentation of Partially Overlapping Objects
 
Slides for talk at BMES Conference 2011
Slides for talk at BMES Conference 2011Slides for talk at BMES Conference 2011
Slides for talk at BMES Conference 2011
 

Semelhante a Deep Learning of Tissue Specific Speckle Representations in Optical Coherence Tomography and Deeper Exploration for In situ Histology

iMinds The Conference: Wim van Aarle
iMinds The Conference: Wim van AarleiMinds The Conference: Wim van Aarle
iMinds The Conference: Wim van Aarle
imec
 
Discenza 9.23.09
Discenza 9.23.09Discenza 9.23.09
Discenza 9.23.09
cdiscenz
 
Fireside chat: Newton Howard, Director of the MIT Synthetic Intelligence Lab ...
Fireside chat: Newton Howard, Director of the MIT Synthetic Intelligence Lab ...Fireside chat: Newton Howard, Director of the MIT Synthetic Intelligence Lab ...
Fireside chat: Newton Howard, Director of the MIT Synthetic Intelligence Lab ...
Codiax
 
Employing Electrophysiology and Optogenetics to Measure and Manipulate Neuron...
Employing Electrophysiology and Optogenetics to Measure and Manipulate Neuron...Employing Electrophysiology and Optogenetics to Measure and Manipulate Neuron...
Employing Electrophysiology and Optogenetics to Measure and Manipulate Neuron...
InsideScientific
 

Semelhante a Deep Learning of Tissue Specific Speckle Representations in Optical Coherence Tomography and Deeper Exploration for In situ Histology (20)

Operating an OCT & evaluating normal scan (Optom.Saptarshi Mehta).....
Operating an OCT & evaluating normal scan (Optom.Saptarshi Mehta).....Operating an OCT & evaluating normal scan (Optom.Saptarshi Mehta).....
Operating an OCT & evaluating normal scan (Optom.Saptarshi Mehta).....
 
059 can oct catheter see plaque macrophages
059 can oct catheter see plaque macrophages059 can oct catheter see plaque macrophages
059 can oct catheter see plaque macrophages
 
Esv3n2
Esv3n2Esv3n2
Esv3n2
 
059 can oct catheter see plaque macrophages
059 can oct catheter see plaque macrophages059 can oct catheter see plaque macrophages
059 can oct catheter see plaque macrophages
 
Machine learning for Science and Society
Machine learning for Science and SocietyMachine learning for Science and Society
Machine learning for Science and Society
 
Ccids 2019 cutting edges of ai technology in medicine
Ccids 2019 cutting edges of ai technology in medicineCcids 2019 cutting edges of ai technology in medicine
Ccids 2019 cutting edges of ai technology in medicine
 
Introduction to Machine Learning and Texture Analysis for Lesion Characteriza...
Introduction to Machine Learning and Texture Analysis for Lesion Characteriza...Introduction to Machine Learning and Texture Analysis for Lesion Characteriza...
Introduction to Machine Learning and Texture Analysis for Lesion Characteriza...
 
iMinds The Conference: Wim van Aarle
iMinds The Conference: Wim van AarleiMinds The Conference: Wim van Aarle
iMinds The Conference: Wim van Aarle
 
X-Ray.pptx
X-Ray.pptxX-Ray.pptx
X-Ray.pptx
 
Noura1
Noura1Noura1
Noura1
 
Animal identification using machine learning techniques
Animal identification using machine learning techniquesAnimal identification using machine learning techniques
Animal identification using machine learning techniques
 
PERIOCULAR RECOGNITION USING REDUCED FEATURES
PERIOCULAR RECOGNITION USING REDUCED FEATURESPERIOCULAR RECOGNITION USING REDUCED FEATURES
PERIOCULAR RECOGNITION USING REDUCED FEATURES
 
Ai in healthcare
Ai in healthcareAi in healthcare
Ai in healthcare
 
In Silico Labelling: Predicting Fluorescent Labels in Unlabelled Images
In Silico Labelling: Predicting Fluorescent Labels in Unlabelled ImagesIn Silico Labelling: Predicting Fluorescent Labels in Unlabelled Images
In Silico Labelling: Predicting Fluorescent Labels in Unlabelled Images
 
Lec2: Digital Images and Medical Imaging Modalities
Lec2: Digital Images and Medical Imaging ModalitiesLec2: Digital Images and Medical Imaging Modalities
Lec2: Digital Images and Medical Imaging Modalities
 
Discenza 9.23.09
Discenza 9.23.09Discenza 9.23.09
Discenza 9.23.09
 
Marc at nanomat_md_june_06
Marc at nanomat_md_june_06Marc at nanomat_md_june_06
Marc at nanomat_md_june_06
 
Humanizing bioinformatics
Humanizing bioinformaticsHumanizing bioinformatics
Humanizing bioinformatics
 
Fireside chat: Newton Howard, Director of the MIT Synthetic Intelligence Lab ...
Fireside chat: Newton Howard, Director of the MIT Synthetic Intelligence Lab ...Fireside chat: Newton Howard, Director of the MIT Synthetic Intelligence Lab ...
Fireside chat: Newton Howard, Director of the MIT Synthetic Intelligence Lab ...
 
Employing Electrophysiology and Optogenetics to Measure and Manipulate Neuron...
Employing Electrophysiology and Optogenetics to Measure and Manipulate Neuron...Employing Electrophysiology and Optogenetics to Measure and Manipulate Neuron...
Employing Electrophysiology and Optogenetics to Measure and Manipulate Neuron...
 

Último

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Último (20)

Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 

Deep Learning of Tissue Specific Speckle Representations in Optical Coherence Tomography and Deeper Exploration for In situ Histology

  • 1. Deep Learning of Tissue Specific Speckle Representations in Optical Coherence Tomography and Deeper Exploration for In situ Histology Debdoot Sheet @ Department of Electrical Engineering, Indian Institute of Technology Kharagpur, India. Sri Phani Krishna Karri, Jyotirmoy Chatterjee @ School of Medical Science and Technology, Indian Institute of Technology Kharagpur, India Amin Katouzian, Nassir Navab @ Chair for Computer Aided Medical Procedures, TU Munich, Germany Ajoy K. Ray @ Electronics and Electrical Comm. Engg., Indian Institute of Technology Kharagpur, India. 1ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet
  • 2. Motivation • Soft tissues – e.g. skin – Epithelial – Connective – Muscular – Adipose • Pathological markers – Extracellular matrix deposition – Cellular atypia and dysplasia – Loss of histo-architecture – Proliferative changes • Conventional histology – Patient discomfort – 48-72 hours delay in processing • Alternatives – Subsurface imaging • Optical coherence tomography (OCT) • Challenges with the alternative – Hard to interpret – Stochastic uncertainty of speckles ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 2 Epithelium, Papillary dermis, Dermis, Adipose
  • 3. Where do we stand now? ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 3 This Paper Text books R. K. Das (2012), PhD Thesis A. Barui (2011), PhD Thesis D. Sheet et.al., ISBI 2014
  • 4. State of the Art • In situ Histology with OCT – G. van Soest et al., (2010), G. J. Ughi et al., (2013) – Cardiovascular OCT – D. Sheet et al., (2013, 2014) – Cutaneous wounds, oral • Challenges – Heuristic features • Texture • Intensity statistics – Heuristic computational models • Transfer learning of speckle occurrence models – Incomplete representation dictionary ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 4 Multi-scale modeling of OCT speckles Training image set Ground truth Random forest learning Multi-scale modeling of OCT speckles Test image Labeled tissue
  • 5. Heuristics in State of Art ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 5
  • 6. The Solution ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 6 DenoisingAutoEncoder DenoisingAutoEncoder LogisticReg.
  • 7. Unfurling the Deep Network ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 7
  • 8. Learning of Representations ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 8 Representation of speckle appearance models learned by DAE1
  • 9. Learning of Representations ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 9 Sparsity of representations learned by DAE2
  • 10. Experiment Design • Data Collection – School of Medical Science and Technology, Indian Institute of Technology Kharagpur – 1300 nm (HPBW 100 nm) Swept Source OCT System • OCS 1300 SS, ThorLabs, NJ, USA • 8 bit bitmap images – Histology for ground truth • HE stained • Samples – Mus musculus (small mice) – 16 healthy skin – 2 wounds on skin • DNN architecture – Patch size – 36 × 36 px – DAE1 – 400 nodes – DAE2 – 100 nodes – Target – Logistic Reg. • 5 outputs – Sparsity – 20% – Mini-batch training • In situ Histology Performance – Epithelium – 96% – Papillary dermis – 93% – Dermis – 99% – Adipose tissue – 98% ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 10
  • 11. Results in Wounds ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 11 (a) OCT image of wound (b) Ground truth (c) In situ histology Epithelium, Papillary dermis, Dermis, Adipose Epithelium, Papillary dermis, Dermis, Adipose
  • 12. Take Home Message • Photons interact characteristically with different tissues. – Stochastic similarity exists in speckle appearance. – Such representations are hard to heuristically encode. • Deep learning and auto-encoders for computational imaging – Speckle imaging application viz. OCT tissue characterization – Hierarchical learning • Locally embedded representations. • Sparsity is in learned (auto-encoded) representations. ISBI 2015 / FrDT3.5 - Deep Learning of Tissue Specific Speckle... - Debdoot Sheet 12 Queries: Debdoot Sheet (debdoot@ee.iitkgp.ernet.in)