Stereoscopic Display of Lung PET/CT DICOM Scans using Perspective
1. Stereoscopic Display of Lung PET/
CT DICOM Scans using Perspective
使用透視法於肺部 PET/CT DICOM 影像之三維立體顯示
Student:Yueh-Ju Chen
Advisor: Dr. Tang-Kai Yin
Institute of Computer Science and Information Engineering
National University of Kaohsiung
2. • Introduction
• Motivation
• Related Works
• Proposed Approach
• DICOM Analysis
• Stereoscopic
• Result
• Conclusion and Future Work
Institute of Computer Science and Information Engineering
2 National University of Kaohsiung
3. Introduction
Institute of Computer Science and Information Engineering
National University of Kaohsiung
4. Background
• Computed tomography:
• A medical imaging procedure
• Utilizing computer-processed
X-rays to produce tomographic
images or 'slices' of specific
areas of the body
• Stereoscopy:
• The illusion 3D depth from images on a 2D plane
Institute of Computer Science and Information Engineering
4 National University of Kaohsiung
5. Motivation
• 3D effect get popular
• Not a new technology
• Medical diagnosis:
• Improve the efficiency of diagnosis
• Surgical simulation
• Education training
Institute of Computer Science and Information Engineering
5 National University of Kaohsiung
6. Algorithm
Institute of Computer Science and Information Engineering
National University of Kaohsiung
7. Related Works
Institute of Computer Science and Information Engineering
National University of Kaohsiung
8. Medical Scans
• DICOM file:
• File format
• DICOM Standards Committee
• Widely used by hospitals
• Dividing into two parts:
• Image
• Header (metadata) files
Institute of Computer Science and Information Engineering
8 National University of Kaohsiung
9. Maximum Intensity
Projection (MIP)
• Volume rendering method
• Voxels with maximum intensity
• Orthographic projection
• Cannot distinguish between left or right,
front or back
• Detection of lung nodules
Institute of Computer Science and Information Engineering
9 National University of Kaohsiung
10. Standardized Uptake
Value (SUV)
• Distinguish between malignant lesions and
benign tumor
• Enhances the 3D nature of nodules
• Pulmonary bronchi and vasculature
• Cut-off value for malignant lesion is 2.5
Institute of Computer Science and Information Engineering
10 National University of Kaohsiung
11. Stereoscopic
• Illusion of 3D depth from images on a 2D
plane
• 3D viewer technology:
• Anaglyph
• Active shutter systems
• Polarization systems
Institute of Computer Science and Information Engineering
11 National University of Kaohsiung
12. NVIDIA 3D Vision
• Shutter glasses and driver software
• Direct3D software
• Mainstream consumers and PC gamers
• Requirement:
• 120 Hz LCD or CRT
monitors, DLP-projectors
• NVIDIA graphics card
Institute of Computer Science and Information Engineering
12 National University of Kaohsiung
13. Proposed Approach
Institute of Computer Science and Information Engineering
National University of Kaohsiung
14. DICOM Analysis
Institute of Computer Science and Information Engineering
National University of Kaohsiung
15. Calculation of SUV
• Referred to as the dose uptake ratio
• Main calculate source: PET DICOM
• The related attributed tags:
• Rescale Slope tag
• Rescale Intercept tag
Institute of Computer Science and Information Engineering
15 National University of Kaohsiung
16. Step 1: Convert Pixel Value to
Activity Concentration
• Rescale Slope tag are vary for every image
slice
Institute of Computer Science and Information Engineering
16 National University of Kaohsiung
17. Step 2: Decay Calibration Factor
Institute of Computer Science and Information Engineering
17 National University of Kaohsiung
18. Step 3: Calculate SUV
Institute of Computer Science and Information Engineering
18 National University of Kaohsiung
19. SUV
Number 147 and 195 slice (a)original PET (b)SUV (c) threshold with 2.5
Institute of Computer Science and Information Engineering
National University of Kaohsiung
20. Non-body Pixels
Non-body
Original CT
pixels removed
Institute of Computer Science and Information Engineering
20 National University of Kaohsiung
21. Body Mask
Institute of Computer Science and Information Engineering
21 National University of Kaohsiung
22. Body Mask (cont.)
Institute of Computer Science and Information Engineering
22 National University of Kaohsiung
23. Stereoscopic
Institute of Computer Science and Information Engineering
National University of Kaohsiung
24. Real 3D vs. Fake 3D
• Fake 3D
• Converting 2D films into 3D
• Depth map
• Real 3D
• Two views
• Two different cameras (or projections)
Institute of Computer Science and Information Engineering
24 National University of Kaohsiung
25. Stereoscopic Principle
• D: distance between the
viewpoint and the screen
• R: distance of stereo pair
of images on the screen
• S: distance between the
perceived object and the
screen
Institute of Computer Science and Information Engineering
25 National University of Kaohsiung
26. Optical Angle
• Best viewing range:
70~500cm
• Distance between the
two eyes: 6.5~7cm
•
Institute of Computer Science and Information Engineering
26 National University of Kaohsiung
27. Eye Separation
• The most suitable for the 3D effect:
• Distance: 140~210 cm
• Optical angle: 2.86~1.91 degree
Institute of Computer Science and Information Engineering
27 National University of Kaohsiung
28. Perspective
Institute of Computer Science and Information Engineering
28 National University of Kaohsiung
29. Perspective
Institute of Computer Science and Information Engineering
29 National University of Kaohsiung
30. Perspective
Institute of Computer Science and Information Engineering
30 National University of Kaohsiung
31. Perspective
Institute of Computer Science and Information Engineering
31 National University of Kaohsiung
32. Parallax
Institute of Computer Science and Information Engineering
National University of Kaohsiung
33. Positive and Zero
Parallax
• Positive Parallax
• Cross point of each eye sight with the
screen
• Behind the screen
• Zero Parallax
• Overlap on the screen
• No 3D effect
Institute of Computer Science and Information Engineering
33 National University of Kaohsiung
34. Negative Parallax
• Focus heating-point in front of the screen
• Out of screen
• The closer the screen is the smaller depth of
field will be generated
Institute of Computer Science and Information Engineering
34 National University of Kaohsiung
35. Parallax Adjustment
Institute of Computer Science and Information Engineering
National University of Kaohsiung
36. Result
Institute of Computer Science and Information Engineering
National University of Kaohsiung
37. NVIDIA 3D
Vision
1. OpenGL QuadBuffer
2. NVAPI
3. 3D Video
Institute of Computer Science and Information Engineering
37 National University of Kaohsiung
38. Experiment
Environment
ASUS G53J
Platform: Win7 64bit
CPU: Intel i7-7400QM @1.73GHz
RAM: 8GM
Graphic Card: NVIDIA GTX 460M
1.5G
Institute of Computer Science and Information Engineering
38 National University of Kaohsiung
39. MIP
0 degree of MIP
100 degree of MIP
Institute of Computer Science and Information Engineering
39 National University of Kaohsiung
40. MIP
240 degree of MIP
280 degree of MIP
Institute of Computer Science and Information Engineering
40 National University of Kaohsiung
41. Perspective of Mean Volume
Rendering
0 degree of Perspective of Mean Volume Rendering
100 degree of Perspective of Mean Volume Rendering
Institute of Computer Science and Information Engineering
National University of Kaohsiung
42. Perspective of Mean Volume
Rendering
240 degree of Perspective of Mean Volume Rendering
280 degree of Perspective of Mean Volume Rendering
Institute of Computer Science and Information Engineering
National University of Kaohsiung
43. Perspective with Bilinear
Interpolation
0 degree of Perspective with Bilinear Interpolation
100 degree of Perspective with Bilinear Interpolation
Institute of Computer Science and Information Engineering
National University of Kaohsiung
44. Perspective with Bilinear
Interpolation
240 degree of Perspective with Bilinear Interpolation
280 degree of Perspective with Bilinear Interpolation
Institute of Computer Science and Information Engineering
National University of Kaohsiung
45. Conclusion
&
Future Work
Institute of Computer Science and Information Engineering
National University of Kaohsiung
46. Conclusion
• The stereoscopic image created by a perspective
projection and applied with SUV calculation of PET
scans in 3D shutter system.
• Expending vision from 2D to 3D and the biggest
difference between them is the depth information.
• 2D images cannot distinguish three points which is
in the front or which is in the back, but after we
applied the stereoscopic techniques it is more
obvious and clear to distinguish points’ relation and
distance between them
Institute of Computer Science and Information Engineering
46 National University of Kaohsiung
47. Future Work
• A medical analyze system with stereoscopic
display
• More medical analyze functions
• Real time volume rendering
• Auto-stereoscopic
Institute of Computer Science and Information Engineering
47 National University of Kaohsiung
48. Demo
Institute of Computer Science and Information Engineering
National University of Kaohsiung
49. Q &A
Institute of Computer Science and Information Engineering
National University of Kaohsiung