SlideShare uma empresa Scribd logo
1 de 1
Min filtered
Max filtered
Input signal
Kernel
Nearest value output
Comparing
difference
max
min
3. output
1. Input
2. max/min
#Limitation: Only one edge in a Kernel window
Removing Depth Map Coding Distortion
by Using Post Filter Set
Norishige Fukushima*, Tomohiko Inoue, Yutaka Ishibashi
Graduate School of Engineering, Nagoya Institute of Technology
Introduction and Overview Experimental Results
Proposed Method
Various codec, JPEG, JPEG2000, JPEG-
LS, H.264/AVC, can encode depth map and
these codecs have coding distortion.
Objective of this paper is removing
distortions by using post filter set.
Problem and OverviewBackground
Median Filter
R-D curve of various image codecs
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 0
1 1 1 0 0
1 1 0 0 0
Box Filter
Binary Weighted Range Filter (BWRF)
Box Filter
BWRFInput
Profile
curve
position
Min-max Blur Remove Filter
Binary Weighted Range Filter
3D scene
2cm
8cm
Source
view
Virtual
views
RAW Image
RAW depth
map
RAW Image
Coded/filtered
depth map
comparecompare
Experimental Setup
Depth map and image captured
from Kinect. Depth maps are
coded by various codecs.
#Image is not compressed.
[1]K. Lai, L .Bo, X. Ren, and D. Fox, “A large-scale
hierarchical multi-view rgb-d object dataset.,” in
Proc. ICRA, pp. 1817–1824, May 2011.
[2] K.-J. Oh, A. Vetro, and Y.-S. Ho, “Depth coding
using a boundary reconstruction filter for 3-d video
systems,” IEEE Trans. CSVT, vol. 21, no. 3, pp. 350 –
359, Mar. 2011.
Trans
mission
Encode Decode
Post
filtering
View
synthesis
Depth
Map
Image
Median
Filter
Min-Max
Blur Remove
Filter
Weighted
Range Filter
Over quantization
is recovered
Boundary blur
is removed
Spike noise
is removed
Gaussian
Filter
Gaussian noise
is removed
Project site/Source code: http://nma.web.nitech.ac.jp/fukushima/research/depthmap_postfilter.html
Reference
Computational Time
15 ms
Intel Core i7 2.93GHz (4core HT)
Parallelization: SSE4, Intel TBB
Language:C++
IEEE International Conference on Multimedia & Expo (ICME), July 2013

Mais conteúdo relacionado

Destaque

ガイデットフィルタとその周辺
ガイデットフィルタとその周辺ガイデットフィルタとその周辺
ガイデットフィルタとその周辺
Norishige Fukushima
 
組み込み関数(intrinsic)によるSIMD入門
組み込み関数(intrinsic)によるSIMD入門組み込み関数(intrinsic)によるSIMD入門
組み込み関数(intrinsic)によるSIMD入門
Norishige Fukushima
 
OpenCVをAndroidで動かしてみた
OpenCVをAndroidで動かしてみたOpenCVをAndroidで動かしてみた
OpenCVをAndroidで動かしてみた
徹 上野山
 
複数台のKinectV2の使い方
複数台のKinectV2の使い方複数台のKinectV2の使い方
複数台のKinectV2の使い方
Norishige Fukushima
 

Destaque (7)

Popcntによるハミング距離計算
Popcntによるハミング距離計算Popcntによるハミング距離計算
Popcntによるハミング距離計算
 
ガイデットフィルタとその周辺
ガイデットフィルタとその周辺ガイデットフィルタとその周辺
ガイデットフィルタとその周辺
 
組み込み関数(intrinsic)によるSIMD入門
組み込み関数(intrinsic)によるSIMD入門組み込み関数(intrinsic)によるSIMD入門
組み込み関数(intrinsic)によるSIMD入門
 
OpenCVをAndroidで動かしてみた
OpenCVをAndroidで動かしてみたOpenCVをAndroidで動かしてみた
OpenCVをAndroidで動かしてみた
 
マルチコアを用いた画像処理
マルチコアを用いた画像処理マルチコアを用いた画像処理
マルチコアを用いた画像処理
 
複数台のKinectV2の使い方
複数台のKinectV2の使い方複数台のKinectV2の使い方
複数台のKinectV2の使い方
 
画像処理ライブラリ OpenCV で 出来ること・出来ないこと
画像処理ライブラリ OpenCV で 出来ること・出来ないこと画像処理ライブラリ OpenCV で 出来ること・出来ないこと
画像処理ライブラリ OpenCV で 出来ること・出来ないこと
 

Mais de Norishige Fukushima

Mais de Norishige Fukushima (6)

画像処理の高性能計算
画像処理の高性能計算画像処理の高性能計算
画像処理の高性能計算
 
計算スケジューリングの効果~もし,Halideがなかったら?~
計算スケジューリングの効果~もし,Halideがなかったら?~計算スケジューリングの効果~もし,Halideがなかったら?~
計算スケジューリングの効果~もし,Halideがなかったら?~
 
多チャンネルバイラテラルフィルタの高速化
多チャンネルバイラテラルフィルタの高速化多チャンネルバイラテラルフィルタの高速化
多チャンネルバイラテラルフィルタの高速化
 
計算機アーキテクチャを考慮した高能率画像処理プログラミング
計算機アーキテクチャを考慮した高能率画像処理プログラミング計算機アーキテクチャを考慮した高能率画像処理プログラミング
計算機アーキテクチャを考慮した高能率画像処理プログラミング
 
3次元計測とフィルタリング
3次元計測とフィルタリング3次元計測とフィルタリング
3次元計測とフィルタリング
 
デプスセンサとその応用
デプスセンサとその応用デプスセンサとその応用
デプスセンサとその応用
 

Último

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Último (20)

08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 

Removing depth map coding distortion by using post filter set

  • 1. Min filtered Max filtered Input signal Kernel Nearest value output Comparing difference max min 3. output 1. Input 2. max/min #Limitation: Only one edge in a Kernel window Removing Depth Map Coding Distortion by Using Post Filter Set Norishige Fukushima*, Tomohiko Inoue, Yutaka Ishibashi Graduate School of Engineering, Nagoya Institute of Technology Introduction and Overview Experimental Results Proposed Method Various codec, JPEG, JPEG2000, JPEG- LS, H.264/AVC, can encode depth map and these codecs have coding distortion. Objective of this paper is removing distortions by using post filter set. Problem and OverviewBackground Median Filter R-D curve of various image codecs 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 0 1 1 0 0 0 Box Filter Binary Weighted Range Filter (BWRF) Box Filter BWRFInput Profile curve position Min-max Blur Remove Filter Binary Weighted Range Filter 3D scene 2cm 8cm Source view Virtual views RAW Image RAW depth map RAW Image Coded/filtered depth map comparecompare Experimental Setup Depth map and image captured from Kinect. Depth maps are coded by various codecs. #Image is not compressed. [1]K. Lai, L .Bo, X. Ren, and D. Fox, “A large-scale hierarchical multi-view rgb-d object dataset.,” in Proc. ICRA, pp. 1817–1824, May 2011. [2] K.-J. Oh, A. Vetro, and Y.-S. Ho, “Depth coding using a boundary reconstruction filter for 3-d video systems,” IEEE Trans. CSVT, vol. 21, no. 3, pp. 350 – 359, Mar. 2011. Trans mission Encode Decode Post filtering View synthesis Depth Map Image Median Filter Min-Max Blur Remove Filter Weighted Range Filter Over quantization is recovered Boundary blur is removed Spike noise is removed Gaussian Filter Gaussian noise is removed Project site/Source code: http://nma.web.nitech.ac.jp/fukushima/research/depthmap_postfilter.html Reference Computational Time 15 ms Intel Core i7 2.93GHz (4core HT) Parallelization: SSE4, Intel TBB Language:C++ IEEE International Conference on Multimedia & Expo (ICME), July 2013