SlideShare uma empresa Scribd logo
1 de 19
Source-Location-Informed Sound Field
Recording and Reproduction:
A Generalization to Arrays of Arbitrary
Geometry
Shoichi Koyama
The University of Tokyo / Université Paris Diderot (Institut Langevin)
July 19, 2016
Super-resolution in Recording and Reproduction
Improve reproduction accuracy when
less microphones than loudspeakers
 # of microphones > # of loudspeakers
– Higher reproduction accuracy within local region of target area
 # of microphones < # of loudspeakers
– Higher reproduction accuracy of sources in local region of recording area
[Koyama+ ICASSP 2014], [Koyama+ IEEE JSTSP 2015]
[Ahrens+ AES Conv. 2010]
Microphone array Loudspeaker array
Sound Field Recording and Reproduction
July 19, 2016
Recording area Target area
Obtain driving signals of secondary sources (= loudspeakers)
arranged on to reconstruct desired sound field inside
 Inherently, sound pressure and its gradient on is required to obtain
, but sound pressure is usually only known
 Fast and stable signal conversion for sound field recording and reproduction
with ordinary acoustic sensors and transducers is required
Primary
sources
July 19, 2016
Wave field reconstruction (WFR) filtering method
Target area
Received
signals
Driving signals
Plane wave Plane wave
Each plane wave determines entire sound field
Spatial aliasing artifacts due to plane wave decomposition
Significant error at high freq. even when microphone < loudspeaker
Recording area
[Koyama+ IEEE TASLP 2013]
Signal
conversion
Secondary source planeReceiving plane
Primary
sources
Source-Location-Informed Recording and Reproduction
 Signal conversion method that takes into account a priori knowledge of primary
source locations
 This prior information can be obtained by using various types of sensors or by
manual input
 By exploiting this prior information, reproduction accuracy above the spatial
Nyquist freq can be improved
 Apply the method proposed in [Koyama+ IEEE JSTSP 2015] to several array
geometries
July 19, 2016
Target areaRecording area
Signal
conversion
Secondary source planeReceiving plane
Primary
sources
Approximate location is
obtained by sensors
Statement of Problem
July 19, 2016
Target areaRecording area
Primary
sources
Secondary source distribution:
Microphone array on baffle
Control points
Constraint on driving signals
Linear combination of spatial basis functions
Transfer functionDesired
pressures
Optimize and by
using prior information on
source locations
Statement of Problem
July 19, 2016
Target areaRecording area
Primary
sources
Secondary source distribution:
Control points
 Two requirement must be satisfied to apply the method proposed in
[Koyama+ IEEE JSTSP 2015]
1. The relationship between and can be obtained
2. The amplitude distribution of the driving signals of the secondary
sources can be predicted from prior information on the source location
Microphone array on baffle
Modified Transfer Function
 For the first requirement, we consider modified transfer function
that relates with
 For planar / linear array case, because can
be equivalent to
 When microphones are mounted on baffle,
 We here show an example of a cylindrical array
– Spherical array case is presented in [Koyama+ WASPAA 2015]
July 19, 2016
Modified Transfer Function
 Synthesized sound field in cylindrical
harmonic domain
 Desired sound field in cylindrical harmonic
domain
July 19, 2016
Modified transfer function for cylindrical arrays of microphones and loudspeakers
MAP Estimation of Driving Signals
 Likelihood function: complex Gaussian distribution
 Prior distribution: Amplitude distribution of ( ) predicted from
approximate primary source location is incorporated
July 19, 2016
Maximum a posteriori (MAP) estimation
Bayes’ rule
Likelihood function Prior distribution
MAP Estimation of Driving Signals
 Objective function:
 Assume that spatial basis functions are M orthogonal functions, which
satisfies the following relation of singular value decomposition
 Optimal spatial basis functions and their coefficients
 Driving signals obtained by MAP estimation
July 19, 2016
( : regularization parameter)
Prior Based on Primary Source Locations
 Amplitude distribution can be obtained by assuming point
source at prior source location with sound field synthesis
techniques
 When array geometry is cylinder and estimated primary source
location is , predicted driving signal is
obtained as
July 19, 2016
Normalization
Algorithm
July 19, 2016
Discretize secondary source distribution
Amplitude distribution for prior
Algorithm
1. Detect source location ( )
2. Calculate amplitude distribution
3. Calculate as
4. Eigenvalue decomposition of
5. Obtain transform filter as
July 19, 2016
Simulation Experiments
 Simulation using cylindrical arrays of microphones and
loudspeakers under free-field assumption
 Proposed method is compared with WFR filtering method
 Microphone array:
– Radius: 0.12 m, # of microphones: 32 in x 6 in
 Loudspeaker array:
– Radius: 1.5 m, # of loudspeakers: 32 in x 12 in
 Evaluation w/ signal-to-distortion ratio (SDR) at radius
July 19, 2016
[Koyama+ IEEE TASLP 2014]
Reproduced and original pressure distribution
Reproduced pressure distribution (x-y-plane)
July 19, 2016
PressureError
Proposed WFR
 Source location: (2.0 m, 155 deg, -0.4) m, Source signal: 1.6 kHz
Reproduced pressure distribution (y-z-plane)
July 19, 2016
PressureError
Proposed WFR
 Source location: (2.0 m, 155 deg, -0.4) m, Source signal: 1.6 kHz
Relationship between distance and SDR
July 19, 2016
 Source location: (2.0 m, 155 deg, -0.4) m, Source signal: 1.6 kHz
Almost the same reproduction
accuracy even when prior source
location was perturbed
Conclusion
 Source-location-informed sound field recording and
reproduction for several types of array geometries
– Signal conversion method that takes into account prior information on
primary source locations
– Spatial basis functions and their coefficients are optimized
– Two requirements:
1. Relationship between desired and received sound pressures can be
obtained
2. Amplitude distribution of driving signals of secondary sources can
be predicted from prior source locations
– Simulation results using cylindrical arrays indicated that region of high
reproduction accuracy of proposed method was larger than that of WFR
filtering method
July 19, 2016
Thank you for your attention!

Mais conteúdo relacionado

Mais procurados

Robust music signal separation based on supervised nonnegative matrix factori...
Robust music signal separation based on supervised nonnegative matrix factori...Robust music signal separation based on supervised nonnegative matrix factori...
Robust music signal separation based on supervised nonnegative matrix factori...Daichi Kitamura
 
Blind audio source separation based on time-frequency structure models
Blind audio source separation based on time-frequency structure modelsBlind audio source separation based on time-frequency structure models
Blind audio source separation based on time-frequency structure modelsKitamura Laboratory
 
Linear multichannel blind source separation based on time-frequency mask obta...
Linear multichannel blind source separation based on time-frequency mask obta...Linear multichannel blind source separation based on time-frequency mask obta...
Linear multichannel blind source separation based on time-frequency mask obta...Kitamura Laboratory
 
Online divergence switching for superresolution-based nonnegative matrix fact...
Online divergence switching for superresolution-based nonnegative matrix fact...Online divergence switching for superresolution-based nonnegative matrix fact...
Online divergence switching for superresolution-based nonnegative matrix fact...Daichi Kitamura
 
Prior distribution design for music bleeding-sound reduction based on nonnega...
Prior distribution design for music bleeding-sound reduction based on nonnega...Prior distribution design for music bleeding-sound reduction based on nonnega...
Prior distribution design for music bleeding-sound reduction based on nonnega...Kitamura Laboratory
 
Efficient initialization for nonnegative matrix factorization based on nonneg...
Efficient initialization for nonnegative matrix factorization based on nonneg...Efficient initialization for nonnegative matrix factorization based on nonneg...
Efficient initialization for nonnegative matrix factorization based on nonneg...Daichi Kitamura
 
Hybrid multichannel signal separation using supervised nonnegative matrix fac...
Hybrid multichannel signal separation using supervised nonnegative matrix fac...Hybrid multichannel signal separation using supervised nonnegative matrix fac...
Hybrid multichannel signal separation using supervised nonnegative matrix fac...Daichi Kitamura
 
DNN-based frequency component prediction for frequency-domain audio source se...
DNN-based frequency component prediction for frequency-domain audio source se...DNN-based frequency component prediction for frequency-domain audio source se...
DNN-based frequency component prediction for frequency-domain audio source se...Kitamura Laboratory
 
Superresolution-based stereo signal separation via supervised nonnegative mat...
Superresolution-based stereo signal separation via supervised nonnegative mat...Superresolution-based stereo signal separation via supervised nonnegative mat...
Superresolution-based stereo signal separation via supervised nonnegative mat...Daichi Kitamura
 
Blind source separation based on independent low-rank matrix analysis and its...
Blind source separation based on independent low-rank matrix analysis and its...Blind source separation based on independent low-rank matrix analysis and its...
Blind source separation based on independent low-rank matrix analysis and its...Daichi Kitamura
 
Depth estimation of sound images using directional clustering and activation-...
Depth estimation of sound images using directional clustering and activation-...Depth estimation of sound images using directional clustering and activation-...
Depth estimation of sound images using directional clustering and activation-...Daichi Kitamura
 
Blind source separation based on independent low-rank matrix analysis and its...
Blind source separation based on independent low-rank matrix analysis and its...Blind source separation based on independent low-rank matrix analysis and its...
Blind source separation based on independent low-rank matrix analysis and its...Daichi Kitamura
 
Online Divergence Switching for Superresolution-Based Nonnegative Matrix Fa...
Online Divergence Switching for  Superresolution-Based  Nonnegative Matrix Fa...Online Divergence Switching for  Superresolution-Based  Nonnegative Matrix Fa...
Online Divergence Switching for Superresolution-Based Nonnegative Matrix Fa...奈良先端大 情報科学研究科
 
DNN-based permutation solver for frequency-domain independent component analy...
DNN-based permutation solver for frequency-domain independent component analy...DNN-based permutation solver for frequency-domain independent component analy...
DNN-based permutation solver for frequency-domain independent component analy...Kitamura Laboratory
 
Depth Estimation of Sound Images Using Directional Clustering and Activation...
Depth Estimation of Sound Images Using  Directional Clustering and Activation...Depth Estimation of Sound Images Using  Directional Clustering and Activation...
Depth Estimation of Sound Images Using Directional Clustering and Activation...奈良先端大 情報科学研究科
 
Audio Source Separation Based on Low-Rank Structure and Statistical Independence
Audio Source Separation Based on Low-Rank Structure and Statistical IndependenceAudio Source Separation Based on Low-Rank Structure and Statistical Independence
Audio Source Separation Based on Low-Rank Structure and Statistical IndependenceDaichi Kitamura
 
Experimental analysis of optimal window length for independent low-rank matri...
Experimental analysis of optimal window length for independent low-rank matri...Experimental analysis of optimal window length for independent low-rank matri...
Experimental analysis of optimal window length for independent low-rank matri...Daichi Kitamura
 
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...奈良先端大 情報科学研究科
 
コサイン類似度罰則条件付き半教師あり非負値行列因子分解と音源分離への応用
コサイン類似度罰則条件付き半教師あり非負値行列因子分解と音源分離への応用コサイン類似度罰則条件付き半教師あり非負値行列因子分解と音源分離への応用
コサイン類似度罰則条件付き半教師あり非負値行列因子分解と音源分離への応用Kitamura Laboratory
 
Learning the Statistical Model of the NMF Using the Deep Multiplicative Updat...
Learning the Statistical Model of the NMF Using the Deep Multiplicative Updat...Learning the Statistical Model of the NMF Using the Deep Multiplicative Updat...
Learning the Statistical Model of the NMF Using the Deep Multiplicative Updat...Hiroki_Tanji
 

Mais procurados (20)

Robust music signal separation based on supervised nonnegative matrix factori...
Robust music signal separation based on supervised nonnegative matrix factori...Robust music signal separation based on supervised nonnegative matrix factori...
Robust music signal separation based on supervised nonnegative matrix factori...
 
Blind audio source separation based on time-frequency structure models
Blind audio source separation based on time-frequency structure modelsBlind audio source separation based on time-frequency structure models
Blind audio source separation based on time-frequency structure models
 
Linear multichannel blind source separation based on time-frequency mask obta...
Linear multichannel blind source separation based on time-frequency mask obta...Linear multichannel blind source separation based on time-frequency mask obta...
Linear multichannel blind source separation based on time-frequency mask obta...
 
Online divergence switching for superresolution-based nonnegative matrix fact...
Online divergence switching for superresolution-based nonnegative matrix fact...Online divergence switching for superresolution-based nonnegative matrix fact...
Online divergence switching for superresolution-based nonnegative matrix fact...
 
Prior distribution design for music bleeding-sound reduction based on nonnega...
Prior distribution design for music bleeding-sound reduction based on nonnega...Prior distribution design for music bleeding-sound reduction based on nonnega...
Prior distribution design for music bleeding-sound reduction based on nonnega...
 
Efficient initialization for nonnegative matrix factorization based on nonneg...
Efficient initialization for nonnegative matrix factorization based on nonneg...Efficient initialization for nonnegative matrix factorization based on nonneg...
Efficient initialization for nonnegative matrix factorization based on nonneg...
 
Hybrid multichannel signal separation using supervised nonnegative matrix fac...
Hybrid multichannel signal separation using supervised nonnegative matrix fac...Hybrid multichannel signal separation using supervised nonnegative matrix fac...
Hybrid multichannel signal separation using supervised nonnegative matrix fac...
 
DNN-based frequency component prediction for frequency-domain audio source se...
DNN-based frequency component prediction for frequency-domain audio source se...DNN-based frequency component prediction for frequency-domain audio source se...
DNN-based frequency component prediction for frequency-domain audio source se...
 
Superresolution-based stereo signal separation via supervised nonnegative mat...
Superresolution-based stereo signal separation via supervised nonnegative mat...Superresolution-based stereo signal separation via supervised nonnegative mat...
Superresolution-based stereo signal separation via supervised nonnegative mat...
 
Blind source separation based on independent low-rank matrix analysis and its...
Blind source separation based on independent low-rank matrix analysis and its...Blind source separation based on independent low-rank matrix analysis and its...
Blind source separation based on independent low-rank matrix analysis and its...
 
Depth estimation of sound images using directional clustering and activation-...
Depth estimation of sound images using directional clustering and activation-...Depth estimation of sound images using directional clustering and activation-...
Depth estimation of sound images using directional clustering and activation-...
 
Blind source separation based on independent low-rank matrix analysis and its...
Blind source separation based on independent low-rank matrix analysis and its...Blind source separation based on independent low-rank matrix analysis and its...
Blind source separation based on independent low-rank matrix analysis and its...
 
Online Divergence Switching for Superresolution-Based Nonnegative Matrix Fa...
Online Divergence Switching for  Superresolution-Based  Nonnegative Matrix Fa...Online Divergence Switching for  Superresolution-Based  Nonnegative Matrix Fa...
Online Divergence Switching for Superresolution-Based Nonnegative Matrix Fa...
 
DNN-based permutation solver for frequency-domain independent component analy...
DNN-based permutation solver for frequency-domain independent component analy...DNN-based permutation solver for frequency-domain independent component analy...
DNN-based permutation solver for frequency-domain independent component analy...
 
Depth Estimation of Sound Images Using Directional Clustering and Activation...
Depth Estimation of Sound Images Using  Directional Clustering and Activation...Depth Estimation of Sound Images Using  Directional Clustering and Activation...
Depth Estimation of Sound Images Using Directional Clustering and Activation...
 
Audio Source Separation Based on Low-Rank Structure and Statistical Independence
Audio Source Separation Based on Low-Rank Structure and Statistical IndependenceAudio Source Separation Based on Low-Rank Structure and Statistical Independence
Audio Source Separation Based on Low-Rank Structure and Statistical Independence
 
Experimental analysis of optimal window length for independent low-rank matri...
Experimental analysis of optimal window length for independent low-rank matri...Experimental analysis of optimal window length for independent low-rank matri...
Experimental analysis of optimal window length for independent low-rank matri...
 
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
 
コサイン類似度罰則条件付き半教師あり非負値行列因子分解と音源分離への応用
コサイン類似度罰則条件付き半教師あり非負値行列因子分解と音源分離への応用コサイン類似度罰則条件付き半教師あり非負値行列因子分解と音源分離への応用
コサイン類似度罰則条件付き半教師あり非負値行列因子分解と音源分離への応用
 
Learning the Statistical Model of the NMF Using the Deep Multiplicative Updat...
Learning the Statistical Model of the NMF Using the Deep Multiplicative Updat...Learning the Statistical Model of the NMF Using the Deep Multiplicative Updat...
Learning the Statistical Model of the NMF Using the Deep Multiplicative Updat...
 

Destaque

HMMに基づく日本人英語音声合成における中学生徒の英語音声を用いた評価
HMMに基づく日本人英語音声合成における中学生徒の英語音声を用いた評価HMMに基づく日本人英語音声合成における中学生徒の英語音声を用いた評価
HMMに基づく日本人英語音声合成における中学生徒の英語音声を用いた評価Shinnosuke Takamichi
 
Moment matching networkを用いた音声パラメータのランダム生成の検討
Moment matching networkを用いた音声パラメータのランダム生成の検討Moment matching networkを用いた音声パラメータのランダム生成の検討
Moment matching networkを用いた音声パラメータのランダム生成の検討Shinnosuke Takamichi
 
数値解析と物理学
数値解析と物理学数値解析と物理学
数値解析と物理学すずしめ
 
独立性に基づくブラインド音源分離の発展と独立低ランク行列分析 History of independence-based blind source sep...
独立性に基づくブラインド音源分離の発展と独立低ランク行列分析 History of independence-based blind source sep...独立性に基づくブラインド音源分離の発展と独立低ランク行列分析 History of independence-based blind source sep...
独立性に基づくブラインド音源分離の発展と独立低ランク行列分析 History of independence-based blind source sep...Daichi Kitamura
 

Destaque (10)

Ea2015 7for ss
Ea2015 7for ssEa2015 7for ss
Ea2015 7for ss
 
Discriminative SNMF EA201603
Discriminative SNMF EA201603Discriminative SNMF EA201603
Discriminative SNMF EA201603
 
Slp201702
Slp201702Slp201702
Slp201702
 
ILRMA 20170227 danwakai
ILRMA 20170227 danwakaiILRMA 20170227 danwakai
ILRMA 20170227 danwakai
 
Asj2017 3 bileveloptnmf
Asj2017 3 bileveloptnmfAsj2017 3 bileveloptnmf
Asj2017 3 bileveloptnmf
 
HMMに基づく日本人英語音声合成における中学生徒の英語音声を用いた評価
HMMに基づく日本人英語音声合成における中学生徒の英語音声を用いた評価HMMに基づく日本人英語音声合成における中学生徒の英語音声を用いた評価
HMMに基づく日本人英語音声合成における中学生徒の英語音声を用いた評価
 
Moment matching networkを用いた音声パラメータのランダム生成の検討
Moment matching networkを用いた音声パラメータのランダム生成の検討Moment matching networkを用いた音声パラメータのランダム生成の検討
Moment matching networkを用いた音声パラメータのランダム生成の検討
 
Asj2017 3invited
Asj2017 3invitedAsj2017 3invited
Asj2017 3invited
 
数値解析と物理学
数値解析と物理学数値解析と物理学
数値解析と物理学
 
独立性に基づくブラインド音源分離の発展と独立低ランク行列分析 History of independence-based blind source sep...
独立性に基づくブラインド音源分離の発展と独立低ランク行列分析 History of independence-based blind source sep...独立性に基づくブラインド音源分離の発展と独立低ランク行列分析 History of independence-based blind source sep...
独立性に基づくブラインド音源分離の発展と独立低ランク行列分析 History of independence-based blind source sep...
 

Semelhante a Koyama AES Conference SFC 2016

Plane wave decomposition and beamforming for directional spatial sound locali...
Plane wave decomposition and beamforming for directional spatial sound locali...Plane wave decomposition and beamforming for directional spatial sound locali...
Plane wave decomposition and beamforming for directional spatial sound locali...Muhammad Imran
 
Adaptive filter
Adaptive filterAdaptive filter
Adaptive filterA. Shamel
 
Multichannel Speech Signal Separation by Beam forming Techniques
Multichannel Speech Signal Separation by Beam forming TechniquesMultichannel Speech Signal Separation by Beam forming Techniques
Multichannel Speech Signal Separation by Beam forming TechniquesIRJET Journal
 
Track 1 session 3 - st dev con 2016 - smart home and building
Track 1   session 3 - st dev con 2016 - smart home and buildingTrack 1   session 3 - st dev con 2016 - smart home and building
Track 1 session 3 - st dev con 2016 - smart home and buildingST_World
 
Dsp final report
Dsp final reportDsp final report
Dsp final reportLinh Nguyen
 
Sound Source Localization
Sound Source LocalizationSound Source Localization
Sound Source LocalizationMuhammad Imran
 
Realisation of awgn channel emulation modules under siso and simo environment...
Realisation of awgn channel emulation modules under siso and simo environment...Realisation of awgn channel emulation modules under siso and simo environment...
Realisation of awgn channel emulation modules under siso and simo environment...ijwmn
 
Catalogue 2013 en
Catalogue 2013 enCatalogue 2013 en
Catalogue 2013 enGuy Crt
 
Direction of Arrival Estimation Based on MUSIC Algorithm Using Uniform and No...
Direction of Arrival Estimation Based on MUSIC Algorithm Using Uniform and No...Direction of Arrival Estimation Based on MUSIC Algorithm Using Uniform and No...
Direction of Arrival Estimation Based on MUSIC Algorithm Using Uniform and No...IJERA Editor
 
IGARSS11_FFBP_CSAR_v3.ppt
IGARSS11_FFBP_CSAR_v3.pptIGARSS11_FFBP_CSAR_v3.ppt
IGARSS11_FFBP_CSAR_v3.pptgrssieee
 
IGARSS11_FFBP_CSAR_v3.ppt
IGARSS11_FFBP_CSAR_v3.pptIGARSS11_FFBP_CSAR_v3.ppt
IGARSS11_FFBP_CSAR_v3.pptgrssieee
 
IGARSS2011_Kawamura.ppt
IGARSS2011_Kawamura.pptIGARSS2011_Kawamura.ppt
IGARSS2011_Kawamura.pptgrssieee
 
PHOENIX AUDIO TECHNOLOGIES - A large Audio Signal Algorithm Portfolio
PHOENIX AUDIO TECHNOLOGIES  - A large Audio Signal Algorithm PortfolioPHOENIX AUDIO TECHNOLOGIES  - A large Audio Signal Algorithm Portfolio
PHOENIX AUDIO TECHNOLOGIES - A large Audio Signal Algorithm PortfolioHTCS LLC
 
Role antennas play in a MIMO link - paper
Role antennas play in a MIMO link - paperRole antennas play in a MIMO link - paper
Role antennas play in a MIMO link - paperAndre Fourie
 
Performance Analysis of MIMO–OFDM for PCHBF , RELAY Technique with MMSE For T...
Performance Analysis of MIMO–OFDM for PCHBF , RELAY Technique with MMSE For T...Performance Analysis of MIMO–OFDM for PCHBF , RELAY Technique with MMSE For T...
Performance Analysis of MIMO–OFDM for PCHBF , RELAY Technique with MMSE For T...Sri Manakula Vinayagar Engineering College
 
Beamforming and microphone arrays
Beamforming and microphone arraysBeamforming and microphone arrays
Beamforming and microphone arraysRamin Anushiravani
 
Distance Coding And Performance Of The Mark 5 And St350 Soundfield Microphone...
Distance Coding And Performance Of The Mark 5 And St350 Soundfield Microphone...Distance Coding And Performance Of The Mark 5 And St350 Soundfield Microphone...
Distance Coding And Performance Of The Mark 5 And St350 Soundfield Microphone...Bruce Wiggins
 
Ijeee 20-23-target parameter estimation for pulsed doppler radar applications
Ijeee 20-23-target parameter estimation for pulsed doppler radar applicationsIjeee 20-23-target parameter estimation for pulsed doppler radar applications
Ijeee 20-23-target parameter estimation for pulsed doppler radar applicationsKumar Goud
 
Thesis_powerpoint
Thesis_powerpointThesis_powerpoint
Thesis_powerpointTim Costa
 
A time domain clean approach for the identification of acoustic moving source...
A time domain clean approach for the identification of acoustic moving source...A time domain clean approach for the identification of acoustic moving source...
A time domain clean approach for the identification of acoustic moving source...André Moreira
 

Semelhante a Koyama AES Conference SFC 2016 (20)

Plane wave decomposition and beamforming for directional spatial sound locali...
Plane wave decomposition and beamforming for directional spatial sound locali...Plane wave decomposition and beamforming for directional spatial sound locali...
Plane wave decomposition and beamforming for directional spatial sound locali...
 
Adaptive filter
Adaptive filterAdaptive filter
Adaptive filter
 
Multichannel Speech Signal Separation by Beam forming Techniques
Multichannel Speech Signal Separation by Beam forming TechniquesMultichannel Speech Signal Separation by Beam forming Techniques
Multichannel Speech Signal Separation by Beam forming Techniques
 
Track 1 session 3 - st dev con 2016 - smart home and building
Track 1   session 3 - st dev con 2016 - smart home and buildingTrack 1   session 3 - st dev con 2016 - smart home and building
Track 1 session 3 - st dev con 2016 - smart home and building
 
Dsp final report
Dsp final reportDsp final report
Dsp final report
 
Sound Source Localization
Sound Source LocalizationSound Source Localization
Sound Source Localization
 
Realisation of awgn channel emulation modules under siso and simo environment...
Realisation of awgn channel emulation modules under siso and simo environment...Realisation of awgn channel emulation modules under siso and simo environment...
Realisation of awgn channel emulation modules under siso and simo environment...
 
Catalogue 2013 en
Catalogue 2013 enCatalogue 2013 en
Catalogue 2013 en
 
Direction of Arrival Estimation Based on MUSIC Algorithm Using Uniform and No...
Direction of Arrival Estimation Based on MUSIC Algorithm Using Uniform and No...Direction of Arrival Estimation Based on MUSIC Algorithm Using Uniform and No...
Direction of Arrival Estimation Based on MUSIC Algorithm Using Uniform and No...
 
IGARSS11_FFBP_CSAR_v3.ppt
IGARSS11_FFBP_CSAR_v3.pptIGARSS11_FFBP_CSAR_v3.ppt
IGARSS11_FFBP_CSAR_v3.ppt
 
IGARSS11_FFBP_CSAR_v3.ppt
IGARSS11_FFBP_CSAR_v3.pptIGARSS11_FFBP_CSAR_v3.ppt
IGARSS11_FFBP_CSAR_v3.ppt
 
IGARSS2011_Kawamura.ppt
IGARSS2011_Kawamura.pptIGARSS2011_Kawamura.ppt
IGARSS2011_Kawamura.ppt
 
PHOENIX AUDIO TECHNOLOGIES - A large Audio Signal Algorithm Portfolio
PHOENIX AUDIO TECHNOLOGIES  - A large Audio Signal Algorithm PortfolioPHOENIX AUDIO TECHNOLOGIES  - A large Audio Signal Algorithm Portfolio
PHOENIX AUDIO TECHNOLOGIES - A large Audio Signal Algorithm Portfolio
 
Role antennas play in a MIMO link - paper
Role antennas play in a MIMO link - paperRole antennas play in a MIMO link - paper
Role antennas play in a MIMO link - paper
 
Performance Analysis of MIMO–OFDM for PCHBF , RELAY Technique with MMSE For T...
Performance Analysis of MIMO–OFDM for PCHBF , RELAY Technique with MMSE For T...Performance Analysis of MIMO–OFDM for PCHBF , RELAY Technique with MMSE For T...
Performance Analysis of MIMO–OFDM for PCHBF , RELAY Technique with MMSE For T...
 
Beamforming and microphone arrays
Beamforming and microphone arraysBeamforming and microphone arrays
Beamforming and microphone arrays
 
Distance Coding And Performance Of The Mark 5 And St350 Soundfield Microphone...
Distance Coding And Performance Of The Mark 5 And St350 Soundfield Microphone...Distance Coding And Performance Of The Mark 5 And St350 Soundfield Microphone...
Distance Coding And Performance Of The Mark 5 And St350 Soundfield Microphone...
 
Ijeee 20-23-target parameter estimation for pulsed doppler radar applications
Ijeee 20-23-target parameter estimation for pulsed doppler radar applicationsIjeee 20-23-target parameter estimation for pulsed doppler radar applications
Ijeee 20-23-target parameter estimation for pulsed doppler radar applications
 
Thesis_powerpoint
Thesis_powerpointThesis_powerpoint
Thesis_powerpoint
 
A time domain clean approach for the identification of acoustic moving source...
A time domain clean approach for the identification of acoustic moving source...A time domain clean approach for the identification of acoustic moving source...
A time domain clean approach for the identification of acoustic moving source...
 

Último

ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTXALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTXDole Philippines School
 
Pests of castor_Binomics_Identification_Dr.UPR.pdf
Pests of castor_Binomics_Identification_Dr.UPR.pdfPests of castor_Binomics_Identification_Dr.UPR.pdf
Pests of castor_Binomics_Identification_Dr.UPR.pdfPirithiRaju
 
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCRCall Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCRlizamodels9
 
User Guide: Capricorn FLX™ Weather Station
User Guide: Capricorn FLX™ Weather StationUser Guide: Capricorn FLX™ Weather Station
User Guide: Capricorn FLX™ Weather StationColumbia Weather Systems
 
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxGenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxBerniceCayabyab1
 
ECG Graph Monitoring with AD8232 ECG Sensor & Arduino.pptx
ECG Graph Monitoring with AD8232 ECG Sensor & Arduino.pptxECG Graph Monitoring with AD8232 ECG Sensor & Arduino.pptx
ECG Graph Monitoring with AD8232 ECG Sensor & Arduino.pptxmaryFF1
 
Citronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayCitronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayupadhyaymani499
 
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfBehavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfSELF-EXPLANATORY
 
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 GenuineCall Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuinethapagita
 
Radiation physics in Dental Radiology...
Radiation physics in Dental Radiology...Radiation physics in Dental Radiology...
Radiation physics in Dental Radiology...navyadasi1992
 
Davis plaque method.pptx recombinant DNA technology
Davis plaque method.pptx recombinant DNA technologyDavis plaque method.pptx recombinant DNA technology
Davis plaque method.pptx recombinant DNA technologycaarthichand2003
 
Pests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPirithiRaju
 
Bioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptxBioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptx023NiWayanAnggiSriWa
 
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPirithiRaju
 
User Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationUser Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationColumbia Weather Systems
 
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.PraveenaKalaiselvan1
 
OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024innovationoecd
 
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptxTHE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptxNandakishor Bhaurao Deshmukh
 
Pests of jatropha_Bionomics_identification_Dr.UPR.pdf
Pests of jatropha_Bionomics_identification_Dr.UPR.pdfPests of jatropha_Bionomics_identification_Dr.UPR.pdf
Pests of jatropha_Bionomics_identification_Dr.UPR.pdfPirithiRaju
 

Último (20)

ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTXALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
 
Pests of castor_Binomics_Identification_Dr.UPR.pdf
Pests of castor_Binomics_Identification_Dr.UPR.pdfPests of castor_Binomics_Identification_Dr.UPR.pdf
Pests of castor_Binomics_Identification_Dr.UPR.pdf
 
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCRCall Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
 
User Guide: Capricorn FLX™ Weather Station
User Guide: Capricorn FLX™ Weather StationUser Guide: Capricorn FLX™ Weather Station
User Guide: Capricorn FLX™ Weather Station
 
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Munirka Delhi 💯Call Us 🔝8264348440🔝
 
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxGenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
 
ECG Graph Monitoring with AD8232 ECG Sensor & Arduino.pptx
ECG Graph Monitoring with AD8232 ECG Sensor & Arduino.pptxECG Graph Monitoring with AD8232 ECG Sensor & Arduino.pptx
ECG Graph Monitoring with AD8232 ECG Sensor & Arduino.pptx
 
Citronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayCitronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyay
 
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfBehavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
 
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 GenuineCall Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
 
Radiation physics in Dental Radiology...
Radiation physics in Dental Radiology...Radiation physics in Dental Radiology...
Radiation physics in Dental Radiology...
 
Davis plaque method.pptx recombinant DNA technology
Davis plaque method.pptx recombinant DNA technologyDavis plaque method.pptx recombinant DNA technology
Davis plaque method.pptx recombinant DNA technology
 
Pests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdf
 
Bioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptxBioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptx
 
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
 
User Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationUser Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather Station
 
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
 
OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024
 
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptxTHE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
 
Pests of jatropha_Bionomics_identification_Dr.UPR.pdf
Pests of jatropha_Bionomics_identification_Dr.UPR.pdfPests of jatropha_Bionomics_identification_Dr.UPR.pdf
Pests of jatropha_Bionomics_identification_Dr.UPR.pdf
 

Koyama AES Conference SFC 2016

  • 1. Source-Location-Informed Sound Field Recording and Reproduction: A Generalization to Arrays of Arbitrary Geometry Shoichi Koyama The University of Tokyo / Université Paris Diderot (Institut Langevin)
  • 2. July 19, 2016 Super-resolution in Recording and Reproduction Improve reproduction accuracy when less microphones than loudspeakers  # of microphones > # of loudspeakers – Higher reproduction accuracy within local region of target area  # of microphones < # of loudspeakers – Higher reproduction accuracy of sources in local region of recording area [Koyama+ ICASSP 2014], [Koyama+ IEEE JSTSP 2015] [Ahrens+ AES Conv. 2010] Microphone array Loudspeaker array
  • 3. Sound Field Recording and Reproduction July 19, 2016 Recording area Target area Obtain driving signals of secondary sources (= loudspeakers) arranged on to reconstruct desired sound field inside  Inherently, sound pressure and its gradient on is required to obtain , but sound pressure is usually only known  Fast and stable signal conversion for sound field recording and reproduction with ordinary acoustic sensors and transducers is required Primary sources
  • 4. July 19, 2016 Wave field reconstruction (WFR) filtering method Target area Received signals Driving signals Plane wave Plane wave Each plane wave determines entire sound field Spatial aliasing artifacts due to plane wave decomposition Significant error at high freq. even when microphone < loudspeaker Recording area [Koyama+ IEEE TASLP 2013] Signal conversion Secondary source planeReceiving plane Primary sources
  • 5. Source-Location-Informed Recording and Reproduction  Signal conversion method that takes into account a priori knowledge of primary source locations  This prior information can be obtained by using various types of sensors or by manual input  By exploiting this prior information, reproduction accuracy above the spatial Nyquist freq can be improved  Apply the method proposed in [Koyama+ IEEE JSTSP 2015] to several array geometries July 19, 2016 Target areaRecording area Signal conversion Secondary source planeReceiving plane Primary sources Approximate location is obtained by sensors
  • 6. Statement of Problem July 19, 2016 Target areaRecording area Primary sources Secondary source distribution: Microphone array on baffle Control points Constraint on driving signals Linear combination of spatial basis functions Transfer functionDesired pressures Optimize and by using prior information on source locations
  • 7. Statement of Problem July 19, 2016 Target areaRecording area Primary sources Secondary source distribution: Control points  Two requirement must be satisfied to apply the method proposed in [Koyama+ IEEE JSTSP 2015] 1. The relationship between and can be obtained 2. The amplitude distribution of the driving signals of the secondary sources can be predicted from prior information on the source location Microphone array on baffle
  • 8. Modified Transfer Function  For the first requirement, we consider modified transfer function that relates with  For planar / linear array case, because can be equivalent to  When microphones are mounted on baffle,  We here show an example of a cylindrical array – Spherical array case is presented in [Koyama+ WASPAA 2015] July 19, 2016
  • 9. Modified Transfer Function  Synthesized sound field in cylindrical harmonic domain  Desired sound field in cylindrical harmonic domain July 19, 2016 Modified transfer function for cylindrical arrays of microphones and loudspeakers
  • 10. MAP Estimation of Driving Signals  Likelihood function: complex Gaussian distribution  Prior distribution: Amplitude distribution of ( ) predicted from approximate primary source location is incorporated July 19, 2016 Maximum a posteriori (MAP) estimation Bayes’ rule Likelihood function Prior distribution
  • 11. MAP Estimation of Driving Signals  Objective function:  Assume that spatial basis functions are M orthogonal functions, which satisfies the following relation of singular value decomposition  Optimal spatial basis functions and their coefficients  Driving signals obtained by MAP estimation July 19, 2016 ( : regularization parameter)
  • 12. Prior Based on Primary Source Locations  Amplitude distribution can be obtained by assuming point source at prior source location with sound field synthesis techniques  When array geometry is cylinder and estimated primary source location is , predicted driving signal is obtained as July 19, 2016 Normalization
  • 13. Algorithm July 19, 2016 Discretize secondary source distribution Amplitude distribution for prior
  • 14. Algorithm 1. Detect source location ( ) 2. Calculate amplitude distribution 3. Calculate as 4. Eigenvalue decomposition of 5. Obtain transform filter as July 19, 2016
  • 15. Simulation Experiments  Simulation using cylindrical arrays of microphones and loudspeakers under free-field assumption  Proposed method is compared with WFR filtering method  Microphone array: – Radius: 0.12 m, # of microphones: 32 in x 6 in  Loudspeaker array: – Radius: 1.5 m, # of loudspeakers: 32 in x 12 in  Evaluation w/ signal-to-distortion ratio (SDR) at radius July 19, 2016 [Koyama+ IEEE TASLP 2014] Reproduced and original pressure distribution
  • 16. Reproduced pressure distribution (x-y-plane) July 19, 2016 PressureError Proposed WFR  Source location: (2.0 m, 155 deg, -0.4) m, Source signal: 1.6 kHz
  • 17. Reproduced pressure distribution (y-z-plane) July 19, 2016 PressureError Proposed WFR  Source location: (2.0 m, 155 deg, -0.4) m, Source signal: 1.6 kHz
  • 18. Relationship between distance and SDR July 19, 2016  Source location: (2.0 m, 155 deg, -0.4) m, Source signal: 1.6 kHz Almost the same reproduction accuracy even when prior source location was perturbed
  • 19. Conclusion  Source-location-informed sound field recording and reproduction for several types of array geometries – Signal conversion method that takes into account prior information on primary source locations – Spatial basis functions and their coefficients are optimized – Two requirements: 1. Relationship between desired and received sound pressures can be obtained 2. Amplitude distribution of driving signals of secondary sources can be predicted from prior source locations – Simulation results using cylindrical arrays indicated that region of high reproduction accuracy of proposed method was larger than that of WFR filtering method July 19, 2016 Thank you for your attention!