Speaker Segmentation (2006)

Real-time Automatic Speaker Segmentation Luís Gustavo Martins UTM – INESC Porto [email_address] http://www.inescporto.pt/~lmartins LabMeetings March 16, 2006 INESC Porto

Notice ,[object Object],[object Object],[object Object],[object Object]

Summary ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Scope ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Audio Analysis front-end ,[object Object],[object Object],[object Object],[object Object],[object Object]

Audio Analysis front-end ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],SOURCE FILTER

Audio Analysis front-end ,[object Object],[object Object],[object Object],Yule-Walker equations Durbin’s recursive algorithm Toeplitz autocorrelation matrix Autocorrelation method

Audio Analysis front-end ,[object Object],Whitening Filter  Pitch LPC Spectrum FFT Spectrum

Audio Analysis front-end ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Audio Analysis front-end Unvoiced speech frames Voiced speech frames

Audio Analysis front-end ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],ZCR STE voiced unvoiced silence

Audio Analysis front-end ,[object Object]

Audio Analysis front-end ,[object Object],[object Object],-------------------------------------- Portuguese Male 2 -------------------------------------- Total Time = 60 secs voiced = 30 secs = 50.0% unvoiced = 14 secs = 23.3% silence = 13 secs = 21.6% Voiced /(Voiced + Unvoiced) = 68% Unvoiced / (Voiced + Unvoiced) = 32% -------------------------------------- Portuguese Male 1 -------------------------------------- Total Time = 60 secs Voiced = 37 secs = 62% unvoiced = 12 secs = 20% silence = 10 secs = 17% Voiced /(Voiced + Unvoiced) = 76% Unvoiced / (Voiced + Unvoiced) = 24% -------------------------------------- Portuguese Female 2 -------------------------------------- Total Time = 60 secs voiced = 30 secs = 50.0% unvoiced = 19 secs = 31.6% silence = 10 secs = 17% Voiced /(Voiced + Unvoiced) = 61.2% Unvoiced / (Voiced + Unvoiced) = 38.7% -------------------------------------- Portuguese Female 1 -------------------------------------- Total Time = 60 secs voiced = 32 secs = 53.3% unvoiced = 17 secs = 28.3% silence = 10 secs = 17% Voiced /(Voiced + Unvoiced) = 65.3% Unvoiced / (Voiced + Unvoiced) = 32.7%

Audio Analysis front-end ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],contamination waste (Theoretical Random Classifier Correct Classifications = 33.33%) Total Classification Error = 18.385% Total Correct Classifications = 81.615+/-1.13912% 64.92 % 33.55 % 0.88 % silence 34.66 % 62.28 % 6.8 % unvoiced 0.41 % 4.17 % 92.32 % voiced silence unvoiced voiced Classified as: ↓

Audio Analysis front-end ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Speaker Coarse Segmentation ,[object Object],[object Object],[object Object],[object Object],Speech stream with 4 speech segments [Campbell97] [Lu2002]

Speaker Coarse Segmentation ,[object Object],[object Object]

Speaker Coarse Segmentation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Speaker Change Validation ,[object Object],[object Object],[object Object],L 0  L 0  Same speaker in segments X and Y Different speakers in segments X and Y X Y Z

Speaker Change Validation ,[object Object],[object Object],[object Object],L 1  L 1  Same speaker in segments X and Y Different speakers in segments X and Y X Y Z

Speaker Change Validation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object], Need to define a Threshold …  ,[object Object]

Speaker Change Validation ,[object Object],[object Object],[object Object],[object Object],… but λ must be set… 

Speaker Change Validation ,[object Object],[object Object],[object Object],[object Object],[object Object]

Speaker Model Update ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Speaker Model Update ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Speaker Model Update ,[object Object],[object Object],[object Object],[object Object],[object Object]

Speaker Change Validation ,[object Object],[object Object]

Experimental Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experimental Results ,[object Object]

Experimental Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experimental Results ,[object Object],[object Object]

Experimental Results ,[object Object],INESC System ver.1 INESC System ver.2 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experimental Results ,[object Object],INESC System ver.2 ,[object Object],[object Object],[object Object],[object Object],[object Object],AUTH System 1 ,[object Object],[object Object],[object Object],[object Object],[object Object]

Experimental Results ,[object Object],AUTH System 1 INESC System ver.2 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experimental Results ,[object Object],AUTH System 2 INESC System ver.2 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experimental Results ,[object Object],[object Object],INESC System ver.1

Achievements ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],DEMO

Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Contributors ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Thank you! ,[object Object],[object Object]

Speaker Segmentation (2006)

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (20)

Semelhante a Speaker Segmentation (2006)

Semelhante a Speaker Segmentation (2006) (20)

Mais de Luís Gustavo Martins

Mais de Luís Gustavo Martins (13)

Último

Último (20)

Speaker Segmentation (2006)