SlideShare uma empresa Scribd logo
1 de 24
DeepFace: Closing the Gap to
Human-Level Performance in
Face Verification
Yaniv Taigman* Ming Yang* Marc’Aurelio Ranzato*
Lior Wolf**
*:Facebook AI Research
**:Tel Aviv University
Tomoaki Teshima @tomoaki_teshima
Contributions
• DNN architecture
• Facial alignment based on 3D model
• Result
• LFW – human performance
• YTF – low error rate
Verification とは
CV勉強会第6回からの抜粋 (@dandelion1124さんの資料)
• Verification
• Object categorization
• Identification
• Detection
• Scene and context categorization
DeepFace: Closing the Gap to Human-
Level Performance in Face Verification
Modern face recognition
detect align represent classify
Constrained/Unconstrained
Face Alignment
Face Alignment in 2D (前処理)
6点を使って
回転と並進とスケールする
顔を検出する
Cropped area から
基準点を検出する
• 両目(2点)
• 鼻先
• 唇中央
• 口角(2点)
Face Alignment in 3D (前処理)
Second SVR を使って2D aligned な
image にUSF Human ID database
平均顔をのっける
Frontalization (こっちだ)
DNN architecture
Face feature
SFCに4030人
いたから
Max pooling と Convolution
L4層とL5層とL6層
全結合のL7層とL8層
Dropoutを適用するのも、全結合のL7層から
SFCとは
Shonan Fujisawa Campus Super Famicom
SFCとは(海外において)
•Santos Futebol Clube, a Brazilian football club
•Scarborough F.C., a dissolved English football club
•Servette FC, a Swiss football club
•Sevilla FC, a Spanish football club
•SFC Opava, a Czech football club
•Shelbourne F.C., an Irish football club
•Sheffield F.C., an English football club
•Southampton F.C., an English football club
•Southport F.C., an English football club
•Spartans F.C. A Punes football club
•Sriwijaya F.C., an Indonesia football club
•Stamford F.C., an English football club
•Stenhousemuir F.C., a Scottish football club
•Stevenage F.C., an English football club
•Stranraer F.C., a Scottish football club
•Sydney FC, an Australian football club
•Syrianska FC, a Swedish football club
http://en.wikipedia.org/wiki/SFC
SFCとは(今回の論文)
The proposed face representation is learned from a large
collection of photos from Facebook, referred to as the
Social Face Classification (SFC) dataset.
全結合のL7層とL8層(再掲)
Dropoutを適用するのも、全結合のL7層から
Normalization
明度の変化からくる影響を軽減するために正規化する
コントラスト正規化
教師データ内の最大値で除算し、L2正規化する
Verification Metric
Weighted χ2 distance
Simanse network
http://www.cs.columbia.edu/~jebara/papers/metricfromnetwork.pdf
http://bengio.abracadoudou.com/lce/slides/andrews.pdf
dataset
• SFC
Social Face Classification
• LFW
Labeled Faces in the Wild
• YTF
Youtube Faces
• SFCは人によりラベリン
グされてるが、3%ぐら
いエラーがある
• SFCは、光源環境、ノイ
ズ、expressionに幅が
ある
• LFWやYTFだと、通常プ
ロに撮影されている
5.2. Training on the SFC
5.3. Results on the LFW dataset
5.4. Results on the YTF dataset
5.5 Computational efficiency
SIMDでチューニングして、キャッシュヒットを考慮
Intel2.2GHzで画像の読みこみ
→アライメント
→Feed forward network
→classification
Totalで0.33s
結論
• Deep Faceは顔の位置合わせとDeep Learningを
組み合わせました。
• Verificationの結果で人間とほぼ同等の性能
• 顔認識全般にもこの恩恵があるだろう
参考文献
• 第六回「コンピュータビジョン最先端ガイド2」勉強会~
第1章物体認識のための画像局所特徴量~
http://www.atinfinity.info/doc/cvsaisentan/cvsaisentan
_20101023_dandelion.pdf, @dandelion1124
• http://shusse.kyokasho.biz/archives/685
• http://upload.wikimedia.org/wikipedia/commons/3/30
/Super_Famicom_JPN.jpg
• http://en.wikipedia.org/wiki/SFC
• http://www.cs.columbia.edu/~jebara/papers/metricfro
mnetwork.pdf
• http://bengio.abracadoudou.com/lce/slides/andrews.p
df

Mais conteúdo relacionado

Mais de tomoaki0705

Cvim tomoaki-3-4-7,8
Cvim tomoaki-3-4-7,8Cvim tomoaki-3-4-7,8
Cvim tomoaki-3-4-7,8
tomoaki0705
 

Mais de tomoaki0705 (20)

Draw Normal Distribution on Powerpoint
Draw Normal Distribution on PowerpointDraw Normal Distribution on Powerpoint
Draw Normal Distribution on Powerpoint
 
Using asimdhp (fp16) on Jetson Xavier CPU
Using asimdhp (fp16) on Jetson Xavier CPUUsing asimdhp (fp16) on Jetson Xavier CPU
Using asimdhp (fp16) on Jetson Xavier CPU
 
Kantocv 2-1-calibration publish
Kantocv 2-1-calibration publishKantocv 2-1-calibration publish
Kantocv 2-1-calibration publish
 
Cvim saisentan-cvpr-super-slomo-publish
Cvim saisentan-cvpr-super-slomo-publishCvim saisentan-cvpr-super-slomo-publish
Cvim saisentan-cvpr-super-slomo-publish
 
Cvim saisentan-gpu-open cl
Cvim saisentan-gpu-open clCvim saisentan-gpu-open cl
Cvim saisentan-gpu-open cl
 
Prmu iccv-2017-rolling-shutter-publish
Prmu iccv-2017-rolling-shutter-publishPrmu iccv-2017-rolling-shutter-publish
Prmu iccv-2017-rolling-shutter-publish
 
Scalable Surface Reconstruction from Point Clouds with Extreme Scale and Dens...
Scalable Surface Reconstruction from Point Clouds with Extreme Scale and Dens...Scalable Surface Reconstruction from Point Clouds with Extreme Scale and Dens...
Scalable Surface Reconstruction from Point Clouds with Extreme Scale and Dens...
 
Cvim saisentan-ellipse-publish
Cvim saisentan-ellipse-publishCvim saisentan-ellipse-publish
Cvim saisentan-ellipse-publish
 
Gpgpu tomoaki-fp16
Gpgpu tomoaki-fp16Gpgpu tomoaki-fp16
Gpgpu tomoaki-fp16
 
Cvim saisentan-cvpr-hyper depth
Cvim saisentan-cvpr-hyper depthCvim saisentan-cvpr-hyper depth
Cvim saisentan-cvpr-hyper depth
 
Cvim saisentan-4-2-tomoaki
Cvim saisentan-4-2-tomoakiCvim saisentan-4-2-tomoaki
Cvim saisentan-4-2-tomoaki
 
Cvim saisentan 半精度浮動小数点数 half
Cvim saisentan 半精度浮動小数点数 halfCvim saisentan 半精度浮動小数点数 half
Cvim saisentan 半精度浮動小数点数 half
 
OpenCV祭り (配布用)
OpenCV祭り (配布用)OpenCV祭り (配布用)
OpenCV祭り (配布用)
 
Cvim half precision floating point
Cvim half precision floating pointCvim half precision floating point
Cvim half precision floating point
 
Mind’s Eye: A Recurrent Visual Representation for Image Caption Generation
Mind’s Eye: A Recurrent Visual Representation for Image Caption GenerationMind’s Eye: A Recurrent Visual Representation for Image Caption Generation
Mind’s Eye: A Recurrent Visual Representation for Image Caption Generation
 
Cvim saisentan-5-2-tomoaki
Cvim saisentan-5-2-tomoakiCvim saisentan-5-2-tomoaki
Cvim saisentan-5-2-tomoaki
 
JetsonでOpenCV
 JetsonでOpenCV JetsonでOpenCV
JetsonでOpenCV
 
Cvim saisentan-6-4-tomoaki
Cvim saisentan-6-4-tomoakiCvim saisentan-6-4-tomoaki
Cvim saisentan-6-4-tomoaki
 
Cvim saisentan-21-tomoaki
Cvim saisentan-21-tomoakiCvim saisentan-21-tomoaki
Cvim saisentan-21-tomoaki
 
Cvim tomoaki-3-4-7,8
Cvim tomoaki-3-4-7,8Cvim tomoaki-3-4-7,8
Cvim tomoaki-3-4-7,8
 

Cvim saisentan-cvpr-deep face