CapsuleNetと3DCNNを組み合わせて人物の行動認識を行うVideoCapsuleNetを提案する論文

1. 2/0 : 40 0 2 42120/ 0 9
1 9 2 0 0 2
A C
1

2. mlk
Y R9C . IKM L, - 7C I C C L D - LC
/ L LC
8 2R LLIK, I I K CIK I I ) NC IKM L
KC I C C L D LC L LC
SVUS , LLIK, ACL M 1 NC /M L 9C . IKM L
fhgd
- N K C M 0 LC KKC A 7PKL (
0 7
e
1 NC /M L : A K 7 L 3M D 7
ip
b a cg.9no bYS
2

3. •
– 1
•
– CNN 1
–
→
CapsNet 3DCNN
3

4. • CapsNet
– MNIST
– CapsNet
•
2
–
– CapsNet
4

5. 3DCNN
C 3D Convolutional Neural Networks for Human Action Recognition
5
URL http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.442.8617&rep=rep1&type=pdf
3
3
D

6. CapsuleNet 6
URL https://papers.nips.cc/paper/6975-dynamic-routing-between-capsules
CapsNet https://www.slideshare.net/harmonylab/dynamic-routing-between-
capsules-86065078
C N
C s pe p
N l
u a
N

7. VideoCapsuleNet 7
( ) (walk run etc)

8. Capsule Pooling 8
g oN M [
p M [ M l P
1 10 V ~ ] c a iN V t
]
:
] N euo
https://openreview.net/pdf?id=HJWLfGWRb
Nsn N C N:::

9. 9
9
9
]
2 0 :
a9
1
1 ]
1[i a .

10. 0 -
• UCF-Sports[2]
– 10 1501 (958s)
• J-HMDB[3]
– 21 9281 (33183f)
• UCF-101[4]
– 101 13,0001
10
[1] https://cs.stanford.edu/people/karpathy/deepvideo/classes.html
[2] https://www.crcv.ucf.edu/data/UCF_Sports_Action.php
[3] http://jhmdb.is.tue.mpg.de/
[4] https://www.crcv.ucf.edu/data/UCF101.php

11. • Sports-1M[1]( )
– 487 1,133,158
– 6 C3D
•
– 8(frame)*112(height)*112(width)
• Adam 0.0001
• 120px
• 112*112px
•
11

12. •
•
12
https://ai-scholar.tech/treatise/ai-capsulenet-52/

13. P 13
- -1* D :U
D :U
I U
A :

14. 14

15. 15

16. 16
Fi ,.
0 A : D
2, gc oend uD, ta F 2,
U -,11 N CIU glra I
VL C N L S
1, : 5 5 : : D 4 : o s D
o s S v
0

17. 17
- C D
-
a e
N Ce C D