This document discusses various machine learning algorithms and techniques including A/B testing, epsilon-greedy, softmax, UCB, DQN, and AlphaGo. It provides examples of these algorithms and how companies like Google, Facebook, and OPT are applying artificial intelligence and deep learning to areas such as computer Go, recommendation systems, and computer vision. Copyright notices are repeated throughout the document.

1. Copyright © 2014 OPT, Inc. All Rights Reserved.
Copyright © 2014 OPT, Inc. All Rights Reserved.
AI

2. Copyright © 2014 OPT, Inc. All Rights Reserved.
AI
AI
2

3. Copyright © 2014 OPT, Inc. All Rights Reserved.
Python
Scala
Facebook( )
https://www.facebook.com/shogiai
3

4. Copyright © 2014 OPT, Inc. All Rights Reserved.
Copyright © 2014 OPT, Inc. All Rights Reserved.
AI
AI

5. Copyright © 2014 OPT, Inc. All Rights Reserved.
ROI
5

6. Copyright © 2014 OPT, Inc. All Rights Reserved.
A/B
N
6

7. Copyright © 2014 OPT, Inc. All Rights Reserved.
- CV ( CV / CLICK )
- ( )
7

8. Copyright © 2014 OPT, Inc. All Rights Reserved.
Copyright © 2014 OPT, Inc. All Rights Reserved.
AI
AI

9. Copyright © 2014 OPT, Inc. All Rights Reserved.
-
9

10. Copyright © 2014 OPT, Inc. All Rights Reserved.
1. (A/B )
2.
3.
10

11. Copyright © 2014 OPT, Inc. All Rights Reserved.
A/B
exploitation exploration
- ←
- ←
AB ←
←
11
A/B

12. Copyright © 2014 OPT, Inc. All Rights Reserved.
12
( ) 4,000 200
( )
http://qiita.com/ysekky/items/4e782603f7592743625b

13. Copyright © 2014 OPT, Inc. All Rights Reserved.
ε-Greedy
- ε (1-ε)
- ε (1-ε)
( )
13

14. Copyright © 2014 OPT, Inc. All Rights Reserved.
Softmax 14
- T
- n i
※ vi i
(T→∞ ) → 1/n
(T→0 )
T

15. Copyright © 2014 OPT, Inc. All Rights Reserved.
UCB
(Softmax )
✖
15

16. Copyright © 2014 OPT, Inc. All Rights Reserved.
Copyright © 2014 OPT, Inc. All Rights Reserved.
AI
AI
AI

17. Copyright © 2014 OPT, Inc. All Rights Reserved.
…
tannsaku
17

18. Copyright © 2014 OPT, Inc. All Rights Reserved.
30
( )
→ 361
( )
http://www.slideshare.net/TakashiKato2/ss-57966067
18

19. Copyright © 2014 OPT, Inc. All Rights Reserved.
•
19

20. Copyright © 2014 OPT, Inc. All Rights Reserved.
( )
(ε-Greedy )
(Softmax )
※
[1] [15]
http://labs.timedia.co.jp/author/author3a1b5/
20

21. Copyright © 2014 OPT, Inc. All Rights Reserved.
UCB
-
- UCB
1
t UCB i
21

22. Copyright © 2014 OPT, Inc. All Rights Reserved.
-
- ( )
-
-
(Alpha Go
1 4.8msec
)
22

23. Copyright © 2014 OPT, Inc. All Rights Reserved.
Copyright © 2014 OPT, Inc. All Rights Reserved.
4. AI
AI
AI

24. Copyright © 2014 OPT, Inc. All Rights Reserved.
Alpha Go
value network( CNN)
policy network( )
1. ( )
2. …
24

25. Copyright © 2014 OPT, Inc. All Rights Reserved.
•
25
Q

26. Copyright © 2014 OPT, Inc. All Rights Reserved.
DQN (Deep Q-Network)
( )
Q Deep CNN (20 30 )
26
)

27. Copyright © 2014 OPT, Inc. All Rights Reserved.
DQN
•
27

28. Copyright © 2014 OPT, Inc. All Rights Reserved.
Google
AI
※Facebook …
“Better Computer Go Player with Neural Network and Long-term Prediction”
http://arxiv.org/abs/1511.06410
28

29. Copyright © 2014 OPT, Inc. All Rights Reserved.
AI( )
-
http://www.nicovideo.jp/watch/sm26167419
-
http://www.nicovideo.jp/watch/1444224154
7
1 AI
29

30. Copyright © 2014 OPT, Inc. All Rights Reserved.
AI
-
-
AlphaGo
30