baidu search engine user experience analyst

1. 2012-01-07

2. Who am I
! Who am I
–
– pengtao@baidu.com
–
•
–
•
• "

4. 1.
!
– 2010 81.9%
• CNNIC, 2011
– Google effects on memory
• v.s.
• v.s.
– (Sparrow, 2011)
• The Internet has become a primary form of external or transactive memory,
where information is stored collectively outside ourselves.

5. 1.
!
– ​1⁄1 × 2
• Query #$ url +
–
​1⁄2 × 3
+
• ​1⁄3 × 1
! +
– MAP
​1⁄4 × 2
+
– DCG ​1⁄5 × 2
+
– nDCG
– ERR
​1⁄6 × 2
=
– … 5.0667

7. 2.
! Side by side

8. 2.
!
–
• E v.s. C
– 10000
• log 10000 query E C
– 1000
• 10000 query 1000
– 100
• 1000 diff PM 100 review
• 30 good) : 50 (same) : 20 (bad)
PM

9. 2.
!
–
• v.s. pm query
–
• “ ”
PM

11. 3.
! crowdsourcing)
– evaluator)
–
– evaluator
! WSE
–
–
–
–

12. 2.
! WSE evaluator

13. 3.
! Lesson1:
–

14. 3.
! Lesson2:
–
–

15. 3.
! Lesson3:
–
–
• Economics
–
•
• evaluator

16. 3.
! WSE
–
– 10w
! crowdsourcing
– reCaptcha
– Amazon Mechanical Turk
– ESP Game
– Human computation

18. 3.
!
–
– AB testing, Bucket testing
50%
%
50%
100%

19. 3.
! AB testing ?
–

20. 3.
! AB testing ?
–

21. 3.
! AB testing
– +
–
–
–

22. 3.
! AB testing
– 1T
• cubeproducer, disql hadoop
– 1G olap
• infobright, mondrian
– 1M
• ABreport

23. 3.
! AB testing
–
•
– Overall Evaluation Criteria
» ("Crook,"2009)"
– Queryrank:
» )
» )
•
–
–

24. 3.
!
–
•
–
•
– AA test
–
•
–
–

25. 3.
!
–

26. 3.
!
– 50% v.s. 50%
–
B1 a1 i1 u1
Baidu
i2 d1
B2
i3 u2
a2
B3 d2
i4
B4 d3 u3

28. !
–
– DCG
!
– PM review
– crowdsourcing
– AB testing

29. !
– v.s. AB testing
–
– v.s.

32. 1 wse

33. 2
)
) sid X X’
/Cookie
Sid=1001)
M1
BWS M2 N2
User)log internal)log
M10
BWS

34. 关注我们：t.baidu-tech.com
资料下载和详细介绍：infoq.com/cn/zones/baidu-salon
“畅想•交流•争鸣•聚会”是百度技术沙龙的宗旨。 百度技术沙龙是由百度与InfoQ中文站定期组织的线下技术交流活动。目
的是让中高端技术人员有一个相对自由的思想交流和交友沟通的的平台。主要分讲师分享和OpenSpace两个关键环节，每期
只关注一个焦点话题。
讲师分享和现场Q&A让大家了解百度和其他知名网站技术支持的先进实践经验，OpenSpace环节是百度技术沙龙主题的升华
和展开，提供一个自由交流的平台。针对当期主题，参与者人人都可以发起话题，展开讨论。
InfoQ 策划·组织·实施
关注我们：weibo.com/infoqchina