1. An Introduce to
Topic Model
towards a topical social dynamics
Mingli Yuan
2012-11-12
Monday, November 12, 12

2. Contents
• Part one: Probabilistic topic modeling
• Part two: Towards a topical social dynamics
• Last question: How about ontological social
dynamics?
Monday, November 12, 12

3. Probabilistic topic model
credit
images from
probabilistic topic model
by D.M. Blei
2012
http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12

4. Latent Dirichlet Allocation
credit
images from
probabilistic topic model
by D.M. Blei
2012
http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12

5. Topic model family
credit
images from
probabilistic topic model
by D.M. Blei
2012
http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12

6. Dynamic topic model
credit
images from
probabilistic topic model
by D.M. Blei
2012
http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12

7. Hierarchical Dirichlet
Process
credit
images from
probabilistic topic model
by D.M. Blei
2012
http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12

8. Online demo
• Allison Chaney: Topic Model Visualization
Engine (TMVE)
• lda for The American Political Science Review
• lda for 2006 arXiv
• ctm for Science (1980-2000)
• dtm for Science (1882-2001)
Monday, November 12, 12

9. Research groups
• David M. Blei and others from Princeton University
• http://www.cs.princeton.edu/~blei/
topicmodeling.html
• Wei Li, Wang Xuerui and Andrew McCallum from
University of Massachusetts
• http://people.cs.umass.edu/~mccallum/
• ......
Monday, November 12, 12

10. Implementations
• lda-c and others
• http://www.cs.princeton.edu/~blei/
topicmodeling.html
• gensim
• http://radimrehurek.com/gensim/
• mallet
• http://mallet.cs.umass.edu/index.php
Monday, November 12, 12

11. Interactions on SNS
Structure:
• following relationship
Interaction:
• notification by @
• reply
• retweet
Credit
by Kencf0618
http://commons.wikimedia.org/wiki/File:Kencf0618FacebookNetwork.jpg
Monday, November 12, 12

12. Spreading and conversation
Conversation by reply
by Roger McLassus
http://commons.wikimedia.org/wiki/File:2006-01-14_Surface_waves.jpg
Spreading by retweet
The Convesation
by Arnold Lakhovsky
http://commons.wikimedia.org/wiki/File:Lakhovsky_Conversation.jpg
Monday, November 12, 12

13. Conversation graph
• Conversation graph:
• the graph draw by reply relationship
• One tweet is too small and very contextual
• Conversation graph can be treat as a basic
unit for study
• Inside conversation-graph
• Inter conversation-graph
Monday, November 12, 12

14. Applying topic model
• Rational topic model for the inner-
structure of the conversation-graph
credit
images from
probabilistic topic model
by D.M. Blei
2012
http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12

15. The needs of
topical social dynamics
• How about the inter-structure of conversation-
graph?
• we need a new tool - the topical social dynamics
• theory not available right now
• Topic model are already here
• Graph dynamical system are emerging
• slowness: lda is slow, dtm is very slow, ....
Monday, November 12, 12

16. The last question
• How about ontological social dynamics?
• Topic is too coarse-grained
• ontological-social data are not very abundant
today
• knowledge is likely to be expressed by natural
language, not the ontology
• But ....
• in promising future
Monday, November 12, 12