What Hath Wikipedia Wrought:
Crowds Remaking the News by Andrew Lih
Closing keynote at Wikisym 2010 in Gdansk, Poland. An update on the health of Wikipedia, its implications on the news industry and a description of a new project: Wikifactcheck.
What Hath Wikipedia Wrought? Crowds remaking the news
1. What Hath Wikipedia
Wrought:
Crowds Remaking the News
Wikisym Andrew Lih
Gdansk, Poland http://andrewlih.com
July 7-9, 2010 Wikipedia/Twitter:
Fuzheado
Associate professor
University of Southern California
Annenberg School for Communication and
Journalism
3. THE WIKIPEDIA REVOLUTION
U.S. $ 2 4.9 9
HOW A BUNCH OF NOBODIES
CREATED THE WORLD’S “Imagine a world in which every single person
on the planet is given free access to the sum of
GREATEST ENCYCLOPEDIA all human knowledge. That’s what we’re doing.”
—Jimmy Wales
With more than 2,0 0 0,0 0 0 individual articles on
everything from Aa! (a Japanese pop group) to
Zzyzx, California, written by an army of volunteer
contributors, Wikipedia is the # 8 site on the World
Wide Web. Created (and corrected) by anyone with
access to a computer, this impressive assemblage
of knowledge is growing at an astonishing rate of
more than 3 0,0 0 0,0 0 0 words a month. Now for the
How a Bunch of Nobodies
Greatest Encyclopedia
Created the World’s
first time, a Wikipedia insider tells the story of how
it all happened—from the first glimmer of an idea to
the global phenomenon it’s become.
Andrew Lih has been an administrator (a trusted
user who is granted access to technical features)
at Wikipedia for more than four years, as well as a
ANDREW LIH
regular host of the weekly Wikipedia podcast. In The
Wikipedia Revolution, he details the site’s inception
in 2 0 01, its evolution, and its remarkable growth,
while also explaining its larger cultural repercussions.
Wikipedia is not just a website; it’s a global commu-
ANDREW LIH nity of contributors who have banded together out of
a shared passion for making knowledge free.
Featuring a Foreword by Wikipedia founder Jimmy
Wales and an Afterword that is itself a Wikipedia
creation.
14. Wikipedia’s impact
ComScore: Top 5
Alexa: Top 6
Since 2006, overtaken
NY Times, Amazon,
Fox Interactive, eBay,
Time Warner sites
Comscore: Nov 2009 Alexa: Feb 2009
Photo by: victoriapeckham@flickr, Creative Commons
15. Wikipedia Stats
380 million unique visits a day
980 million clicks a day
Source: Wikimedia Foundation, July 2010
Photo by: victoriapeckham@flickr, Creative Commons
32. Article “supply”
• Fruit on the ground
• [[Dog]], [[Music]]
• Low hanging fruit
• [[History of England]]
• Higher hanging fruit/deletion
• [[Medical research related to low-carbohydrate diets]]
33. Articles in en: Wikipedia, Projections
(#$"
!"##"$%&'
("
'#$"
Higher
'" hanging fruit
&#$"
&"
Low hanging
fruit
%#$"
%"
Fruit on
!#$"
the ground
!"
)*+,!%" )*+,!&" )*+,!'" )*+,!(" )*+,!$" )*+,!-" )*+,!." )*+,!/" )*+,!0" )*+,%!" )*+,%%" )*+,%&" )*+,%'" )*+,%("
34. Hypotheses
• Human knowledge always expanding,
but...
• Steep exponential curve 2001-2005
a “catchup” phase to existing
knowledge
• Will settle into a less dramatic curve,
even linear?
42. Editing followthrough
• Wikitravel: only 5% of those who press
“edit” actually save
• Wikipedia: 1/5 to 2/5
• WikiHow: 30% with guided editing
• Wikia: WYSIWYG editor >> 50%
Sources: Jack Herrick, WikiHow; Erik Zachte, Wikimedia Foundation
43. Wikimania presentations
Why do Editors Leave Wikipedia? A
Survey of Casual Contributors
Howie Fung - exit interviews
Trends in Wikipedia Communities
Ronald Beelaard- activity before
leaving
Photo by: Susan NYC@flickr, Creative Commons
44. Wikimedia Usability Study
“Every user in this study struggled
to get a basic grasp of the editing
interface... largely failed to make
edits correctly without repeated
attempts and efforts”
http://usability.wikimedia.org/wiki/Usability_and_Experience_Study#Feeling_Stupid
Photo by: Susan NYC@flickr, Creative Commons
45. Losing Ground?
“But not even our youngest and
most computer savvy participants
accomplished these tasks with ease”
http://blog.wikimedia.org/2009/04/24/usability-study-results-sneak-preview/
Photo by: Stevenfruitsmaak@commons.wikimedia, Creative Commons generic 2.5
77. Information Pyramid
?
wisdom
context, historical analysis
knowledge
press releases, live coverage,
photos
Information
sports stats, weather metrics,
financial
data
78. Impact of Internet Media
?
wisdom
context, historical analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather, financial
data
79. Impact of Internet Media
?
wisdom
context, historical analysis
knowledge
press releases, live coverage,
commodity photos
user generated Information
multiple sources
sports, weather, financial
data
80. Journalism Values
?
wisdom
context, historical analysis
knowledge
press releases, live coverage,
commodity photos
user generated Information
multiple sources
sports, weather, financial
data
81. Journalism Values
editing
?
research
storytelling wisdom
curation
context, historical analysis
knowledge
press releases, live coverage,
commodity photos
user generated Information
multiple sources
sports, weather, financial
data
82. Journalism Values
editing fairness
?
research accuracy
storytelling wisdom balance
curation transparency
context, historical analysis
knowledge
press releases, live coverage,
commodity photos
user generated Information
multiple sources
sports, weather, financial
data
83. Wikipedia and the News
"Trying to determine what
is going on in the world by
reading newspapers is like
trying to tell the time by
watching the second hand
of a clock."
-Ben Hecht
88. NASA Clickworkers
Volunteers,
identifying and
classifying the
age of craters
on Mars
http://en.wikipedia.org/wiki/Clickworkers
89. Clickworkers vectorizing craters
“accomplished in a week
what a single graduate
student would have
needed a year to
complete”
The Future of the Internet--And How to Stop It by Jonathan Zittrain
91. UK Parliament expenses scandal
20,000
volunteers
comb through
PDF documents
http://www.niemanlab.org/2009/06/four-crowdsourcing-lessons-from-the-guardians-spectacular-expenses-scandal-experiment/
92. Guardian experiences
Your workers are unpaid, so
make it fun.
Speed: use a framework, Django
Burst: have servers ready -
Amazon EC2
94. Wisdom of Crowds Online
(Derek Powazek, SXSW2009)
Small simple tasks
Large diverse groups
Design for selfishness
Result aggregation
Photo by: iskanderbenamor@flickr, Creative Commons
96. Attorneys scandal
TPM Muckraker readers
combed thru 3,000 emails
In hours, crowd ID’ed
“compromising passages”
Result: MSM news stories,
Polk Award
http://www.npr.org/templates/story/story.php?storyId=9083501
97. Theme Park Insider
Early whistleblower site
Report accidents, first-hand
accounts, photos to TPI
http://www.ojr.org/ojr/stories/070731niles/
98. Robert Niles (Theme Park Insider)
“Crowdsouring...
will stand along the
traditional ‘big three’ of
interviews, observation and
examining documents”
http://www.ojr.org/ojr/stories/070731niles/
99. Journalism Values
editing fairness
?
research accuracy
storytelling wisdom balance
curation transparency
context, historical analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather, financial
data
100. Clay Shirky
The problem is filter failure,
not information overload
101. A new model for
understanding the crowd,
creation and curation
102. Understanding
Content | Curation
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather,
financial
data
Credit: Andrew Lih, University of Southern
California
103. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather,
financial
data
Credit: Andrew Lih, University of Southern
California
104. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
105. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
106. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
107. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
Wikipedia
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
108. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
Wikipedia
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
109. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
Wikipedia
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
110. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
111. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
112. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker
s
Credit: Andrew Lih, University of Southern
California
113. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open
s Streetmap
Credit: Andrew Lih, University of Southern
California
114. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open
s Streetmap
Credit: Andrew Lih, University of Southern
California
115. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open
s Streetmap
Credit: Andrew Lih, University of Southern
California
116. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open
s Streetmap
Credit: Andrew Lih, University of Southern
California
117. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open TPM
s Streetmap Muckraker
attorneys
scandal
Credit: Andrew Lih, University of Southern
California
118. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open TPM
s Streetmap Muckraker
attorneys
scandal
Credit: Andrew Lih, University of Southern
California
119. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open TPM
s Streetmap Muckraker
attorneys
scandal
Credit: Andrew Lih, University of Southern
California
120. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open TPM
s Streetmap Muckraker
attorneys
scandal
Credit: Andrew Lih, University of Southern
California
121. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open TPM ThemePark
s Streetmap Muckraker Insider
attorneys
scandal
Credit: Andrew Lih, University of Southern
California
122. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open TPM ThemePark
s Streetmap Muckraker Insider
attorneys
scandal
Credit: Andrew Lih, University of Southern
California
123. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open TPM ThemePark
s Streetmap Muckraker Insider
attorneys
scandal
Credit: Andrew Lih, University of Southern
California
124. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information CNN
Wikipedia
iReport
sports, weather,
financial
data NASA
Clickworker Open TPM ThemePark
s Streetmap Muckraker Insider
attorneys
scandal
Credit: Andrew Lih, University of Southern
California
125. Impact of Internet Media
?
wisdom
context, historical analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather, financial
data
126. News industry
Journalism not doomed but
it is shifting to a permanent
disruptive beta mode
Fortune at the top of the
pyramid
127. Journalism Values
editing fairness
?
research accuracy
storytelling wisdom balance
curation transparency
context, historical analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather, financial
data
128. Journalism’s problems
Journalism is not
stenography.
Too often it is.
http://www.ojr.org/ojr/stories/070731niles/
129. Wikipedia relevance
WP:V and WP:RS
What if the sources aren’t
checking themselves?
http://www.ojr.org/ojr/stories/070731niles/
130. Sources and facts
Military commentators
(MSNBC)
Irresponsible reporting
(FOX)
Sunday Morning talk shows
(NBC)
138. Understanding
Content | Curation
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather,
financial
data
Credit: Andrew Lih, University of Southern
California
139. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information
sports, weather,
financial
data
Credit: Andrew Lih, University of Southern
California
140. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information Wikipedia
sports, weather,
financial
data
Credit: Andrew Lih, University of Southern
California
141. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information Wikipedia
sports, weather,
financial
data
Credit: Andrew Lih, University of Southern
California
142. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information Wikipedia
sports, weather,
financial
data
Credit: Andrew Lih, University of Southern
California
143. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information Wikipedia
sports, weather,
WikiFactCheck
financial
data
Credit: Andrew Lih, University of Southern
California
144. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information Wikipedia
sports, weather,
WikiFactCheck
financial
data
Credit: Andrew Lih, University of Southern
California
145. Understanding
Content Curation
Crowd/
Audience
Content | Curation Corporate/
Govt
...
wisdo
m
context, historical
analysis
knowledge
press releases, live coverage,
photos
Information Wikipedia
sports, weather,
WikiFactCheck
financial
data
Credit: Andrew Lih, University of Southern
California
147. Andrew Lih
andrew@andrewlih.com
THE WIKIPEDIA REVOLUTION
Twitter: Fuzheado
cle disc ussion view sourc e history U.S. $ 2 4.9 9
pedia Revolution HOW A BUNCH OF NOBODIES
pedia, the free encyclopedia CREATED THE WORLD’S “Imagine a world in which every single person
navigation, search on the planet is given free access to the sum of
s article is about the book. For the different, similar terms related to Wikipedia, see
GREATEST ENCYCLOPEDIA all human knowledge. That’s what we’re doing.”
—Jimmy Wales
ipedia (terminology).
Wikipedia’s non-encyclopedic visitor introduction, see Wikipedia:About.
With more than 2,0 0 0,0 0 0 individual articles on
Revolution (pronunciation ) is the story of the free, [1] multilingual ency-
roject supported by the non-profit Wikimedia Foundation. The website’s name
everything from Aa! (a Japanese pop group) to
anteau of the words wiki (a technology for creating collaborative websites) and Zzyzx, California, written by an army of volunteer
dia. Wikipedia’s 1 0 million articles have been written collaboratively by volun- contributors, Wikipedia is the # 8 site on the World
nd the world, and almost all of its articles can be edited by anyone who can Wide Web. Created (and corrected) by anyone with
Wikipedia website. [2] Launched in 2 0 0 1 by Jimmy Wales and Larry Sanger, [3] it access to a computer, this impressive assemblage
y the largest and most popular[1] general reference work on the Internet. [4][5][6] of knowledge is growing at an astonishing rate of
edia Revolution traces Wikipedia’s phenomenal success back to its roots, and more than 3 0,0 0 0,0 0 0 words a month. Now for the
How a Bunch of Nobodies
Greatest Encyclopedia
Created the World’s
e people who have contributed to its stated mission of giving every single person
first time, a Wikipedia insider tells the story of how
s to the sum of all human knowledge.
it all happened—from the first glimmer of an idea to
the global phenomenon it’s become.
e Introduction to The Wikipedia Revolution Andrew Lih has been an administrator (a trusted
edia founder, Jimmy Wales user who is granted access to technical features)
at Wikipedia for more than four years, as well as a
ANDREW LIH
regular host of the weekly Wikipedia podcast. In The
ow, it’s hard not to use the Internet without experiencing Wikipedia in Wikipedia Revolution, he details the site’s inception
s and surfing. It has become an incredibly useful Internet resource in in 2 0 01, its evolution, and its remarkable growth,
nguages. Yet when you use Wikipedia, you may not understand the while also explaining its larger cultural repercussions.
phy behind it. Wikipedia is not just a website; it’s a global commu-
book tells the story of how Wikipedia began and evolved from a traditional
pedia into the intricate global community that it is today. ANDREW LIH nity of contributors who have banded together out of
a shared passion for making knowledge free.
ISBN: 978-1-4013-0371-6
Featuring a Foreword by Wikipedia founder Jimmy
Wales and an Afterword that is itself a Wikipedia
creation.
148. What Hath Wikipedia
Wrought:
Crowds Remaking the News
Wikisym Andrew Lih
Gdansk, Poland http://andrewlih.com
July 7-9, 2010 Wikipedia/Twitter:
Fuzheado
Associate professor
University of Southern California
Annenberg School for Communication and
Journalism
Notas do Editor
20 minutes for presentation , 10 minutes for Q&A
Famous saying in the community
Works in practice, but not in theory
No better starting point, no worse ending point
Wikipedia is the worst place to start, except for every other web site
Famous saying in the community
Works in practice, but not in theory
No better starting point, no worse ending point
Wikipedia is the worst place to start, except for every other web site
What started conventional, 7 step process, top editors, copy editor, PhDs required
Only sites that consistently rank above it globally are Google, Yahoo and Microsoft. Oftentimes Facebook. Depending on locales and language groups, one other property ranks above Wikipedia, such as T-sites in Germany, France Telecom. Korea: cyworld, daum, naver
"Functional MRI of the social mind"
(attentive clusters)
Muslim Brotherhood in Egypt, wants strictly Islamic state
Levant - Lebanon, more Western sensibilities
Al Jarida, Kuwaiti newspaper, all color, started in 2007
Human rights site, secular bloggers in Egypt
NY Times, Kuwaiti, Levant, secular reform bloggers
Al Jazeera the only one that is consistently cited across the Arabic blogosphere -- secular, religious, Arab-oriented, Western, et al.
As an emergent phenomenon that shows the influence and perceived reliability of Wikipedia
Famous saying in the world of Linux and open source software
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
The idea is that depending on the situation, sometimes the crowds is the better “filter” or the “MSM”
One irreverent addition that delivers you to wisdom? Lostpedia
Heroes, 24
20 minutes for presentation , 10 minutes for Q&A