Introduction to the Wikilytics Platform to analyze the health of a Mediawiki community.

1. wikilytics
DATA SUMMIT
Feb 4, 2011
Diederik van Liere

8. “ Live Demo”

10. answers
wikilytics platform
raw data

11. Wikilytics
config | download | extract | sort | store | transform
raw data answers

12. configure | wikilytics
config | download | extract | sort | store | transform

13. language support | wikilytics
config | download | extract | sort | store | transform

14. download dump | wikilytics
config | download | extract | sort | store | transform

15. extract variables | wikilytics
config | download | extract | sort | store | transform

16. mergesort edits by editor | wikilytics
config | download | extract | sort | store | transform

17. store editors in db | wikilytics
config | download | extract | sort | store | transform

18. precompute variables | wikilytics
config | download | extract | sort | store | transform

19. config | download | extract | sort | store | transform
00:00:00:000 01:05:29:352
(Polish wiki)

20. “Command lines are too hard...”

21. Launch the entire data-processing from
your browser

22. The entire data-processing chain is
running...

23. wikilytics platform
Plugins (Python) Map / Reduce (JS)
Analysis
BSON Document in New Collection in
Storage MongoDB MongoDB
Output

24. Each analysis is a plugin...
def new_editor_count(var, editor, **kwargs):
'''
Summary: This function generates an overview of the number of
new_wikipedians for a given year / month combination.
Purpose: This data can be used to compare with Erik Zachte's
stats.download.org to make sure that we are using the same numbers.
'''
# headers = ['year', 'month', 'count']
new_wikipedian = editor['new_wikipedian']
var.add(new_wikipedian, {0:1})
return var

25. ...and available in your browser

26. Text

27. Resources
•strategy.wikimedia.org/wiki/Editor_Trends_Study
•strategy.wikimedia.org/wiki/Editor_Trends_Study/Software
•svn.wikimedia.org/svnroot/mediawiki/trunk/tools/editor_trends/