1. Respect for Small Data

2. Big Data
“...is the mathematics of
effectiveness. It aggregates
data at scale — it doesn’t
work at small scale.”
-Jose Ferreira, CEO

3. Small Data
measures
effectiveness on a
personal level.
-Me

4. Same two questions:
Are you... Am I...
1.satisfied/happy?
2.going to succeed?

5. Punnett
Square of
Student
Experience
:) : (
A+
F
Experience
Success

6. Punnett
Square of
Student
Experience
:) : (
A+
F
:DA+
Experience
Success
:|F
: (
F
A+

7. Four ways
1.Written Woes
2.Grading
3.NPS/Ratings
4.Objectivity/Consistency

8. Pick something
to measure.

9. Examples of what we started tracking
ratings
“NPS” scores
number of tickets from students
number of emails
number of flagged/problematic submissions
number/% of completers
average grades
average scores
scores by different graders on the same assignment
# of submissions by week
average turnaround time for feedback
% of students who bought the book
time to completion
comparative course ratings

10. 1. Writing

12. 2. Normalization

13. 3. NPS/Ratings

14. Dissatisfaction doesn’t have
to be permanent

15. 4. Objectivity
& Consistency

16. http://docs.moodle.org/25/en/Quiz_statistics_report

17. Sources of information
logs
gradebook export
activity reports
rubrics
sql queries
surveys
end of course evaluations
exit interviews
help desk tickets
requests
chats (live chat transcripts)
phone calls ...and

18. Sources
Jose Ferreira quote: http://www.knewton.com/blog/ceo-jose-ferreira/big-data-
mathematics/
Mdocs: http://docs.moodle.org/27/en/Quiz_statistics_report
Images from Unsplash.com (CC0 public domain)
● Dandylion
● Beach
● Wood
Rageface from none other than Rage Comics
http://www.reddit.com/r/fffffffuuuuuuuuuuuu/