1. 1
© 2011 Regents of the University of Minnesota. All rights reserved.
11
Enabling Youth Inquiry through
Citizen Science
EVALUATION/RESEARCH OVERVIEW
May 2013
University of Minnesota, Cedar Creek Ecosystem Science Reserve
Evaluation Team: Kim Kies, Nathan Meyer, Pam Larson Nippolt,
Siri Scott, Andrea Lorek Strauss, Katie Smiley

2. Acknowledgments
The Driven to Discover project is supported, in part, by a grant
from the National Science Foundation.

3. 3
© 2011 Regents of the University of Minnesota. All rights reserved.
AGENDA
►Research purpose/evaluation approach
►Snapshot of evaluation results to date
►Discuss instruments/procedures

4. 4
© 2011 Regents of the University of Minnesota. All rights reserved.
OVERARCHING GOALS
To engage individuals
working with youth in
Informal Science
Education settings in
Citizen Science, AND
to encourage
authentic inquiry in
this engagement.
Oberhauser 2010

5. 5
© 2011 Regents of the University of Minnesota. All rights reserved.
2 PHASES
1. Youth leader/youth/scientist research
teams engage in youth-initiated research
based on involvement in CS programs
focused on monarch butterflies or birds.
2. Disseminate model to broader audiences
of youth leaders and citizen science
practitioners.
Oberhauser 2010

6. 6
© 2011 Regents of the University of Minnesota. All rights reserved.
3 PREMISES
1. Engagement in authentic inquiry leads to
important science education outcomes.
2. Citizen Science is an engaging, effective setting
for learning science content & methods (~40% of
Monarch Larvae Monitoring Program volunteers
monitor with youth).
3. Integrating authentic inquiry into Citizen Science
programs will benefit the practice of Citizen
Science and Informal Science Education in
general.
Oberhauser 2010

7. 7
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH CHARACTERISTICS:

8. 8
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH GENDER
29%
71%
Male Female
39%
61%
Male Female
2010 2011 2012
Male 20 43 55
Female 48 67 70
• Percentage of male participants
increased slightly each year
44%
56%
Male Female

9. 9
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH AGE
• The largest proportion of youth are between the ages of 9 and 13.
• 28% of Year 2 youth and 23% of Year 3 youth were returning
participants
0
5
10
15
20
25
30
35
5 6 7 8 9 10 11 12 13 14 15 16 17
N
u
m
b
e
r
Age
2010
2011
2012
The Number of Youth by Age and Year

10. 10
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH ATTITUDES (2012)
 73% of youth coming into the program agree
that they can contribute to a citizen science
project, but only 56% say they consider
themselves a citizen scientist.
 78% of youth coming into the program are
interested in answering their own questions
about nature.
 33% had participated in a citizen science project
before. Of those, 26% participated through prior
D2D involvement and 7% another project.

11. 11
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH ATTENDANCE AND EXPERIENCE (2012)
Youth Attendance Ratings
% Youth
All of the time. I was at every
meeting.
44%
More than half of the time. I
missed a few meetings.
49%
About half of the time. I missed
about half of the meetings.
3%
Less than half of the time. I
missed more than half of the
meetings.
4%
• 73% of youth would like to
participate in the research
club again, 26% were
unsure and 1% did not want
to participate again.
• 74% said they enjoyed the
program a lot; 23% a
moderate amount; and 3%
said a little.

12. 12
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH KNOWLEDGE (2012 PRE-POST
PROGRAM COMPARISON)
43.0%
90.0%
59.0%
80.0%
93.0%
74.0%
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
90.0%
100.0%
Heard of citizen
science before?
Heard of hypothesis
before?
Heard of the
scientific process
before?
Pre
Post

13. 13
© 2011 Regents of the University of Minnesota. All rights reserved.
How often do you watch birds or
butterflies?
0.0%
5.0%
10.0%
15.0%
20.0%
25.0%
30.0%
35.0%
40.0%
45.0%
50.0%
Pre
post
How often do you try to identify the
bird or butterflies you see
outdoors?
0.0%
5.0%
10.0%
15.0%
20.0%
25.0%
30.0%
35.0%
40.0%
Pre
Post
YOUTH 2012 PRE AND POST PROGRAM
BEHAVIORS

14. 14
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH RATED SKILLS: 2012 PRE PROGRAM
0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0%
Finding organisms and their habitats
Observing organisms and their
habitats
Identifying organisms
Using scientific instruments
Using a field guide
Filling out data sheets
Very skilled Moderately skilled A little skilled Not skilled

15. 15
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH RATED SKILLS: 2012 POST PROGRAM
0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0%
Finding organisms and their habitats
Observing organisms and their
habitats
Identifying organisms
Using scientific instruments
Using a field guide
Filling out data sheets
Very skilled Moderately skilled A little skilled Not skilled

16. 16
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH RATED SKILLS: 2012 PRE PROGRAM
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50%
Asking a question that can be answered by
collecting data.
Developing testable hypotheses.
Designing a scientific procedure to answer a
question.
Creating graphs that help me and others
understand my data.
creating a display to communicate my data and
observations.
Analyzing the results of a scientific investigation.
Using the results of my investigation to answer
the question that I asked.
Very skilled Moderately skilled A little skilled Not skilled

17. 17
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH RATED SKILLS: 2012 POST PROGRAM
0% 10% 20% 30% 40% 50% 60%
Asking a question that can be answered by
collecting data.
Developing testable hypotheses.
Designing a scientific procedure to answer a
question.
Creating graphs that help me and others
understand my data.
creating a display to communicate my data and
observations.
Analyzing the results of a scientific investigation.
Using the results of my investigation to answer
the question that I asked.
Very skilled Moderately skilled A little skilled Not skilled

18. 18
© 2011 Regents of the University of Minnesota. All rights reserved.
EVALUATION PROCEDURES

19. 19
© 2011 Regents of the University of Minnesota. All rights reserved.
OVERVIEW
 We will ask you to complete / participate in…
– Assessments / Surveys
– Group phone / conference calls
– Attendance forms
– Observations with selected teams
– Focus Groups with adult leaders
 We will ask for your help…
– Youth enrollment / consents
– Youth assessments

20. 20
© 2011 Regents of the University of Minnesota. All rights reserved.
EVALUATION STEPS OVERVIEW
1. Complete and send the consent forms to Grant Bowers (D2D
Program Coordinator).
2. Complete and send youths’ completed pre-assessments and
reporting sheet.
3. Have fun! Do your projects! / Complete Attendance sheet. /
Participate in phone conference calls.
4. Complete and send youths’ completed post-
assessments, reporting sheet, and attendance sheet.
5. Attend the D2D summit / Adult leader focus groups.
6. Complete troop leader surveys.

21. 21
© 2011 Regents of the University of Minnesota. All rights reserved.
PARENT/YOUTH CONSENT
1. Parents complete enrollment/consent
forms (Voluntary)
2. Inform youth about the
research/evaluation process
3. Youth complete consent forms
(Voluntary)
4. Youth complete code sheet

22. 22
© 2011 Regents of the University of Minnesota. All rights reserved.
PARENT/YOUTH CONSENT
 Send the consent forms and youth code sheets in the
pre-stamped and addressed envelope to:
Grant Bowers
University of Minnesota
1980 Folwell Ave
200 Hodson Hall
St. Paul, MN 55108
P: 612.625.8304
F: 612.625.5299
bowe0182@umn.edu

23. 23
© 2011 Regents of the University of Minnesota. All rights reserved.
ADULT LEADER ASSESSMENTS
 Pre-program adult leader assessments: will be
administered through SurveyMonkey. A link will only be
sent to new leaders.
 Post-training assessments: if attending, will be
completed on paper directly after the training.)
 Post-program adult leader assessments will be
administered through SurveyMonkey. A link will be sent
to your email after we receive the youth assessments or
after the summit if you plan to attend.)

24. 24
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH ASSESSMENTS
 First and last meeting; dedicate 30 minutes
 Give plenty of time
 Provide a comfortable space for writing
 Let youth know that there are no correct / incorrect
answers
 Encourage them to fill it out completely (especially open-
ended questions)
 Make sure the youth complete the questions on their
own.
 Complete the survey at the meeting. Do not send the
surveys home with the youth to complete.

25. 25
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH PRE-ASSESSMENTS
 Administer prior to or at the first meeting before you
begin your activities.
 Put all the youth pre-assessment material into the self-
addressed stamped envelope provided in your
evaluation packet. Be sure to include the following:
– Reporting Sheet
– Youth Pre-Assessments
 Seal the envelope and put it where you will remember to
send it in the mail the next day.
 Send the assessment in the mail the day after your
meeting.

26. 26
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH PRE PROGRAM REPORTING SHEET

27. 27
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH PRE ASSESSMENT

28. 28
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH POST-ASSESSMENTS
 Administer after your team activities are completed.
 Put all the youth post-assessment material into the self-
addressed stamped envelope provided in your
evaluation packet. Be sure to include the following:
– Reporting Sheet
– Youth Post-Assessments
– Attendance forms
 Seal the envelope and put it where you will remember to
send it in the mail the next day.
 Send the assessment in the mail the day after your
meeting.

29. 29
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH POST ASSESSMENT REPORTING SHEET

30. 30
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH POST ASSESSMENT

31. 31
© 2011 Regents of the University of Minnesota. All rights reserved.
ATTENDANCE FORM

32. 32
© 2011 Regents of the University of Minnesota. All rights reserved.
ADULT LEADER GROUP PHONE / CONFERENCE CALLS
The program will offer Bi-weekly conference calls
for adult leaders to connect and discuss various
items. Conference call information will be shared
in bi-weekly E-zines. The calls offer the means:
 To disseminate useful information
 For adult leaders to ask questions
 For seasoned adult leaders to offer insight
 For adult leaders to share successes

33. 33
© 2011 Regents of the University of Minnesota. All rights reserved.
ADULT FOCUS GROUPS
 Adult leader focus groups will be
scheduled the first evening of the D2D
Summit / Insect Fair (November or
December 2013 -date to be decided).

34. 34
© 2011 Regents of the University of Minnesota. All rights reserved.
QUESTIONS?