The Claremont Consortium administers a biennial survey to the approximately 5,000 Sakai-using undergraduate and graduate students in its member institutions [Claremont McKenna College, Claremont Graduate University, Harvey Mudd College, Keck Graduate Institute, Pitzer College, Pomona College and Scripps College]. The presentation summarizes findings from the 2008 and 2010 surveys. We identify changes in student use of Sakai; student assessment of the benefits and drawbacks of courses that use Sakai; which tools students find most useful in their courses as well as tool usage patterns, and student suggestions to improve Sakai and the ways that it is used in their classes.
Presented at the 2010 Sakai Conference (Denver, CO) on June 17, 2010. (Presentation slightly updated for online viewing.)
15. Overall Experience: Do students prefer courses that use Sakai? 2008 2010 2008 9% 54% 19% 8% 10% 2010 23% 57% 13% 3% 5%
16.
17.
18.
19.
20.
21.
22.
23.
Notas do Editor
Good afternoon, I’m Mary McMahon from Pomona College and this is Susan Kullmann from Scripps College. Thank you for choosing to spend this time at our presentation in the last period of this conference. Susan Kullman and I will be discussing results of Sakai satisfaction surveys administered in 2008 and again in 2010 to students in the Claremont Consortium. We’ll be comparing and contrasting the results of those surveys administered two years apart. In doing so, we’re reporting on contributions made by many people, some of whom are in the room . . . --next slide
You’re met some of these folks in the last few days. We’ll try to represent our students’ views the many who are not here. 1 st a few words about the Claremont Consortium Next->
We are 5 residential liberal arts colleges plus 2 grad institutions about 30 miles east of Los Angeles. There are 7 of us here at the conference from those schools. In total, the student population is about 6,300 from all 7 schools. We administered the student survey in spring 2008 and again on 2010. The intervening years we administration Faculty Satisfaction surveys. For both faculty and student cycles, we use the standard questions from the Multi Institutional Survey Initiative (MISI) survey managed by University of Michigan. Here’s our responses by college->
2008 = 865 (~14%) 2010 = 1128 (~18%) HMC had a contest for entrants PO 257 250 HMC 234 307 CMC 102 153 PZ 20 82 SCR 114 172 CGU 65 138 KGI 0 27 2008 TOTAL 865 14% 2010 TOTAL 1130 18%
We asked which browser they use— Other included largely Chrome plus a few who indicated they used multiple browsers.
How they rated their own proficiency –
HMC students generally more perceived as moretechnical
Sakai was never difficult for most students to use.
Survey Question: Which Sakai tools do you use? 2008 – Other tools mentioned by less than 25% (and more than 10%) of respondents: Schedule/Calendar (13%). 2010 – Other tools mentioned by less than 25% (and more than 10%) of respondents: Schedule/Calendar (18%), Forums (16%), Messages (16%). Implications: More faculty are using Sakai. Newer faculty users are probably using fewer tools than early adaptors.
Questions: Which of the following Sakai tools do you find most useful in your courses. For both years, all other tools were selected by less than 10% of respondents.
Question: Please rate your overall experience with Sakai. Positive (Excellent + Good) 2008 = 62% 2010 = 76%
Question: I prefer courses that use Sakai to organize course materials and communications.
Students are more familiar with Sakai because of more individual usage and more classes using Sakai More classes use Sakai - All courses automatically have Sakai course sites populated with students and faculty; rosters updated regularly during add/drop period - More faculty USE in 2010 because of greater Sakai experience (administrative uses), training workshops, exposure to peer usage, etc.
Open-ended question: If you could change one feature in Sakai, what would it be? Why?
These are issues mentioned in a questions about the drawbacks of courses that use Sakai. Faculty preferences &/or training: inconsistent use, failure to use email notification, resource naming conventions, syllabus Sakai software: no search feature, back button Network: Email from Sakai goes to spam: 7 email servers interact with Sakai. Problem when students forward to/from gMail accounts
Open-ended question: What are the benefits of courses that use Sakai?
These are some of our favorite student comments Sakai URL = sakai.claremont.edu which redirects to a longer URL This is summary data from 7 institutions (undergraduate & graduate) All are small private institutions so there are no fully online classes, some hybrids at the graduate school 2008 survey was taken one year after Sakai adoption 2010 data is encouraging and provides us with areas to focus our energy and resources re: usability and training