For the past two academic years, the ePortfolio team at the University of Michigan has administered pre and post surveys to students that were using ePortfolios for the purpose of fostering integrative, lifelong, and lifewide learning. This session will present results from this longitudinal research, focusing on specific trends, significant findings and implications of this research for conducting integrative assessments of students' academic and co-curricular learning.
Fostering Friendships - Enhancing Social Bonds in the Classroom
Investigating Changes in Integrative and Lifelong Learning: Students’ Use of ePortfolios
1. Investigating Changes in
Integrative and Lifelong
Learning: Students’
Use of ePortfolios
Steven Lonn
Research Specialist
USE Lab • Digital Media Commons • University of Michigan
2. ses
C our
Job
Liv i ng
icu lar
rac urr
Ext
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
3. USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
4. Reflective
Integrative
Real-World
Evidence-Based
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
5. Pre & Post Surveys
Twelve learning
outcome categories:
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
6. Pre & Post Surveys
And... activities, opinions,
and perspectives about
the portfolio process
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
7. 1 2 3 4 5
6 7 8 9 10
11 12 13 14 15
16 17 18 19 20
21 22 23 24 25
26 27 28 29 30
31 32 33 34 35
USE Lab
36 37 Digital Media Commons
http://umich.edu/~uselab University of Michigan
8. 1 2 3 4 5
6 7 8 9 10
11 12 13 14 15
16 17 18 19 20
21 22 23 24 25
26 27 28 29 30
31 32 33 34 35
USE Lab
36 37 Digital Media Commons
http://umich.edu/~uselab University of Michigan
9. 9 37 25 28
3 6 26 30
12 18 31 29
15 17 21
34 27
35 7
8 36
32 1 4
10 20
13 2 5
11 22 24
16 33 14
19 23
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
10. Capacity to demonstrate
and apply knowledge of
various sorts
11 Items
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
11. Recognition &
understanding of
intercultural and
collaborative situations
6 Items
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
12. Self-awareness of
learning across settings
7 Items
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
13. Insight into the
process of working
with others
6 Items
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
14. Engagement with factors
that influence my
perspectives and
decisions
4 Items
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
15. Developing a
professional identity
3 Items
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
16. 620 Pre-Post Surveys
Over Two Years
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
17. Factor Pre-Survey Post-Survey Gain
demonstrate and apply
3.88 4.26 0.38
knowledge
intercultural & collaborative
4.42 4.49 0.07
situations
self-awareness of learning 4.25 4.42 0.17
process of working with
4.12 4.31 0.19
others
factors that influence my
4.30 4.45 0.15
perspectives & decisions
developing a professional
3.49 4.09 0.60
identity
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
18. PortfolioProcess
Process
PortfolioProcess
Process
PortfolioProcess
PortfolioProcess
Portfolio
Portfolio
0.75 0.7
0.6
0.6
0.5
0.3
0.2 0.4
0.25 0.2
0.1 0.2
0.1 0.2
0 0.1
factors that
intercultural & process of demonstrate developing a
influence my self-awareness
collaborative working with and apply professional
perspectives & of learning
situations others knowledge identity
decisions
USE Lab
Multiple Digital Media Commons
http://umich.edu/~uselab Single University of Michigan
19. # of Students
Humanities 60
Natural Sciences 108
Social Sciences 310
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
20. 0.75 0.71
0.58 0.57
0.50
0.5 0.46
0.35
0.31
0.28 0.29 0.29
0.25
0.25
0.20
0.16
0.13 0.12
0.09 0.08
0.03
0
intercultural & factors that self-awareness process of demonstrate developing a
collaborative influence my of learning working with and apply professional
situations perspectives & others knowledge identity
decisions
Humanities
USE Lab Natural Science Digital Media Commons
http://umich.edu/~uselab Social Science University of Michigan
21. Context Matters...
Michigan Research Community /
Women in Science & Enginering
(MRC / WISE)
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
22. Context Matters...
School of Education
Commuter Campus
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
23. Context Matters...
Residential Housing Staff
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
24. Context Matters...
Writing Center
Program Courses
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
25. MRC/WISE Education Res Staff Writing
0.9
demonstrate 0.3
and apply 0.4
knowledge 0.3
0.6
developing a 0.6
professional 0.6
identity 0.5
0.5
self-awareness 0.1
of learning 0.2
0.2
factors that 0.4
influence my 0.1
perspectives & 0.2
decisions 0.1
0.4
process of 0.1
working with 0.2
others 0.2
0.3
intercultural & 0.0
collaborative 0.1
situations 0.0
0 0.25 0.5 0.75 1
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
26. 5
4.5
-Survey
Pre
4
3.5
3
developing a demonstrate process of self-awareness factors that intercultural &
professional and apply working with of learning influence my collaborative
identity knowledge others perspectives & situations
decisions
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
27. 5
4.5
4
3.5
3
developing a demonstrate process of self-awareness factors that intercultural &
professional and apply working with of learning influence my collaborative
identity knowledge others perspectives & situations
decisions
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
28. )
cant
(signifi
No Differences!
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
29. )
cant
(signifi
No Differences!
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
30. )
cant
(signifi
No Differences!
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
31. ?
?
?
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
32. Very
While creating your portfolio, how important was...
Important 5
4.15 4.18 4.21
4.01 4.05 4.07
4
3.7
3.53
3.44
3.22
3
2
Not
1
Important
iew
k
s
ck
er
ns
.
k
ills
rk
tc
er
ac
or
th
wo
io
ba
,e
sk
th
db
rv
rw
ct
ge
ed
hs
/o
d
te
e
n
ne
to
an
gt
ou
fe
fe
go
w
In
on
en
ng
ng
ng
gy
ge
lio
ive
in
gc
tr
hi
ivi
ivi
led
ct
tfo
tin
,s
at
yt
in
G
ce
fl e
er
es
ow
en
or
er
ak
Re
Re
en
lu
gp
um
ev
M
kn
va
G
in
ng
oc
ID
ID
ar
tti
D
Sh
Pu
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
33. What do you think was the purpose of creating an electronic
portfolio as part of your course or program?
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
34. Who (which groups of students) do you think would most benefit
from the process of creating an electronic portfolio?
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
35. USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
36. Perceptions
Qualitative Content
Measurable Outcomes
Contexts
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
37. Contexts
Perceptions
Measurable Outcomes
Qualitative Content
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
38. Survey Power
Analysis at Scale
Ot her Idea
s.. .
USE Lab Digital Media Commons
http://umich.edu/~uselab University of Michigan
39. THANK YOU!
Steven Lonn
slonn@umich.edu
http://umich.edu/~uselab
USE Lab • Digital Media Commons • University of Michigan