This leadership webinar focused on current practices for evaluating program effectiveness, the evaluation tools in use and how state online schools analyze multiple sources of data to understand program success. Presenters will lead a discussion of important considerations around the ongoing formative data collected to inform teachers and administrators about what contributes to student success in online courses. The panelists will explore how their programs approach collection of data and what methodology they use to organize and present data for school or district leaders.

1. Approaches to Evaluating
Supplemental Online
Learning Programs
•
•
•
Robin Winder, Director of Student Learning, Florida Virtual School
Amy McGrath, Principal/Lead Instructor, World Languages, Florida Virtual
School
Joe Freidhoff, Director of Michigan Virtual Learning Research Institute,
Michigan Virtual School
December 2013

2. Webinar Focus
• Evaluation of Supplemental Online
Programs
– Information can apply to full time programs as
well as blended learning programs
– Takes time to learn what to evaluate, how to
evaluate and how to report results
– Perspectives from two well established
programs
• Michigan Virtual School: Est. 2000
• Florida Virtual School: Est. 1996

3. Michigan Virtual School
www.mivhs.org

4. About Michigan Virtual School
Fast Facts
• Created in 2000 by Public Act 230
• Supplemental Program
• Mainly High School, Some Middle School
• Over 138,000 enrollments since its inception
• Currently offer around 200-250 different online
courses

5. Program Evaluation
•
•
•
•
•
Accreditation
Perceptual Data
Reporting Results
Internal Monitoring
External Assistance

6. Accreditation

7. Perceptual Data
Available from: http://media.mivu.org/institute/pdf/stusurvey.pdf

8. Reporting Results
Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

9. Reporting Results
Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

10. Reporting Results
Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

11. Reporting Results
Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

12. Reporting Results
Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

13. Reporting Results
Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

14. Internal Monitoring

15. Internal Monitoring

16. Internal Monitoring

17. Internal Monitoring
Figure 8. School Names for Drops (Min. 5 Drops)

18. Internal Monitoring
Vendor Comparison Report

19. External Assistance
Available from: http://www.sri.com/sites/default/files/publications/supporting-k-12-students-online-learning-2.pdf

20. Florida Virtual School
www.flvs.net

21. Florida Virtual School
Part –time, Full- time, Global School
Talk about milestones! As we completed our 15th year, we
have served 819,488 total students.

22. Fully Accredited
• North Central Association Commission on
Accreditation and School Improvement
• North West Accreditation Commission
• Southern Association of College and
Schools Council on Accreditation and
School Improvement
• NCAA approval of Core Courses

23. The Florida Virtual School Approach
STUDENT DRIVEN

24. Depth of Knowledge
The effectiveness of my virtual program is ____
A. Highly Effective
B. Effective
C. Below Target
D. Unsure

25. Formative Assessment
•
•
•
•
•
Learning Styles
Pre/Post Tests +
Module Exams +
Live Lessons +
Discussion Based Assessment
= Competency Based Learning

26. Formative Data
Tracking Student Success
• Parents and Students are surveyed at intervals
• Data Reports that reveal student engagement
• Course Health Reports

27. FLVS Quality Assurance
Examples
•
•
•
•
•
Instructional Audits
Fidelity Checks
Concern & Celebration Reports
Principal Requests
Executive Leadership Requests

28. Summative Assessments
• Segment Exams
• End of Course Assessment
• AP Results

29. “Inspect what we
Expect”
FLVS Leaders Influence
Student Learning by
Promoting Vision
• Balanced Score Card

30. Algebra EOC Assessment Compared to
State

31. Geometry EOC Assessment
Comparison to State 2012-2013
School Year

32. Biology EOC Assessment Comparison
to State 2012-2013 School Year

33. 2012 AP Results

34. Reporting
• Annual Reports both externally and
internally
• Board Updates Monthly
• Community Relations Department

35. FLVS
Comprehensive Organizational Confidence in
STUDENT MASTERY OUTCOMES
because of….
•Adaptive Instruction
•Competency Based Instruction
•Reflection on student engagement
•Quality Assurance and Accountability

36. Questions

37. Contact Information
• Florida Virtual School – www.flvs.net
– Robin Winder, rwinder@flvs.net
– Amy McGrath, amcgrath@flvs.net
• Michigan Virtual School - www.mivhs.org/
– Joe Freidhoff, jfreidhoff@mivu.org