The Open SUNY Course Quality Review Rubric OSCQR

Center for Online Teaching Excellence (COTE) #OpenEd16 #OSCQR
Center for Online Teaching Excellence (COTE)
The Open SUNY Course Quality Review Rubric
OSCQR
Alexandra M. Pickett
Director, Open SUNY COTE
OpenED
2016

November 4, 2016
#OpenEd16
#oscqr

Presentation Goals
•  Learn about the OSCQR Online Course Quality Review Process & Rubric.
–  Earn a badge.
•  Take home the Rubric.
–  CC licensed
–  Feedback?
–  Opportunities for collaboration?
•  Join our community.
–  Become “Friend of SUNY” to network, access resources, and continue
the conversation. And, earn another badge.

64 Campuses

1994:
Ini%ated
system-‐wide

asynchronous
learning

network
with
grants
from

Sloan
Founda%on:
The
SUNY

Learning
Network

1995:
Launched
the
ﬁrst
online
mul%-‐
ins%tu%onal
Learning
Management

System
that
scaled
to
support
40+

ins%tu%ons

1996:
Launched
system-‐
wide
online
faculty

development
and
online

course
design
processes

2000:
SUNY’s
SLN
became
the

second-‐largest
asynchronous

learning
network
in
the
country

2012:
Online
faculty
developed
through
SLN

surpass
5,000
mark,
along
with
thousands
more

developed
by
campuses.

There
are
nearly
400

online
degree
programs
and
12,000
online
course

sec%ons

2013:
Announced

Open
SUNY
launch

challenge,
State
of

University
address

2010:
Ini%ated

Power
of
SUNY

&
Innova%ve

Instruc%on

Transforma%on

Team

2011:
SUNY
online
students
passed
the
85K

mark.

Established
Chancellor’s
Advisory

CommiVee
on
Online
Educa%on
(part
of
GeYng

Down
to
Business
Ini%a%ve)

A Rich History

Who are we? How did we get here?
SLN
Application
Support
Online
readiness
assessment
Open-
SUNY.edu
navigator Exploration
course
Student
online
experience
SLN
Education
Research
Faculty
professional
development
in online
education
SLN Online
Resources
LMS
Administrative
Support
LMS
Hosting
SLN
HelpDesk

Open SUNY Initiatives
Campus and
system-wide
initiatives and
supports
Student
Supports
24/7 service
hotline
Online
academic
tutoring
Library
and open
educational
resources
Student
computer
program
Academic
initiatives
Lab for
new models
in teaching
and learning
Affordable
broadband
for NYS
Revenue
and cost
models
Universal
sign-on
Online
readiness
assessment
Policy
architecture
NY State
SUNY
Prior
learning
assessment
High-needs
disciplines
General
education
Signature
SUNY
programs
Skill
remediation
Offerings
powered by
Open SUNY
Open SUNY
infrastructure
Educational
resources
Competency-
based
learning
Credit-
bearing
third-party
content
Open SUNY
Global
ePortfolio
Open-
SUNY.edu
navigator
Credits
and financial
aid across
campuses
Student
services
hotline
Experiential
learning
Exploration
course
Student
online
experience
Faculty
Supports
Research &
Innovation
COTE
Course
Supports
Community
Of Practice Competency
Development
Open SUNY
Learning
Commons
24/7 service
hotline
Institutional
pathways &
readiness
Student
concierge
Enrollment
Marketing
mgmt
Monitoring
and
continuous
improvement
Stakeholder
engagement
and commu-
nications
Funders
and
partners
Complete
SUNY
IT enablers
Legal and
compliance
policies
Identification
& verification
Workforce
development

Campus and
system-wide
initiatives and
supports
Student
Supports
24/7 service
hotline
Online
academic
tutoring
Library
and open
educational
resources
Student
computer
program
Academic
initiatives
Lab for
new models
in teaching
and learning
Affordable
broadband
for NYS
Revenue
and cost
models
Universal
sign-on
Online
readiness
assessment
Policy
architecture
NY State
SUNY
Prior
learning
assessment
High-needs
disciplines
General
education
Signature
SUNY
programs
Skill
remediation
Offerings
powered by
Open SUNY
Open SUNY
infrastructure
Educational
resources
Competency-
based
learning
Credit-
bearing
third-party
content
Open SUNY
Global
ePortfolio
Open-
SUNY.edu
navigator
Credits
and financial
aid across
campuses
Student
services
hotline
Experiential
learning
Exploration
course
Student
online
experience
Institutional
pathways &
readiness
Student
concierge
Enrollment
Marketing
mgmt
Monitoring
and
continuous
improvement
Stakeholder
engagement
and commu-
nications
Funders
and
partners
Complete
SUNY
Open SUNY Center for Online Teaching Excellence
IT enablers
Legal and
compliance
policies
Identification
& verification
Workforce
development
(COTE)
Research &
Innovation
Competency
Development
Course
Supports
Community
Of Practice
Open SUNY
Learning
Commons
24/7 service
hotline
COTE
Faculty
Supports

Open SUNY Center for Online Teaching Excellence
Course Supports


Course

Development/

Refresh

Learning

Review

Continuous
Improvement
Course Review &
Refresh
Course Supports
Course

Delivery

Support

Course
Delivery
Course

Development

Support

Meet OSCQR!
Open
SUNY
Course
Quality
Review
Rubric

Evolution of OSCQR

Evolution of OSCQR
QM
Bb
iNACOL

The OSCQR Rubric
Customizable
Non-evaluative
Focused on improvement
Research-based
50 design and accessibility standards

Community
of
Inquiry

(Garrison,
Anderson,
&
Archer,
2000)

Pedagogical Influences

Community
of
Inquiry

(Garrison,
Anderson,
&
Archer,
2000)

Blooms
Taxonomy

(Bloom
et
al.,
1956)


Community
of
Inquiry

(Garrison,
Anderson,
&
Archer,
2000)

Blooms
Taxonomy

(Bloom
et
al.,
1956)

How
People
Learn

(Bransford
et
al.,
1999)


Community
of
Inquiry

(Garrison,
Anderson,
&
Archer,
2000)

Blooms
Taxonomy

(Bloom
et
al.,
1956)

How
People
Learn

(Bransford
et
al.,
1999)

The
Adult
Learner

(Malcom
Knowles,
1973)


Community
of
Inquiry

(Garrison,
Anderson,
&
Archer,
2000)

Blooms
Taxonomy

(Bloom
et
al.,
1956)

How
People
Learn

(Bransford
et
al.,
1999)

The
Adult
Learner

(Malcom
Knowles,
1973)

7
Principles
for
Good
Prac%ce
in

Undergraduate
Educa%on

(Chickering
&
Gamson,
1987)


The OSCQR Rubric
DEMO


Course

Development/

Refresh

Learning

Review

Course

Development

Support

Continuous
Improvement
Course

Delivery

Support

Course Review &
Refresh
Course Refresh
Course
Delivery

Factors of Quality
Instructional
Design
Program of
Study
Course
Management
Instructor
Feedback
Institutional
Readiness
Student
Readiness
Faculty
Readiness

Instructional Design
Instructional
Design
•  Alignment of course objectives.
•  Learning activities/assessments.
•  Social Presence, Teaching Presence,
Cognitive Presence.
•  The Learner’s Perspective:
•  Navigation
•  Pacing
•  Content presentation
•  Accessibility.

Online Course Review Models
The Rubric is flexible and designed to be used in a variety
of online course quality assurance approaches.
•  Professional Development
•  Self-Assessment
•  Peer Review
•  Collaborative Team

OSCQR Rubrichttp://bit.ly/oscqrselfassess

OSCQR Rubric
DEMO

OSCQR Dashboard

OSCQR Dashboard
Hyperlinks to
each rubric
Rubric
completion
percentage
Estimated
time to
address
issues
Notes to help
track
progress and
issues

Analytics
DEMO

Center
for
Online
Teaching
Excellence
(COTE)

Campus and Program Implementation
of the OSCQR Rubric

OSCQR Process
Campuses create and manage their
own OSCQR rubrics.
Rubrics can be customized for
particular programs.
Activity can be tracked and aggregated.
Reviews are conducted on copies of courses
(no student activity).

OSCQR Process
review and refresh on a regular basis. Through the OSCQR Process a
fresh set of eyes or a fresh idea can lead to a better experience for
students and faculty alike.
In the process, courses are reviewed using the OSCQR Rubric, and
viewed from three different perspectives:
•  The online faculty perspective (a review by the course author).
•  The online instructional design perspective (a review by
someone with an online instructional design or faculty
development background).
•  The external reviewer perspective (a review by someone
unfamiliar with the course, preferably a librarian, technologist, or
other faculty member). Incorporated in this are additional
opportunities for specific insights from the librarian and/or
technologist perspectives.
These perspectives combine to provide rich feedback on the design of the
online course and inform a plan to refresh specific design elements, such
Process supports
multiple models and
is flexible.

OSCQR Process
1.  Identify who will be part of the review team
2.  Provide access to the course
3.  Provide access to the OSCQR Rubric
4.  Have the course developer complete the profile
5.  Review the course
6.  Monitor the review progress
7.  Discuss the suggestions proposed by the review team
8.  Create a ‘refresh plan’
9.  Refresh the course
10.  Provide reports on progress
11.  Conduct a ‘Learning Review’ to inform future reviews
The focus remains
on continuous
improvement and is
an iterative process.

•  Mobile Learning
•  Virtual & Alternative labs
•  Short Format Courses
•  Large Enrollment Courses
•  Foreign Language
•  Blended Learning
•  MOOCs
•  Open Education Resources
•  Course Delivery
•  Experiential Learning
Other Ideas? Interest in Collaboration?!
New Standards

Join our community as a “Friend of SUNY”
•  http://bit.ly/friendofsuny - apply!
•  http://bit.ly/cotecommunity - join!
–  http://cotecommunity.open.suny.edu/group/oscqr - usergroup
Connect!

•  https://credly.com/ - Create account
•  DM me for the
Claim Codes:
•  Share them!
Claim your badges!
Friend of SUNY Community Participant

Learn more about OSCQR:
–  http://bit.ly/OSCQRlinks
Get the Rubric:
–  http://bit.ly/oscqrselfassess
Get the Rubric!

Learn more about Open SUNY & COTE
http://bit.ly/allthingscote
–  http://commons.suny.edu/opensuny/faq/
–  http://commons.suny.edu/cote/
–  https://commons.suny.edu/cotehub/
–  http://open.suny.edu/gazette - subscribe
Contact:
–  Alexandra.Pickett@suny.edu - @alexpickett
Thank YOU! Any Questions?

The Open SUNY Course Quality Review Rubric OSCQR

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to The Open SUNY Course Quality Review Rubric OSCQR

Similar to The Open SUNY Course Quality Review Rubric OSCQR (20)

More from Alexandra M. Pickett

More from Alexandra M. Pickett (20)

Recently uploaded

Recently uploaded (20)

The Open SUNY Course Quality Review Rubric OSCQR