Presentation on Assessing and Evaluating Your Tech Initiative at PETE&C 2015. Presentation designed and delivered by Randy Ziegenfuss (@ziegeran) and Lynn Fuini-Hetten (@lfuinihetten)
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
PETE&C 2015 assessing & evaluating your tech initiative
1. Assessing & Evaluating
your
Tech Initiative
Randy Ziegenfuss, Ed.D.
@ziegeran
Lynn Fuini-Hetten
@lfuinihetten
Salisbury Township School District
Allentown, PA
http://bit.ly/peteandc15
5. ● Measure progress toward meeting project goals
● Support action planning with data
● Provide greater community evidence of success
● Share evidence and examples of what works (and what doesn’t)
with the greater educational community
● Build a culture and community of data-informed decisions
● Organize stakeholders around the goals of
the project
● Determine if the financial investment is
“paying off”
● Understand how and where teaching and
learning is evolving
from Bebel (2014)
6.
7. ● Increase productivity and streamline record keeping
● Increase opportunities to practice 21st century skills
● Create equity
● Improve teaching and learning practices
● Raise student test scores
● Provide wider access to materials and
resources
● Increase student engagement
● Lower dropout rates
from Bebel (2014)
8. The TL2014 initiative accelerates the process of providing our students with the
knowledge and skills necessary for post-secondary success – the workforce or higher
education – in the 21st century. TL2014has as its stated goals:
● Increased learning opportunities for the development of critical 21st century
skills: critical thinking and problem solving, effective oral and written
communication, collaboration, creativity and curiosity, adaptability,
organization, initiative and entrepreneurialism.
● Increased opportunities for student engagement in a dynamic, technology-
rich learning environment.
● Increased opportunities for project-based and challenge-based learning,
mirroring real-world work force and higher education environments.
● Increased opportunities for differentiation and individualized instruction
through the use of technology.
9. The TL2020 initiative accelerates the process of providing our students with the
knowledge and skills necessary for post-secondary success – the workforce or higher
education – in the 21st century. TL2020 has as its stated goals:
● Transformed teaching and learning, guided by the SAMR framework as
measured by classroom walkthroughs, observations, surveys and other
sources.
● Increased occurrences of higher level thinking, guided by Webb’s Depths of
Knowledge (DOK) as measured by classroom walkthroughs, observations,
surveys and other sources.
● Increased opportunities for all students to benefit from online and blended
learning opportunities in all content areas including courses/content
developed by Salisbury staff.
● Increased opportunities for all students to develop and practice literacies that
10.
11.
12. ● Observational tools, rubrics and
walkthroughs
● Surveys
● Drawings
● Journaling
● Focus groups
● Interviews
● Assessment and skill tests
● Student records
● Commercial tools
○ Bright Bytes - Clarity Survey
○ Apple Educational Technology
Profile
○ Apple Educational Leadership Profile
Connect emotionally with our personal story:
Probably like you, we developed this grand vision for learning in our school district - describe.
To achieve this vision, all learners needed access to a computing device. How to do this?
Once access looked like a reality, we asked the question - How do we know if the program has been effective? How do we demonstrate change to our stakeholders
What have other schools done? Other than university-sponsored research on 1:1 programs, we found very little. Virtually no schools were assessing/evaluating their implementations, at least not publicly.
So we set up a cyclical framework to provide us with regular feedback from teachers, students and parents - 1x each semester - formative and summative
What are the goals of the initiative?
Who is the audience?
What data will you collect relevant to the goals of the initiative?
How will you analyze the data?
How will you share the results?
What’s next?
Provide some demographic information:
Small district (1600 students)
$32M annual budget (3% technology - including personnel)
29% free/reduced
Provide the brief story of the initiative:
2011 - 1st year of 1:1 in grades 6-12
TL2014 - resources available at TL2014.org
2014 - 4th year of 1:1 in grades 6-12; 1st year of 1:1 in grades K-5
TL2020 - resources available at TL2020.org
Macbook device; iPad device
Constant data gathering - formative (to inform the program) and summative (to demonstrate progress toward the goals of the program)
Benefits of undertaking an assessment/evaluation project...
What are the general goals and outcomes that are important to you and your community?
Why are you implementing your tech initiative?
Can the goals/outcomes be turned into 1 or more specific research/evaluation questions?
Community - school board, teachers, parents, taxpayers, etc.
Wider educational community - locally, nationally, educational researchers
Formative vs. Summative: Does your audience need/want formative data to make adjustments in implementation? Or does your audience need/want data to provide evidence of impact at a particular end period?
Will you find or build data collection tools?
What tools will provide you with the kind of data you need to determine success toward your goals? The goals should drive the research
Explain components of each tool and how the tools connects to the goals and what we were/are looking for.
Who will analyze the data? Should not be a solitary effort.
What evidence shows you’ve met your goals?
What are you looking for in your data?
What is important to your constituents when you share out?
Remember who your audience is…
teachers (faculty meetings)
school board
public (post online)
Ongoing Research Initiative
Joining Apple Cohort to determine our next steps
Developing research project with admin team collaboratively this summer
Only a couple doing research TL2014 - more ownership