SlideShare uma empresa Scribd logo
1 de 19
Baixar para ler offline
PILOT EVALUATION INSIGHTS
Learning how to do it better
CHARO SADABA
CreBiz O.I.L.
24.Feb.2015
PILOT EVALUATION INSIGHTS
Evaluation as an essential part of the process
Part of the but trying to keep an external view
Team at the Center for Internet Studies and Digital Life (University of
Navarra)
- Prof. Angel Arrese
- Prof. Ramón Salaverría
- Samuel Negredo, Ph.D.
- With the assistance of: Prof. Robert Picard (Oxford University)
Our evaluation includes:
•  Handbook
•  Pilot course
•  Open Innovation Labs (1 general one, 1 more per country)
PILOT EVALUATION INSIGHTS
Evaluating the Pilot Course (WIP)
3 different course structures (from an extended version during three
months to a short and intensive one of 24 hours)
Number of participants: 37-40
Evaluation tools:
•  Pre-pilot survey (students demographics&background,
expectations)
•  Post-course survey (contents, structure, materials, etc)
•  In depth interviews with professors, students and coordinators
•  Observation: we attended the last session of each course (taking
pictures, visiting the facilities, observing dynamics)
Why are you interested in this course?
PILOT EVALUATION INSIGHTS
What do you expect from this course?
PILOT EVALUATION INSIGHTS
Where do you think this kind of subject
should be located?
PILOT EVALUATION INSIGHTS
The course objectives were clear
PILOT EVALUATION INSIGHTS
The workload was easy to manage
PILOT EVALUATION INSIGHTS
“I think I have made progress in this
course”
PILOT EVALUATION INSIGHTS
While learning material has been well
rated as relevant and useful…
PILOT EVALUATION INSIGHTS
Recommended reading books and
documents are not so well considered
PILOT EVALUATION INSIGHTS
“The course stimulated my interest and
thought on the subject area”
PILOT EVALUATION INSIGHTS
•  “It made me think about new and different possibilities
for my life and about the importance of thinking
different nowadays to improve yourself and
career”(ISCTE, best)
•  “It promoted us to think out of the box. The feedback
from the professors was very useful”(Turku, best)
PILOT EVALUATION INSIGHTS
“My expectations have been met”
PILOT EVALUATION INSIGHTS
•  “The people I have met, the people running the course,
the speakers, the introduction to everyone at persuasive
media and the professional involvement and enjoyment
of the whole course pulled together to make an
excellent experience”(UWE, best)
PILOT EVALUATION INSIGHTS
“My entrepreneurial thinking has been
reinforced”
PILOT EVALUATION INSIGHTS
To improve: lack of diversity, more
defined briefings
•  “Join people from different backgrounds/study fields
“ (ISCTE)
•  “More time and involving more departments for varied
ideas”(Turku)
•  “The briefs were interesting, but we would have
progressed more with a focused one”(UWE)
PILOT EVALUATION INSIGHTS
Best
PILOT EVALUATION INSIGHTS
To improve
PILOT EVALUATION INSIGHTS

Mais conteúdo relacionado

Mais procurados

Power point learning and teaching
Power point learning and teachingPower point learning and teaching
Power point learning and teaching
Tom Duff
 

Mais procurados (10)

CPED Business Meeting
CPED Business MeetingCPED Business Meeting
CPED Business Meeting
 
WSU Intern roundup 2016
WSU Intern roundup 2016WSU Intern roundup 2016
WSU Intern roundup 2016
 
Quality Management of Norwegian Higher Education: complexities and visions on...
Quality Management of Norwegian Higher Education: complexities and visions on...Quality Management of Norwegian Higher Education: complexities and visions on...
Quality Management of Norwegian Higher Education: complexities and visions on...
 
Enhancing Librarians’ Research Skills: A Professional Development Program
Enhancing Librarians’ Research Skills: A Professional Development ProgramEnhancing Librarians’ Research Skills: A Professional Development Program
Enhancing Librarians’ Research Skills: A Professional Development Program
 
Power point learning and teaching
Power point learning and teachingPower point learning and teaching
Power point learning and teaching
 
Working with international students as co-researchers: towards an inclusive e...
Working with international students as co-researchers: towards an inclusive e...Working with international students as co-researchers: towards an inclusive e...
Working with international students as co-researchers: towards an inclusive e...
 
Nine Months In: Successes, Shortcomings, and Future Plans for Localness Initi...
Nine Months In: Successes, Shortcomings, and Future Plans for Localness Initi...Nine Months In: Successes, Shortcomings, and Future Plans for Localness Initi...
Nine Months In: Successes, Shortcomings, and Future Plans for Localness Initi...
 
It’s time to ‘Face’ the truth. Is Facebook’s Survey Monkey a legitimate rese...
It’s time to ‘Face’ the truth.  Is Facebook’s Survey Monkey a legitimate rese...It’s time to ‘Face’ the truth.  Is Facebook’s Survey Monkey a legitimate rese...
It’s time to ‘Face’ the truth. Is Facebook’s Survey Monkey a legitimate rese...
 
The Equity and Diversity Committee (EDC) at UW-Madison Libraries: Lessons Lea...
The Equity and Diversity Committee (EDC) at UW-Madison Libraries: Lessons Lea...The Equity and Diversity Committee (EDC) at UW-Madison Libraries: Lessons Lea...
The Equity and Diversity Committee (EDC) at UW-Madison Libraries: Lessons Lea...
 
Presentació o2
Presentació o2Presentació o2
Presentació o2
 

Destaque

Ion exchange chromatography and gec
Ion exchange chromatography and gecIon exchange chromatography and gec
Ion exchange chromatography and gec
ceutics1315
 
Ion exchange chromatography
Ion exchange chromatographyIon exchange chromatography
Ion exchange chromatography
shishirkawde
 

Destaque (9)

Are you sure you are marketable - WikiStage Oran
Are you sure you are marketable - WikiStage OranAre you sure you are marketable - WikiStage Oran
Are you sure you are marketable - WikiStage Oran
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Science
 
Typography1
Typography1Typography1
Typography1
 
Generos
GenerosGeneros
Generos
 
фонетические упражнения
фонетические упражненияфонетические упражнения
фонетические упражнения
 
Chromatography: Analysis of Phosphate and Manganese degradation Products in A...
Chromatography: Analysis of Phosphate and Manganese degradation Products in A...Chromatography: Analysis of Phosphate and Manganese degradation Products in A...
Chromatography: Analysis of Phosphate and Manganese degradation Products in A...
 
Ion exchange chromatography and gec
Ion exchange chromatography and gecIon exchange chromatography and gec
Ion exchange chromatography and gec
 
Ion exchange Chromatography
Ion exchange ChromatographyIon exchange Chromatography
Ion exchange Chromatography
 
Ion exchange chromatography
Ion exchange chromatographyIon exchange chromatography
Ion exchange chromatography
 

Semelhante a CreBiz - Pilot Evaluation Insights

Librarians as researchers: why bother darts3 290612
Librarians as researchers: why bother darts3 290612Librarians as researchers: why bother darts3 290612
Librarians as researchers: why bother darts3 290612
ARLGSW
 
Global Classroom VUC - Phd-Project so far Winter 2013
Global Classroom VUC - Phd-Project so far Winter 2013Global Classroom VUC - Phd-Project so far Winter 2013
Global Classroom VUC - Phd-Project so far Winter 2013
CharlotteLarke
 
Lighthouse @ Anglia Ruskin - Matt East and Rodney Tamblyn | Talis Insight Eur...
Lighthouse @ Anglia Ruskin - Matt East and Rodney Tamblyn | Talis Insight Eur...Lighthouse @ Anglia Ruskin - Matt East and Rodney Tamblyn | Talis Insight Eur...
Lighthouse @ Anglia Ruskin - Matt East and Rodney Tamblyn | Talis Insight Eur...
Talis
 
Computers and Learning Research Group: Research methods in open education: I...
Computers and Learning Research Group: Research methods in open education: I...Computers and Learning Research Group: Research methods in open education: I...
Computers and Learning Research Group: Research methods in open education: I...
Robert Farrow
 
Teaching portfolio
Teaching portfolioTeaching portfolio
Teaching portfolio
riegersy
 
Institutional support & HRS4R: How to involve and engage stakeholders and res...
Institutional support & HRS4R: How to involve and engage stakeholders and res...Institutional support & HRS4R: How to involve and engage stakeholders and res...
Institutional support & HRS4R: How to involve and engage stakeholders and res...
Lana Jerolimov
 
Teaching Showcase Programme2013 for Annual ReportV2
Teaching Showcase Programme2013 for Annual ReportV2Teaching Showcase Programme2013 for Annual ReportV2
Teaching Showcase Programme2013 for Annual ReportV2
Mark McKee
 

Semelhante a CreBiz - Pilot Evaluation Insights (20)

Ku leuven stellenbosch university think tank
Ku leuven  stellenbosch university think tankKu leuven  stellenbosch university think tank
Ku leuven stellenbosch university think tank
 
Supporting research by becoming a researcher- Miggie Pickton,
Supporting research by becoming a researcher- Miggie Pickton,Supporting research by becoming a researcher- Miggie Pickton,
Supporting research by becoming a researcher- Miggie Pickton,
 
Librarians as researchers: why bother darts3 290612
Librarians as researchers: why bother darts3 290612Librarians as researchers: why bother darts3 290612
Librarians as researchers: why bother darts3 290612
 
KU Leuven - Stellenbosch University Think Tank
KU Leuven - Stellenbosch University Think Tank KU Leuven - Stellenbosch University Think Tank
KU Leuven - Stellenbosch University Think Tank
 
Demystifying Teaching and Learning Research process
Demystifying Teaching and Learning Research processDemystifying Teaching and Learning Research process
Demystifying Teaching and Learning Research process
 
Global Classroom VUC - Phd-Project so far Winter 2013
Global Classroom VUC - Phd-Project so far Winter 2013Global Classroom VUC - Phd-Project so far Winter 2013
Global Classroom VUC - Phd-Project so far Winter 2013
 
Lighthouse @ Anglia Ruskin - Matt East and Rodney Tamblyn | Talis Insight Eur...
Lighthouse @ Anglia Ruskin - Matt East and Rodney Tamblyn | Talis Insight Eur...Lighthouse @ Anglia Ruskin - Matt East and Rodney Tamblyn | Talis Insight Eur...
Lighthouse @ Anglia Ruskin - Matt East and Rodney Tamblyn | Talis Insight Eur...
 
1.4 Engaging with student feedback on feedback: A staff-student co-design app...
1.4 Engaging with student feedback on feedback: A staff-student co-design app...1.4 Engaging with student feedback on feedback: A staff-student co-design app...
1.4 Engaging with student feedback on feedback: A staff-student co-design app...
 
CDIs: A team-based approach to designing technology-enriched programmes
CDIs: A team-based approach to designing technology-enriched programmesCDIs: A team-based approach to designing technology-enriched programmes
CDIs: A team-based approach to designing technology-enriched programmes
 
Computers and Learning Research Group: Research methods in open education: I...
Computers and Learning Research Group: Research methods in open education: I...Computers and Learning Research Group: Research methods in open education: I...
Computers and Learning Research Group: Research methods in open education: I...
 
Teaching portfolio
Teaching portfolioTeaching portfolio
Teaching portfolio
 
Critical thinking and e portfolios orna farrell final
Critical thinking and e portfolios orna farrell finalCritical thinking and e portfolios orna farrell final
Critical thinking and e portfolios orna farrell final
 
Research dissemination within and beyond the curriculum
Research dissemination within and beyond the curriculumResearch dissemination within and beyond the curriculum
Research dissemination within and beyond the curriculum
 
Students as Partners: Three Leicester vignettes
Students as Partners: Three Leicester vignettesStudents as Partners: Three Leicester vignettes
Students as Partners: Three Leicester vignettes
 
Institutional support & HRS4R: How to involve and engage stakeholders and res...
Institutional support & HRS4R: How to involve and engage stakeholders and res...Institutional support & HRS4R: How to involve and engage stakeholders and res...
Institutional support & HRS4R: How to involve and engage stakeholders and res...
 
2nd International Conference on Psychology, Language and Teaching (ICPLT)
2nd International Conference on Psychology, Language and Teaching (ICPLT)2nd International Conference on Psychology, Language and Teaching (ICPLT)
2nd International Conference on Psychology, Language and Teaching (ICPLT)
 
Research Day: Arizona State University
Research Day:  Arizona State UniversityResearch Day:  Arizona State University
Research Day: Arizona State University
 
How EDEN Network can Support PhD Students and Research? #edlw2018
How EDEN Network can Support PhD Students and Research? #edlw2018How EDEN Network can Support PhD Students and Research? #edlw2018
How EDEN Network can Support PhD Students and Research? #edlw2018
 
Moocs and how to use them july 2014
Moocs and how to use them   july 2014Moocs and how to use them   july 2014
Moocs and how to use them july 2014
 
Teaching Showcase Programme2013 for Annual ReportV2
Teaching Showcase Programme2013 for Annual ReportV2Teaching Showcase Programme2013 for Annual ReportV2
Teaching Showcase Programme2013 for Annual ReportV2
 

Último

Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
SanaAli374401
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
MateoGardella
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Último (20)

Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 

CreBiz - Pilot Evaluation Insights

  • 1. PILOT EVALUATION INSIGHTS Learning how to do it better CHARO SADABA CreBiz O.I.L. 24.Feb.2015
  • 2. PILOT EVALUATION INSIGHTS Evaluation as an essential part of the process Part of the but trying to keep an external view Team at the Center for Internet Studies and Digital Life (University of Navarra) - Prof. Angel Arrese - Prof. Ramón Salaverría - Samuel Negredo, Ph.D. - With the assistance of: Prof. Robert Picard (Oxford University) Our evaluation includes: •  Handbook •  Pilot course •  Open Innovation Labs (1 general one, 1 more per country)
  • 3. PILOT EVALUATION INSIGHTS Evaluating the Pilot Course (WIP) 3 different course structures (from an extended version during three months to a short and intensive one of 24 hours) Number of participants: 37-40 Evaluation tools: •  Pre-pilot survey (students demographics&background, expectations) •  Post-course survey (contents, structure, materials, etc) •  In depth interviews with professors, students and coordinators •  Observation: we attended the last session of each course (taking pictures, visiting the facilities, observing dynamics)
  • 4. Why are you interested in this course? PILOT EVALUATION INSIGHTS
  • 5. What do you expect from this course? PILOT EVALUATION INSIGHTS
  • 6. Where do you think this kind of subject should be located? PILOT EVALUATION INSIGHTS
  • 7. The course objectives were clear PILOT EVALUATION INSIGHTS
  • 8. The workload was easy to manage PILOT EVALUATION INSIGHTS
  • 9. “I think I have made progress in this course” PILOT EVALUATION INSIGHTS
  • 10. While learning material has been well rated as relevant and useful… PILOT EVALUATION INSIGHTS
  • 11. Recommended reading books and documents are not so well considered PILOT EVALUATION INSIGHTS
  • 12. “The course stimulated my interest and thought on the subject area” PILOT EVALUATION INSIGHTS
  • 13. •  “It made me think about new and different possibilities for my life and about the importance of thinking different nowadays to improve yourself and career”(ISCTE, best) •  “It promoted us to think out of the box. The feedback from the professors was very useful”(Turku, best) PILOT EVALUATION INSIGHTS
  • 14. “My expectations have been met” PILOT EVALUATION INSIGHTS
  • 15. •  “The people I have met, the people running the course, the speakers, the introduction to everyone at persuasive media and the professional involvement and enjoyment of the whole course pulled together to make an excellent experience”(UWE, best) PILOT EVALUATION INSIGHTS
  • 16. “My entrepreneurial thinking has been reinforced” PILOT EVALUATION INSIGHTS
  • 17. To improve: lack of diversity, more defined briefings •  “Join people from different backgrounds/study fields “ (ISCTE) •  “More time and involving more departments for varied ideas”(Turku) •  “The briefs were interesting, but we would have progressed more with a focused one”(UWE) PILOT EVALUATION INSIGHTS