SlideShare uma empresa Scribd logo
1 de 24
101 Townsend Street, Suite 282 San Francisco, CA 94107 www.excelmeetings.com
Results Based Meetings   Three Steps of Evaluation That Will  Clearly Demonstrate the Value of  Your Conference, Sales Meeting or  Annual Scientific Meeting Presentation by  Jon Wollenhaupt, VP, Excel Meetings & Events  www.excelmeetings.com Processes outlined in this presentation are based on the ROI Methodology developed by Jack Philips, PhD, Chairman, The ROI Institute
Definition of Results Based Meetings ,[object Object],[object Object],[object Object],[object Object],[object Object]
Paradigm Shift in Meetings and Events Results and expectations communicated to participants  No effort to prepare meeting participants to achieve results  Specific objectives for behavior  and business impact  No specific measurable  objectives  Assessment of performance effectiveness  No assessment of  performance issues  Program linked to specific  business needs  No clearly defined business need  for the meeting  Results Based Activity Based
Paradigm Shift in Meetings and Events Reporting on meetings  is output focused  Reporting on meetings  is input focused  Measurement of results and benefit-cost analysis (ROI)  No measurement of results or benefit-cost analysis  Partnerships established with  key managers and clients  No efforts to build partnerships with key managers  Environment prepared to  support meeting  No effort to prepare the work environment to support meeting  Results Based Activity Based
Evaluation Levels   Level   Measurement Focus 1. Reaction & Measures participant reaction to the Perceived  meeting and captures perceived value. Value 2. Learning Measures changes in knowledge,  information, skills, and attitudes  gained in the meeting. 3. Application & Measures changes in on-the-job Implementation behavior and progress with planned  actions.
Chain of Impact From Meetings & Events ,[object Object],[object Object],[object Object],[object Object],[object Object]
Levels of Assessment   ,[object Object],[object Object],[object Object],[object Object],[object Object],Level 1 Reaction and Perceived Value ,[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],Levels of Assessment   Level 2   Learning ,[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],Levels of Assessment   Level 3  Application and Implementation ,[object Object],[object Object],[object Object],[object Object],[object Object]
The ROI Methodology Develop  Evaluation Plans and Baseline Data Evaluation Planning Data Collection Via Questionnaire Collect Data During Meeting Level 1: REACTION AND PERCIEVED VALUE LEVEL 2: LEARNING Collect Data After Meeting LEVEL 3:   APPLICATION AND IMPLEMENTATION OPTIONAL LEVEL 4: IMPACT AND CONSEQUENCES Develop  Objectives  of Meeting
Plan Meetings with Evaluation in Mind ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Plan Meetings with Evaluation in Mind ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Project Example:  Development of Measurable  Learning Objectives and  Post Event Questionnaire for an Annual Scientific Meeting
Overview: Excel Meetings & Events  was under contract with a San Francisco Bay Area Pharmaceutical Company to assist in the development of measurable learning objectives for an annual scientific meeting and in the design of a post meeting questionnaire. This meeting brought together research scientist from three separate company facilities located in Silicon Valley, Alabama and India.
Overview: General desired outcomes for the meeting were stated as follows:  Energized participants - Key scientists and engineers from all research sites will have an opportunity to interact, discuss science, think about the future, get to know each other and establish alliances that will enable success.
Stated Measurable Learning Objectives After the annual scientific meeting, research scientist  will be able to:  •  Explain the process for implementing new research • Name three new colleagues you met with whom    you can collaborate on your research •  List three reasons you agree with the research    funding for 2008 • List the three most significant things you learned in    the poster session •  Identify at least one science or technology the    company should acquire or develop
Stated Measurable Learning Objectives After the annual scientific meeting, research scientist  will be able to:  •  Explain the process for implementing new research •  Name three new colleagues you met with whom    you can collaborate on your research •  List three reasons you agree with the research    funding for 2008 •  List the three most significant things you learned in    the poster session •  Identify at least one science or technology the    company should acquire or develop
[object Object],[object Object],[object Object],[object Object],[object Object]
Questionnaire Development  Sample questions included:  2) Identify two or three things you learned about future research ideas in the poster session. (open-ended) 3) Identify three major accomplishments attained in 2008 that you learned about in the poster session. (open-ended) 4) List the three reasons why you agree with the research funding for this year as discussed. (open-ended)
Questionnaire Development  Sample questions included:  5) Name three new colleagues you met at this year’s Research Summit , and list at least one way you will collaborate with each on your research in the coming year. (open-ended)  6) What I learned from the presentations I will be able to use in my work and with all colleagues when I return to work. Please circle a number that best reflects your response. 5 = Strongly Agree,  4 = Agree,  3 = Neutral,  2 = Disagree,  1 = Strongly Disagree
“ Excel Meetings & Events worked with our internal meeting planning resources and provided guidance, tools, and ideas. Their contributions enhanced the quality of our annual scientific meeting and set up the foundation for continuous improvement.” –  CARLOS SCHULER SENIOR DIRECTOR OF SCIENCE & TECHNOLOGY
Alliance Partner Profile ,[object Object]
[object Object],[object Object],[object Object],[object Object],Alliance Partner Profile

Mais conteúdo relacionado

Mais procurados

2nd Partnership Inception Workshop_Presentation 4: Project proposal
2nd Partnership Inception Workshop_Presentation 4: Project proposal2nd Partnership Inception Workshop_Presentation 4: Project proposal
2nd Partnership Inception Workshop_Presentation 4: Project proposalNawsheen Hosenally
 
Writing Successful Project Proposal
Writing Successful Project ProposalWriting Successful Project Proposal
Writing Successful Project ProposalGhulam Qadir
 
3 proj plan notes
3 proj plan notes3 proj plan notes
3 proj plan notesTony
 
Building Capacity to Measure, Analyze and Evaluate Government Performance
Building Capacity to Measure, Analyze and Evaluate Government PerformanceBuilding Capacity to Measure, Analyze and Evaluate Government Performance
Building Capacity to Measure, Analyze and Evaluate Government PerformanceWashington Evaluators
 
Logic Models For Grant Writing
Logic Models For Grant WritingLogic Models For Grant Writing
Logic Models For Grant WritingDierdre McKee
 
Introduction to project evaluations for SLOGA / Trialog
Introduction to project evaluations for SLOGA / TrialogIntroduction to project evaluations for SLOGA / Trialog
Introduction to project evaluations for SLOGA / TrialogInka Pibilova
 
The Ultimate Personal Project Guide
The Ultimate Personal Project GuideThe Ultimate Personal Project Guide
The Ultimate Personal Project GuideMirjam Berghuis
 
Writing and Presenting a Project Proposal by Andile Andries Ndlovu
Writing and Presenting  a Project Proposal by Andile Andries NdlovuWriting and Presenting  a Project Proposal by Andile Andries Ndlovu
Writing and Presenting a Project Proposal by Andile Andries NdlovuAndile Andries Ndlovu
 
Proposal writing sample 2
Proposal writing sample 2Proposal writing sample 2
Proposal writing sample 2Momy Saikia
 
Performance Management - Herman Augnis
Performance Management - Herman Augnis Performance Management - Herman Augnis
Performance Management - Herman Augnis Preeti Bhaskar
 
Logic model templates_and_howto
Logic model templates_and_howtoLogic model templates_and_howto
Logic model templates_and_howtoCarrie Grote
 
Ssrm assignment-b-2021-22
Ssrm assignment-b-2021-22Ssrm assignment-b-2021-22
Ssrm assignment-b-2021-22AdamsOdanji
 
Black, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomesBlack, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomeseaquals
 
Collaborative work 2 Part 1
Collaborative work 2 Part 1Collaborative work 2 Part 1
Collaborative work 2 Part 1Fc2017
 

Mais procurados (20)

2nd Partnership Inception Workshop_Presentation 4: Project proposal
2nd Partnership Inception Workshop_Presentation 4: Project proposal2nd Partnership Inception Workshop_Presentation 4: Project proposal
2nd Partnership Inception Workshop_Presentation 4: Project proposal
 
Lecture 2
Lecture 2Lecture 2
Lecture 2
 
Writing Successful Project Proposal
Writing Successful Project ProposalWriting Successful Project Proposal
Writing Successful Project Proposal
 
3 proj plan notes
3 proj plan notes3 proj plan notes
3 proj plan notes
 
Building Capacity to Measure, Analyze and Evaluate Government Performance
Building Capacity to Measure, Analyze and Evaluate Government PerformanceBuilding Capacity to Measure, Analyze and Evaluate Government Performance
Building Capacity to Measure, Analyze and Evaluate Government Performance
 
Logic Models For Grant Writing
Logic Models For Grant WritingLogic Models For Grant Writing
Logic Models For Grant Writing
 
Introduction to project evaluations for SLOGA / Trialog
Introduction to project evaluations for SLOGA / TrialogIntroduction to project evaluations for SLOGA / Trialog
Introduction to project evaluations for SLOGA / Trialog
 
Proposal Writing Basics10.08
Proposal Writing Basics10.08Proposal Writing Basics10.08
Proposal Writing Basics10.08
 
The Ultimate Personal Project Guide
The Ultimate Personal Project GuideThe Ultimate Personal Project Guide
The Ultimate Personal Project Guide
 
Writing a Successful Project Proposal by Kathleen Dowd-Gailey
Writing a Successful Project Proposal by Kathleen Dowd-GaileyWriting a Successful Project Proposal by Kathleen Dowd-Gailey
Writing a Successful Project Proposal by Kathleen Dowd-Gailey
 
Proposal writing
Proposal writingProposal writing
Proposal writing
 
Proposal
ProposalProposal
Proposal
 
Writing and Presenting a Project Proposal by Andile Andries Ndlovu
Writing and Presenting  a Project Proposal by Andile Andries NdlovuWriting and Presenting  a Project Proposal by Andile Andries Ndlovu
Writing and Presenting a Project Proposal by Andile Andries Ndlovu
 
Proposal writing sample 2
Proposal writing sample 2Proposal writing sample 2
Proposal writing sample 2
 
Performance Management - Herman Augnis
Performance Management - Herman Augnis Performance Management - Herman Augnis
Performance Management - Herman Augnis
 
Logic model templates_and_howto
Logic model templates_and_howtoLogic model templates_and_howto
Logic model templates_and_howto
 
Ssrm assignment-b-2021-22
Ssrm assignment-b-2021-22Ssrm assignment-b-2021-22
Ssrm assignment-b-2021-22
 
Walking Through Your Project Proposal
Walking Through Your Project ProposalWalking Through Your Project Proposal
Walking Through Your Project Proposal
 
Black, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomesBlack, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomes
 
Collaborative work 2 Part 1
Collaborative work 2 Part 1Collaborative work 2 Part 1
Collaborative work 2 Part 1
 

Semelhante a Measurable Learning Objectives and Post-Event Questionnaire

Success Beyond a Test: The Importance of Application in Performance Improvement
Success Beyond a Test: The Importance of Application in Performance ImprovementSuccess Beyond a Test: The Importance of Application in Performance Improvement
Success Beyond a Test: The Importance of Application in Performance ImprovementBizLibrary
 
Return On Investment Training And Development
Return On Investment   Training And DevelopmentReturn On Investment   Training And Development
Return On Investment Training And DevelopmentAhmed Zeen EL Abeden
 
Training Needs Analysis
Training Needs AnalysisTraining Needs Analysis
Training Needs Analysissany26
 
Measuring Nonprofit Outcomes
Measuring Nonprofit OutcomesMeasuring Nonprofit Outcomes
Measuring Nonprofit OutcomesTrina Willard
 
Performance Improvement Culture
Performance Improvement CulturePerformance Improvement Culture
Performance Improvement CultureAnand Subramaniam
 
RBL Omnia, a world-class offering
RBL Omnia, a world-class offeringRBL Omnia, a world-class offering
RBL Omnia, a world-class offeringThe RBL Group
 
RBL Omnia - Detailed Deck
RBL Omnia - Detailed DeckRBL Omnia - Detailed Deck
RBL Omnia - Detailed DeckThe RBL Group
 
Training needs analysis, skills auditing and training
Training needs analysis, skills auditing and trainingTraining needs analysis, skills auditing and training
Training needs analysis, skills auditing and trainingCharles Cotter, PhD
 
MEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNED
MEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNEDMEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNED
MEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNEDHuman Capital Media
 
RBL Omnia, a world-class offering
RBL Omnia, a world-class offeringRBL Omnia, a world-class offering
RBL Omnia, a world-class offeringThe RBL Group
 
MPA 212 Lec Training and Development.pdf
MPA 212 Lec Training and Development.pdfMPA 212 Lec Training and Development.pdf
MPA 212 Lec Training and Development.pdfJo Balucanag - Bitonio
 
Business Learning Strategy
Business Learning StrategyBusiness Learning Strategy
Business Learning StrategyNick DeNardo
 
Benchmarking For Best Practice
Benchmarking For Best PracticeBenchmarking For Best Practice
Benchmarking For Best PracticeMichael Barger
 
Learning focused Evaluation
Learning focused EvaluationLearning focused Evaluation
Learning focused EvaluationMichele Garvey
 
Project management for instructional designers
Project management for instructional designersProject management for instructional designers
Project management for instructional designersKimberly Kaye
 
The Art of Program Development
The Art of Program DevelopmentThe Art of Program Development
The Art of Program Developmentmikespezzano
 

Semelhante a Measurable Learning Objectives and Post-Event Questionnaire (20)

2009 Motivation Show - To Meet or Not To Meet
2009 Motivation Show - To Meet or Not To Meet2009 Motivation Show - To Meet or Not To Meet
2009 Motivation Show - To Meet or Not To Meet
 
Staff appraisal training
Staff appraisal trainingStaff appraisal training
Staff appraisal training
 
06 Om At Training W Kshop Org Practices & Monitoring
06 Om At Training W Kshop   Org Practices & Monitoring06 Om At Training W Kshop   Org Practices & Monitoring
06 Om At Training W Kshop Org Practices & Monitoring
 
Success Beyond a Test: The Importance of Application in Performance Improvement
Success Beyond a Test: The Importance of Application in Performance ImprovementSuccess Beyond a Test: The Importance of Application in Performance Improvement
Success Beyond a Test: The Importance of Application in Performance Improvement
 
Return On Investment Training And Development
Return On Investment   Training And DevelopmentReturn On Investment   Training And Development
Return On Investment Training And Development
 
Training Needs Analysis
Training Needs AnalysisTraining Needs Analysis
Training Needs Analysis
 
ICSA Competency Framework presentation for Guernsey branch - 26 February 2019
ICSA Competency Framework presentation for Guernsey branch - 26 February 2019ICSA Competency Framework presentation for Guernsey branch - 26 February 2019
ICSA Competency Framework presentation for Guernsey branch - 26 February 2019
 
Measuring Nonprofit Outcomes
Measuring Nonprofit OutcomesMeasuring Nonprofit Outcomes
Measuring Nonprofit Outcomes
 
Performance Improvement Culture
Performance Improvement CulturePerformance Improvement Culture
Performance Improvement Culture
 
RBL Omnia, a world-class offering
RBL Omnia, a world-class offeringRBL Omnia, a world-class offering
RBL Omnia, a world-class offering
 
RBL Omnia - Detailed Deck
RBL Omnia - Detailed DeckRBL Omnia - Detailed Deck
RBL Omnia - Detailed Deck
 
Training needs analysis, skills auditing and training
Training needs analysis, skills auditing and trainingTraining needs analysis, skills auditing and training
Training needs analysis, skills auditing and training
 
MEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNED
MEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNEDMEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNED
MEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNED
 
RBL Omnia, a world-class offering
RBL Omnia, a world-class offeringRBL Omnia, a world-class offering
RBL Omnia, a world-class offering
 
MPA 212 Lec Training and Development.pdf
MPA 212 Lec Training and Development.pdfMPA 212 Lec Training and Development.pdf
MPA 212 Lec Training and Development.pdf
 
Business Learning Strategy
Business Learning StrategyBusiness Learning Strategy
Business Learning Strategy
 
Benchmarking For Best Practice
Benchmarking For Best PracticeBenchmarking For Best Practice
Benchmarking For Best Practice
 
Learning focused Evaluation
Learning focused EvaluationLearning focused Evaluation
Learning focused Evaluation
 
Project management for instructional designers
Project management for instructional designersProject management for instructional designers
Project management for instructional designers
 
The Art of Program Development
The Art of Program DevelopmentThe Art of Program Development
The Art of Program Development
 

Measurable Learning Objectives and Post-Event Questionnaire

  • 1. 101 Townsend Street, Suite 282 San Francisco, CA 94107 www.excelmeetings.com
  • 2. Results Based Meetings Three Steps of Evaluation That Will Clearly Demonstrate the Value of Your Conference, Sales Meeting or Annual Scientific Meeting Presentation by Jon Wollenhaupt, VP, Excel Meetings & Events www.excelmeetings.com Processes outlined in this presentation are based on the ROI Methodology developed by Jack Philips, PhD, Chairman, The ROI Institute
  • 3.
  • 4. Paradigm Shift in Meetings and Events Results and expectations communicated to participants No effort to prepare meeting participants to achieve results Specific objectives for behavior and business impact No specific measurable objectives Assessment of performance effectiveness No assessment of performance issues Program linked to specific business needs No clearly defined business need for the meeting Results Based Activity Based
  • 5. Paradigm Shift in Meetings and Events Reporting on meetings is output focused Reporting on meetings is input focused Measurement of results and benefit-cost analysis (ROI) No measurement of results or benefit-cost analysis Partnerships established with key managers and clients No efforts to build partnerships with key managers Environment prepared to support meeting No effort to prepare the work environment to support meeting Results Based Activity Based
  • 6. Evaluation Levels Level Measurement Focus 1. Reaction & Measures participant reaction to the Perceived meeting and captures perceived value. Value 2. Learning Measures changes in knowledge, information, skills, and attitudes gained in the meeting. 3. Application & Measures changes in on-the-job Implementation behavior and progress with planned actions.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11. The ROI Methodology Develop Evaluation Plans and Baseline Data Evaluation Planning Data Collection Via Questionnaire Collect Data During Meeting Level 1: REACTION AND PERCIEVED VALUE LEVEL 2: LEARNING Collect Data After Meeting LEVEL 3: APPLICATION AND IMPLEMENTATION OPTIONAL LEVEL 4: IMPACT AND CONSEQUENCES Develop Objectives of Meeting
  • 12.
  • 13.
  • 14. Project Example: Development of Measurable Learning Objectives and Post Event Questionnaire for an Annual Scientific Meeting
  • 15. Overview: Excel Meetings & Events was under contract with a San Francisco Bay Area Pharmaceutical Company to assist in the development of measurable learning objectives for an annual scientific meeting and in the design of a post meeting questionnaire. This meeting brought together research scientist from three separate company facilities located in Silicon Valley, Alabama and India.
  • 16. Overview: General desired outcomes for the meeting were stated as follows: Energized participants - Key scientists and engineers from all research sites will have an opportunity to interact, discuss science, think about the future, get to know each other and establish alliances that will enable success.
  • 17. Stated Measurable Learning Objectives After the annual scientific meeting, research scientist will be able to: • Explain the process for implementing new research • Name three new colleagues you met with whom you can collaborate on your research • List three reasons you agree with the research funding for 2008 • List the three most significant things you learned in the poster session • Identify at least one science or technology the company should acquire or develop
  • 18. Stated Measurable Learning Objectives After the annual scientific meeting, research scientist will be able to: • Explain the process for implementing new research • Name three new colleagues you met with whom you can collaborate on your research • List three reasons you agree with the research funding for 2008 • List the three most significant things you learned in the poster session • Identify at least one science or technology the company should acquire or develop
  • 19.
  • 20. Questionnaire Development Sample questions included: 2) Identify two or three things you learned about future research ideas in the poster session. (open-ended) 3) Identify three major accomplishments attained in 2008 that you learned about in the poster session. (open-ended) 4) List the three reasons why you agree with the research funding for this year as discussed. (open-ended)
  • 21. Questionnaire Development Sample questions included: 5) Name three new colleagues you met at this year’s Research Summit , and list at least one way you will collaborate with each on your research in the coming year. (open-ended) 6) What I learned from the presentations I will be able to use in my work and with all colleagues when I return to work. Please circle a number that best reflects your response. 5 = Strongly Agree, 4 = Agree, 3 = Neutral, 2 = Disagree, 1 = Strongly Disagree
  • 22. “ Excel Meetings & Events worked with our internal meeting planning resources and provided guidance, tools, and ideas. Their contributions enhanced the quality of our annual scientific meeting and set up the foundation for continuous improvement.” – CARLOS SCHULER SENIOR DIRECTOR OF SCIENCE & TECHNOLOGY
  • 23.
  • 24.