1. #658
13:00
Identifying and Overcoming Challenges to
High-Quality Simulation-based Research:
Improving Rigor and Impact
Todd P Chang MD
Marc Auerbach MD MSc
Elizabeth Hunt MD MPH PhD
David Kessler MD MSc
Adam Cheng MD
International Network for Simulation-based Pediatric Innovation, Research and Education

2. Disclosures
• No relevant financial conflicts of interest
• The INSPIRE Network infrastructure has
partial funding from:
International Network for Simulation-based Pediatric Innovation, Research and Education

3. International Network for Simulation-based Pediatric Innovation, Research and Education

4. INSPIRE Network
International Network for Simulation-based Pediatric Innovation, Research and Education

5. INSPIRE Network
International Network for Simulation-based Pediatric Innovation, Research and Education

6. INSPIRE Network
International Network for Simulation-based Pediatric Innovation, Research and Education

7. Objectives
• Evaluate characteristics of a simulation-based
research question or protocol conducive to
quality research & output
• Identify 6 specific challenges in simulation-based
research that threaten rigor and quality of
research output
• Demonstrate differences in problems faced by
single-center vs. multi-center research
International Network for Simulation-based Pediatric Innovation, Research and Education

8. Format
International Network for Simulation-based Pediatric Innovation, Research and Education

9. 90 minutes
5
International Network for Simulation-based Pediatric Innovation, Research and Education

10. 90 minutes
15
5
10
International Network for Simulation-based Pediatric Innovation, Research and Education

11. 90 minutes
30
15
5
10
25
International Network for Simulation-based Pediatric Innovation, Research and Education

12. 90 minutes
30
15
5
5
10
25
International Network for Simulation-based Pediatric Innovation, Research and Education

13. 90 minutes
30
15
5
5
10
25
2 – 4 weeks
International Network for Simulation-based Pediatric Innovation, Research and Education

14. 13:05 Small Group I 13:19
International Network for Simulation-based Pediatric Innovation, Research and Education

15. 13:20 Overview 13:29
International Network for Simulation-based Pediatric Innovation, Research and Education

16. 6 Potential Challenges
1.
2.
3.
4.
5.
6.
Scenario development
Outcome measurements
Sharing and rating videos
IT- and Mobile / Web solutions
Standardizing research protocols
Logistics, budgeting, staffing
International Network for Simulation-based Pediatric Innovation, Research and Education

17. 1. Scenario Development
• Simulator capabilities
• Facility capabilities
• Institutional equipment
• Protocols, medicolegal elements
International Network for Simulation-based Pediatric Innovation, Research and Education

18. 1. Scenario Development
International Network for Simulation-based Pediatric Innovation, Research and Education

19. 2. Outcome Measurements
• Standardization
• Simulator capabilities
• Data capture
• Instrument validity
International Network for Simulation-based Pediatric Innovation, Research and Education

20. 2. Outcome Measurements
International Network for Simulation-based Pediatric Innovation, Research and Education

21. 3. Sharing & rating videos
• Accessibility / Protection
• Videography quality
• Interobserver agreement
International Network for Simulation-based Pediatric Innovation, Research and Education

22. 3. Sharing video & reviews
International Network for Simulation-based Pediatric Innovation, Research and Education

23. 4. IT & Mobile Web
• Accessibility / Protection
• Platforms, Operating systems
• Institutional firewalls, blocked programs
• Firesharing
International Network for Simulation-based Pediatric Innovation, Research and Education

24. 4. IT & Mobile Web
International Network for Simulation-based Pediatric Innovation, Research and Education

25. 5. Standardizing protocols
• Simulator capabilities
• Facility and personnel capabilities
• Clinical standard of care
• Buy-in
International Network for Simulation-based Pediatric Innovation, Research and Education

26. 5. Standardizing protocols
International Network for Simulation-based Pediatric Innovation, Research and Education

27. 6. Logistics
• Research coordinators
• Institutional Review Boards
• Academic credit, Legitimacy of authorship
• Communication, troubleshooting
International Network for Simulation-based Pediatric Innovation, Research and Education

28. Does multicenter solve
everything?
1. Greater ‘n’
2. Reliability, Validity, Generalizability
3. Greater Expert pool
4. Greater Resources
International Network for Simulation-based Pediatric Innovation, Research and Education

29. Brophy RH et al. Multi-investigator collaboration in orthopaedic surgery research compared to other medical fields. J Ortho Res 2012;30(10):1523-8.
International Network for Simulation-based Pediatric Innovation, Research and Education

30. 13:30 Small Group II 13:59
International Network for Simulation-based Pediatric Innovation, Research and Education

31. 14:00 Report Out 14:24
International Network for Simulation-based Pediatric Innovation, Research and Education

32. 14:25 Denouement 14:30
International Network for Simulation-based Pediatric Innovation, Research and Education

33. Thank you
INSPIRESimulationNetwork@gmail.com
http://www.INSPIRESim.com/
International Network for Simulation-based Pediatric Innovation, Research and Education