The Revised METRIQ Score: A Quality Evaluation Tool for Online Educational Resources.

Published on Oct 1, 2019
· DOI :10.1002/AET2.10376
Isabelle N. Colmers‐Gray4
Estimated H-index: 4
(U of A: University of Alberta),
Keeth Krishnan4
Estimated H-index: 4
(McMaster University)
+ 5 AuthorsBrent Thoma18
Estimated H-index: 18
(U of S: University of Saskatchewan)
Background: With the rapid proliferation of online medical education resources, quality evaluation is increasingly critical. The Medical Education Translational Resources: Impact and Quality (METRIQ) study evaluated the METRIQ-8 quality assessment instrument for blogs and collected feedback to improve it. Methods: As part of the larger METRIQ study, participants rated the quality of five blog posts on clinical emergency medicine topics using the eight-item METRIQ-8 score. Next, participants used a 7-point Likert scale and free-text comments to evaluate the METRIQ-8 score on ease of use, clarity of items, and likelihood of recommending it to others. Descriptive statistics were calculated and comments were thematically analyzed to guide the development of a revised METRIQ (rMETRIQ) score. Results: A total of 309 emergency medicine attendings, residents, and medical students completed the survey. The majority of participants felt the METRIQ-8 score was easy to use (mean ± SD = 2.7 ± 1.1 out of 7, with 1 indicating strong agreement) and would recommend it to others (2.7 ± 1.3 out of 7, with 1 indicating strong agreement). The thematic analysis suggested clarifying ambiguous questions, shortening the 7-point scale, specifying scoring anchors for the questions, eliminating the "unsure" option, and grouping-related questions. This analysis guided changes that resulted in the rMETRIQ score. Conclusion: Feedback on the METRIQ-8 score contributed to the development of the rMETRIQ score, which has improved clarity and usability. Further validity evidence on the rMETRIQ score is required.
  • References (18)
  • Citations (4)
📖 Papers frequently viewed together
1 Citations
13 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
Cited By4
#1Jason M. Woods (University of Colorado Denver)
#2Teresa M. Chan (McMaster University)H-Index: 19
Last. Brent Thoma (U of S: University of Saskatchewan)H-Index: 18
view all 6 authors...
INTRODUCTION Podcasts are increasingly being used for medical education. Studies have found that the assessment of the quality of online resources can be challenging. We sought to determine the reliability of gestalt quality assessment of education podcasts in emergency medicine. METHODS An international, interprofessional sample of raters was recruited through social media, direct contact, and the extended personal network of the study team. Each participant listened to eight podcasts (selected...
#1Daniel K. Ting (UBC: University of British Columbia)
#2Patrick E. Boreskie (UM: University of Manitoba)H-Index: 1
Last. Teresa M. ChanH-Index: 19
view all 6 authors...
Summary: Free open access medical education (FOAM) has disrupted traditional modes of knowledge translation and dissemination. These are popular resources with a wide educational reach. Nephrology has been a leader in FOAM, but many skeptics still question the accuracy and reliability of this content. Recently, quality-assurance techniques have been developed to address these concerns. These techniques may be helpful for readers to appraise the online literature and for institutions to reward th...
#1Michael Gottlieb (Rush University Medical Center)H-Index: 10
#2Adaira Landry (Brigham and Women's Hospital)H-Index: 1
Last. Megan L. Fix (UofU: University of Utah)H-Index: 7
view all 7 authors...
Abstract The COVID-19 pandemic requires a substantial change to the traditional approach to conference didactics. Switching to a virtual medium for conference sessions presents several challenges, particularly with regard to aspects that rely heavily upon in-person components (e.g., simulation, ultrasound). This paper will discuss the challenges and strategies to address them for conference planning in the era of COVID-19.
#1Justin Berk (Brown University)H-Index: 3
#1Justin Berk (Brown University)
Last. Robert M. Centor (UAB: University of Alabama at Birmingham)H-Index: 39
view all 5 authors...
Social media, particularly podcasts, has become an influential modality within informal medical education. As podcasts continue to become more prevalent among learners of all types, clinical educators of the future must be able to help navigate this new pedagogy. Preliminary data demonstrates that medical students, residents, post-training physicians, and advanced practitioners all utilize podcasts for their own benefit. New data is discussed in the setting of the current literature on podcastin...
3 CitationsSource