Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education

Salah A. Aldekhayel, Nahar A. Alselaim, Mohi Eldin Magzoub, Mohammad M. Al-Qattan, Abdullah M. Al-Namlah, Hani Tamim, Abdullah Al-Khayal, Sultan I. Al-Habdan, Mohammed F. Zamakhshary

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)

Abstract

Background: Script Concordance Test (SCT) is a new assessment tool that reliably assesses clinical reasoning skills. Previous descriptions of developing SCT-question banks were merely subjective. This study addresses two gaps in the literature: 1) conducting the first phase of a multistep validation process of SCT in Plastic Surgery, and 2) providing an objective methodology to construct a question bank based on SCT. Methods. After developing a test blueprint, 52 test items were written. Five validation questions were developed and a validation survey was established online. Seven reviewers were asked to answer this survey. They were recruited from two countries, Saudi Arabia and Canada, to improve the test's external validity. Their ratings were transformed into percentages. Analysis was performed to compare reviewers' ratings by looking at correlations, ranges, means, medians, and overall scores. Results: Scores of reviewers' ratings were between 76% and 95% (mean 86% ± 5). We found poor correlations between reviewers (Pearson's: +0.38 to -0.22). Ratings of individual validation questions ranged between 0 and 4 (on a scale 1-5). Means and medians of these ranges were computed for each test item (mean: 0.8 to 2.4; median: 1 to 3). A subset of test items comprising 27 items was generated based on a set of inclusion and exclusion criteria. Conclusion: This study proposes an objective methodology for validation of SCT-question bank. Analysis of validation survey is done from all angles, i.e., reviewers, validation questions, and test items. Finally, a subset of test items is generated based on a set of criteria.

Original languageEnglish
Article number100
JournalBMC medical education
Volume12
Issue number1
DOIs
Publication statusPublished - 2012
Externally publishedYes

Keywords

  • Plastic surgery
  • Question bank
  • Script concordance approach
  • Surgical education

ASJC Scopus subject areas

  • Education

Fingerprint

Dive into the research topics of 'Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education'. Together they form a unique fingerprint.

Cite this