Script concordance test as a sanctionnal evaluation in cardiology

##plugins.themes.academic_pro.article.sidebar##

Published Sep 7, 2018
Download
pdf
Vol. 96 No. 6 (2018): Issue Jun 2018

##plugins.themes.academic_pro.article.main##

Khadija Mzoughi
Ihsen Zairi
Mohamed Ali Kedous
Sana El Mhamdi
mohamed ben dhiab
Fethia Mghaieth
Sondos Kraiem

Abstract

Introduction: Sanctioning evaluation in cardiology is carried out using multiple choice questions, short-answer questions, clinical cases and editorial questions. However, these methods do not assess clinical reasoning in a context of uncertainty in contrast with  script concordance tests (SCT).
Objective: The aim of our study was to compare the scores obtained by the students in the 3rd year of medicine with the SCT versus the sanctioning test of cardiology and to study the correlation between these two evaluation methods.
Methods: This is a prospective study including 31 3rd year students who completed their cardiology clerckship in the Cardiology Department of the HabibThameur Hospital during the first half of 2016.
We compared the scores obtained in the 13 SCT test (39 items) with those of the cardiology normative test.
Results:  Students ‘mean score at SCT was significantly lower than that of experts (66.6 ± 10.2 vs 86 ± 6.7%, p <0.0001).
The mean score obtained by students at the SCT was significantly higher than that of the cardiology sanctioning test (p <0.001).
Cronbach alpha coefficient  was 0.71.
There was no correlation between the two tests (r = 0.329; p= 0.07).

Conclusion:
The evaluation of our students by the SCT showed mean score statistically higher than the questions of a classic test, without correlation between them. This should encourage us to incorporate SCT into our assessment methods to promote clinical reasoning.

Keywords:

Script concordance test, Evaluation, Competence, Reasoning, cardiology.

##plugins.themes.academic_pro.article.details##

References

  1. Présentation - Centre de pédagogie appliquée aux sciences de la santé (CPASS) - Faculté de Médecine - Université de Montréal [Internet]. [cité 4 sept 2017]. Disponible sur: https://www.cpass.umontreal.ca/recherche/concordance/tcs/presentation_tcs/ http://www.cpass.umontreal.ca/tcs.html
  2. Bordage G. Elaborated knowledge: a key to successful diagnostic thinking. Acad Med J Assoc Am Med Coll. 1994;69(11):883‑5.
  3. Charlin B, Desaulniers M, Gagnon R, Blouin D, van der Vleuten C. Comparison of an aggregate scoring method with a consensus scoring method in a measure of clinical reasoning capacity. TeachLearn Med. 2002;14(3):150‑6.
  4. Charlin B. Standardized Assessment of Reasoning in Contexts of Uncertainty: The Script Concordance Approach. Eval Health Prof.2004;27(3):304‑19.
  5. Charlin B, Kazi-Tani D, Gagnon R, Thivierge R. Le test de concordance comme outil d'évaluation en ligne du raisonnement des professionnels en situation d'incertitude. Rev Int Technol. 2005;2(2):22‑7.
  6. Charlin B, Roy L, Brailovsky C, Goulet F, Van der Vleuten C. The Script Concordance test: a tool to assess the reflective clinician. Teach Learn Med. 2000;12(4):189‑95.
  7. Sibert L, Charlin B, Gagnon R, Corcos J, Khalaf A, Grise P. Évaluation du raisonnement clinique en urologie: l'apport du test de concordance de script. ProgUrol.2001;11:1213‑9.
  8. Marie I, Sibert L, Roussel F, Hellot M-F, Lechevallier J, Weber J. Le test de concordance de script : un nouvel outil d'évaluation du raisonnement et de la compétence clinique en médecine interne ? RevMed Interne.2005;26(6):501‑7.
  9. Gibot S, Bollaert P-E. Le test de concordance de script comme outil d'évaluation formative en réanimation médicale. PédagogieMédicale. 2008;9(1):7‑18.
  10. Caire F, Marin B, Cuny E. Utilisation du test de concordance de script au cours du deuxième cycle des études médicales : expérience dans l'enseignement de la neurochirurgie. Pédagogie Médicale. 2011;12(1):29‑35.
  11. Jouneau S, Luraine R, Desrues B. Intérêt des tests de concordance de script pour évaluer le raisonnement et l'organisation des connaissances des étudiants de quatrième année des études médicales en France. Pédagogie Médicale. 2012;13(4):225‑32.
  12. Giet D, Massart V, Gagnon R, Charlin B. Le test de concordance de script en 20 questions. Pédagogie Médicale. 2013;14(1):39‑48.
  13. Fournier JP, Demeester A, Charlin B. Script concordance tests: guidelines for construction. BMC Med Inform DecisMak. 2008; 6;8-18.
  14. Charlin B, Gagnon R, Lubarski S, Lambert C, Meterissian S, Chalk C, et al. Assessment in the Context of Uncertainty Using the Script Concordance Test: More Meaning for Scores.Teach Learn Med. 2010;22(3):180‑6.
  15. Jouquan J. L'évaluation des apprentissages des étudiants en formation médicale initiale.Pédagogie Médicale. 2002;3(1):38‑52.
  16. Brailovsky C, Charlin B, Beausoleil S, Coté S, Van Der Vleuten C. Measurement of clinical reflective capacity early in training as a predictor of clinical reasoning performance at the end of residency: an experimental study on the script concordance test. Med Educ. 2001;35(5):430-436.
  17. Fournier J-P, Thiercelin D, Pulcini C, Alunni-Perret V, Gilbert E, Minguet JM, et al. Évaluation du raisonnement clinique en médecine d'urgence : les tests de concordance des scripts décèlent mieux l'expérience clinique que les questions à choix multiples à contexte riche. Pédagogie Médicale. 2006;7(1):20-30.
  18. Kelly W, Durning S, Denton G. Comparing a script concordance examination to a multiple-choice examination on a core internal medicine clerkship. Teach Learn Med. 2012;24(3):187-193.
  19. Nseir S, Elkalioubie A, Deruelle P, Lacroix D, Gosset D. Accuracy of script concordance tests in fourth-year medical students. Int J Med Educ. 2017.25;8:63-69.
  20. Ben Hamida A. Mémoire. Le test de concordance de script comme outil d'évaluationen néonatologie. M´édecine humaine et pathologie. 2015
  21. Gagnon R, Charlin B, Lambert C, Carrière B, der Vleuten V. Script Concordance Testing: More Cases or More Questions? AdvHealthSciEduc 2009; 14:1382-96.
  22. Gagnon R, Charlin B, Coletti M, Sauve E, Van Der Vleuten C. Assessment in the context of uncertainty: how many members are needed on the panel of reference of a script concordance test? Med Educ. 2005;39(3):284‑91.