Skip to main content Accessibility help
×
×
Home

Validation and evaluation of new assessments for the otolaryngology undergraduate medical clerkship

  • R Woods (a1), T Subramaniam (a1), A Patterson (a2), M Hennessy (a2) and C Timon (a1)...

Abstract

Objectives:

To validate and evaluate a short answer question paper and objective structured clinical examination. Validity and effect on overall performance were considered.

Methods:

Students completed a voluntary short answer question paper during their otolaryngology attachment. Short answer question paper results were collated and compared to the essay examination and new end of year objective structured clinical examination.

Results:

The study comprised 160 students. Questions were validated for internal consistency (Cronbach's alpha = 0.76). Correlations were determined for: short answer question paper and essay results (r = 0.477), short answer question paper and objective structured clinical examination results (r = 0.355), and objective structured clinical examination and essay results (r = 0.292). On unpaired t-tests comparing the short answer question paper group and non-short answer question paper group, essay results were 1.2 marks higher (p = 0.45) and the objective structured clinical examination results were 0.09 marks lower (p = 0.74) in the short answer question paper group.

Conclusion:

Two new valid summative assessments of student ability have been introduced, which contribute to an enhanced programme of assessment to drive student learning.

Copyright

Corresponding author

Address for correspondence: Mr Robbie Woods, Trinity Department of Otolaryngology, Royal Victoria Eye and Ear Hospital, Adelaide Road, Dublin 2, Ireland E-mail: woodsr@tcd.ie

Footnotes

Hide All

Presented at the Irish Otolaryngology Society annual meeting, 11 October 2014, Donegal, Ireland.

Footnotes

References

Hide All
1Epstein, RM. Assessment in medical education. N Engl J Med 2007;356:387–96
2Van Der Vleuten, CP. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract 1996;1:4167
3Wass, V, Van der Vleuten, C, Shatzer, J, Jones, R. Assessment of clinical competence. Lancet 2001;357:945–9
4Miller, GE. The assessment of clinical skills/competence/performance. Acad Med 1990;65(9 suppl):S63–7
5Schuwirth, LW, van der Vleuten, CP. ABC of learning and teaching in medicine: written assessment. BMJ 2003;326:643–5
6Vergis, A, Hardy, K. Principles of assessment: a primer for medical educators in the clinical years. Internet Journal of Medical Education 2009;1(1)
7Hayes, A, Holden, C, Gaynor, D, Kavanagh, B, Otoom, S. Bridging the gap: a program to enhance medical students’ learning experience in the foundation year. Bahrain Medical Bulletin 2013;35:201–5
8Voorhees, KI, Prado-Gutierrez, A, Epperly, T, Dirkson, D. A proposal for reform of the structure and financing of primary care graduate medical education. Fam Med 2013;45:164–70
9Lambert, T, Goldacre, R, Smith, F, Goldacre, MJ. Reasons why doctors choose or reject careers in general practice: national surveys. Br J Gen Pract 2012;62:e851–8
10Department of Health. A High Quality Workforce: NHS Next Stage Review. London: HMSO, 2008
11Vinayak, BC, Bates, GJ. Undergraduate training in ENT - time for change? J R Soc Med 1993;86:181
12Clamp, PJ, Gunasekaran, S, Pothier, DD, Saunders, MW. ENT in general practice: training, experience and referral rates. J Laryngol Otol 2007;121:580–3
13Hu, A, Sardesai, MG, Meyer, TK. A need for otolaryngology education among primary care providers. Med Educ Online 2012;17:17350
14Donnelly, MJ, Walsh, MA, Hone, S, O'Sullivan, P. Examining the ear: clinical teaching. Med Educ 1996;30:299302
15Donnelly, MJ, Quraishi, MS, McShane, DP. ENT and general practice: a study of paediatric ENT problems seen in general practice and recommendations for general practitioner training in ENT in Ireland. Ir J Med Sci 1995;164:209–11
16Mace, AD, Narula, AA. Survey of current undergraduate otolaryngology training in the United Kingdom. J Laryngol Otol 2004;118:217–20
17Khan, MM, Saeed, SR. Provision of undergraduate otorhinolaryngology teaching within General Medical Council approved UK medical schools: what is current practice? J Laryngol Otol 2012;126:340–4
18Sharma, A, Machen, K, Clarke, B, Howard, D. Is undergraduate otorhinolaryngology teaching relevant to junior doctors working in accident and emergency departments? J Laryngol Otol 2006;120:949–51
19Wass, V, Bowden, R, Jackson, N. The principles of assessment design. In: Jackson, N, Jameson, A, Khan, A, eds. Assessment in Medical Education and Training: A Practical Guide. Oxford: Radcliffe, 2007;1126
20Al-Wardy, NM. Assessment methods in undergraduate medical education. Sultan Qaboos Univ Med J 2010;10:203–9
21van der Vleuten, CP, Schuwirth, LW. Assessing professional competence: from methods to programmes. Med Educ 2005;39:309–17
22Hawthorne, K. Assessment in the undergraduate curriculum. In: Jackson, N, Jameson, A, Khan, A, eds. Assessment in Medical Education and Training: A Practical Guide. Oxford: Radcliffe, 2007;2740
23Raj, N, Badcock, LJ, Brown, GA, Deighton, CM, O'Reilly, SC. Design and validation of 2 objective structured clinical examination stations to assess core undergraduate examination skills of the hand and knee. J Rheumatol 2007;34:421–4
24Chandratilake, M, Davis, M, Ponnamperuma, G. Evaluating and designing assessments for medical education: the utility formula. Internet Journal of Medical Education 2009;1(1)
25Newble, D. Techniques for measuring clinical competence: objective structured clinical examinations. Med Educ 2004;38:199203
26Harden, RM, Gleeson, FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 1979;13:4154
27Munro, N, Denney, ML, Rughani, A, Foulkes, J, Wilson, A, Tate, P. Ensuring reliability in UK written tests of general practice: the MRCGP examination 1998–2003. Med Teach 2005;27:3745
28Schuwirth, LW, van der Vleuten, CP. Different written assessment methods: what can be said about their strengths and weaknesses? Med Educ 2004;38:974–9
29Evans, DJ, Zeun, P, Stanier, RA. Motivating student learning using a formative assessment journey. J Anat 2014;224:296303
30Lloyd, S, Tan, ZE, Taube, MA, Doshi, J. Development of an ENT undergraduate curriculum using a Delphi survey. Clin Otolaryngol 2014;39:281–8
31Powell, J, Cooles, FA, Carrie, S, Paleri, V. Is undergraduate medical education working for ENT surgery? A survey of UK medical school graduates. J Laryngol Otol 2011;125:896905
32Ranta, M, Hussain, SS, Gardiner, Q. Factors that inform the career choice of medical students: implications for otolaryngology. J Laryngol Otol 2002;116:839–41
33Fowell, SL, Bligh, JG. Recent developments in assessing medical students. Postgrad Med J 1998;74:1824
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

The Journal of Laryngology & Otology
  • ISSN: 0022-2151
  • EISSN: 1748-5460
  • URL: /core/journals/journal-of-laryngology-and-otology
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed