Psychiatric Bulletin (2007) 31: 342-344. doi: 10.1192/pb.bp.106.012906
© 2007 The Royal College of Psychiatrists
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Submit an eLetter
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Oyebode, F.
Right arrow Articles by Haque, S.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Oyebode, F.
Right arrow Articles by Haque, S.

Inter-examiner reliability of the clinical parts of MRCPsych part II examinations

Femi Oyebode, Professor of Psychiatry

Department of Psychiatry, University of Birmingham, Queen Elizabeth Psychiatric Hospital, Birmingham B15 2QZ, email: femi.oyebode{at}bsmht.nhs.uk

Sanju George, Consultant Psychiatrist

Birmingham and Solihull Mental Health NHS Trust

Veena Math, Specialist Registrar

Greater Glasgow Primary Care NHS Trust

Sayeed Haque, Research Fellow

Department of Psychiatry, University of Birmingham, Queen Elizabeth Psychiatric Hospital, Birmingham

Declaration of interest

F.O. was Chief Examiner, Royal College of Psychiatrists 2002-2005.

AIMS AND METHOD

The aim of the study was to investigate the interrater reliability of the clinical component of the MRCPsych part II examinations, namely the individual patient assessment and the patient management problems. In the study period, there were 1546 candidates and 773 pairs of examiners. Kappa scores for pairs of examiners in both these assessments were calculated.

RESULTS

The kappa scores for exact numerical agreement between the pairs of examiners in both individual patient assessment and patient management problems were only moderate (0.4-0.5). However, the kappa scores for agreement between pairs of examiners for the reclassified pass and fail categories were very good (0.8).

CLINICAL IMPLICATIONS

The poor reliability of thetraditional long case and oral examinations in general is one of the most potent arguments against their use. Our finding suggests that the College clinical examinations are at least not problematic from this point of view, particularly if global pass or fail judgements rather than discrete scores are applied.




This article has been cited by other articles:


Home page
 Psychiatr. Bull.Home page
G. F. Searle
Is CEX good for psychiatry? An evaluation of workplace-based assessment
Psychiatr. Bull., July 1, 2008; 32(7): 271 - 273.
[Full Text] [PDF]

Home page
 Psychiatr. Bull.Home page
F. Odukwe and M. McCauley
The case for the long case
Psychiatr. Bull., March 1, 2008; 32(3): 117 - 117.
[Full Text] [PDF]