Hostname: page-component-7c8c6479df-hgkh8 Total loading time: 0 Render date: 2024-03-28T12:19:55.558Z Has data issue: false hasContentIssue false

MRCPsych examinations: cumulative results 1997–2002

Published online by Cambridge University Press:  02 January 2018

Femi Oyebode
Affiliation:
Department of Psychiatry, University of Birmingham, Queen Elizabeth Psychiatric Hospital, Birmingham B15 2QZ, email: femi.oyebode@bsmht.nhs.uk
Elizabeth Furlong
Affiliation:
Department of Psychiatry, Queen Elizabeth Psychiatric Hospital, Birmingham
Rights & Permissions [Opens in a new window]

Abstract

Aims and Method

The aim of this study was to investigate the pattern of performance of candidates in the MRCPsych examinations in the period 1997–2002 inclusive. During this period 6306 candidates sat the MRCPsych part I and 4536 sat the MRCPsych part II.

Results

The overall pass rates for MRCPsych part I was 44.7% and 48.9% for MRCPsych part II. The majority of those who passed either part of the examinations did so on their first attempt; females performed better than males and graduates of UK and Republic of Ireland medical schools performed better than foreign graduates in all component parts of the examinations.

Clinical Implications

The pattern of results suggests that clinical tutors and course organisers need to pay special care to the training needs of trainees who are foreign medical graduates.

Type
Original papers
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Royal College of Psychiatrists, 2007

The Membership examinations (parts I and II) of the Royal College of Psychiatrists (MRCPsych) are important in determining the career progression of trainee psychiatrists. There is evidence that success in these examinations, as with other postgraduate medical examinations, is associated with age, gender, original medical school of training and ethnicity (Reference Ayres, Rigby and WilliamsAyres et al, 1996; Reference KruegerKrueger, 1998; Reference Tyrer, Leung and SmallsTyrer et al, 2002). For both parts of the MRCPsych examination those who passed were significantly younger and had qualified for a significantly shorter period of time than those who failed. Furthermore, the pass rates were higher for women than men; this was accounted for by the relatively higher failure rate of male candidates who qualified from medical schools outside the UK and Ireland (Reference Tyrer, Leung and SmallsTyrer et al, 2002).

The previous published study of the factors associated with success (Reference Tyrer, Leung and SmallsTyrer et al, 2002) investigated only one cohort each of both parts of the examinations. Also, the study used overall success as the outcome measure. The aim of the current study was to investigate the pattern and determinants of success in the MRCPsych examinations based on a larger cohort utilising the cumulative results of the MRCPsych examinations for a 6-year period (1997–2002 inclusive). Performance in the written and clinical examinations was investigated.

Results

MRCPsych part I

In the study period, 6306 candidates sat the MRCPsych part I examination and 2816 of these passed (44.7%). The majority of those who passed did so on their first attempt (n=1970, 70%). The pass rate for females was 51.9% and 39.8% for males. The overall pass rate varied according to original medical school of training. The pass rate of candidates graduating from UK and Irish medical schools was 59.8% and 48.6% respectively. This compared with 21% for graduates from Indian borders (Afghanistan, Pakistan and Nepal), 37.3% from the Indian subcontinent (India and Sri Lanka) and 36.7% for the others. This difference was statistically significant (χ2=468.25, d.f.=4, P<0.001). The UK and Irish graduates were more likely to pass on their first attempt (Table 1).

Table 1. Results by medical school, MRCPsych part I examinations

Medical school Candidates n Pass attempt 1 n (%) Pass attempt 2 n (%) Total pass n (%)
UK 2283 1065 (77.9) 0 (0) 1366 (59.8)
Republic of Ireland 325 120 (75.9) 25 (15.8) 158 (48.6)
Indian borders 461 44 (45.4) 26 (26.8) 97 (21.0)
Indian subcontinent 1234 311 (67.6) 99 (21.5) 460 (37.3)
Other 2003 430 (58.5) 188 (25.6) 735 (36.7)
Total 6306 1970 (70.0) 338 (12.0) 2816 (44.7)

The written examination was introduced as a screening test in 1997. The performance in the written and clinical examinations varied according to original medical school of training. UK graduates performed significantly better than the others in the multiple choice question (MCQ) paper (χ2=113.9, P<0.001) and the UK and Irish graduates both performed significantly better than the others in the clinical examination (χ2=271.1, P<0.001). The performance of graduates from the Indian borders was worse in both aspects of the examinations (Table 2).

Table 2. Results by component parts, MRCPsych part I

Pass MCQ Pass clinical
Medical school Candidates n n (%) 95% CI n (%) 95% CI
UK 1506 1022 (67.9) 65.5-70.2 887 (86.8) 84.7-88.9
Republic of Ireland 246 129 (52.4) 46.1-58.6 112 (86.8) 80.9-2.7
Indian borders 344 134 (38.9) 33.8-44.1 71 (53) 44.5-61.4
Indian subcontinent 998 568 (56.9) 53.8-59.9 370 (65.1) 61.2-69.1
Other 1428 819 (57.4) 54.8-59.9 510 (62.3) 59.0-65.6
Total 4522 2672 (59.0) 1950 (73.0)

MRCPsych part II

In the study period, 4536 candidates sat the MRCPsych part II examinations, and 2220 of these passed (48.9%). The majority of those who passed did so on their first attempt (n=1372; 69%). The pass rate for females was 54% and for males 45.1%. The overall pass rate varied according to original medical school of training. The pass rate for candidates graduating from UK and Irish medical schools was 68.0% and 55.5% respectively. This compared with 24.8% for candidates graduating from Indian borders, 35.5% for candidates from the Indian subcontinent and 33.2% from other medical schools. This difference was statistically significant (χ2=527.5, d.f.=4, P<0.001). UK graduates were more likely to pass on their first attempt (χ2=592.6, P<0.001) (Table 3).

Table 3. Overall results by medical school, MRCPsych part II

Medical school Candidates n Pass attempt 1 n (%) Pass attempt 2 n (%) Total pass n (%)
UK 1860 921 (72.9) 252 (19.9) 1264 (68.0)
Republic of Ireland 319 93 (52.5) 56 (31.6) 177 (55.5)
Indian borders 226 15 (24.8) 14 (25.0) 56 (24.8)
Indian subcontinent 686 128 (52.7) 53 (21.8) 243 (35.5)
Other 1445 215 (44.8) 120 (25.0) 480 (33.2)
Total 4536 1372 (61.8) 495 (22.3) 2220 (48.9)

Data were available for the performance of candidates on the different component parts of the examinations for autumn 1998, spring 1999, spring and autumn 2000, and spring 2001. The UK and Irish graduates were consistently better across all the component parts of the examination (Table 4). The difference was most marked in the written papers, particularly the critical review paper and the MCQ paper.

Table 4. Results by component parts, MRCPsych part II

UK and Republic of Ireland graduates Foreign graduates
Paper Candidates n Pass n Pass rate % Candidates n Pass n Pass rate % Total pass rate % χ 2
MCQ 962 666 69.2 1012 420 41.5 55.0 153.2*
Essay 961 670 69.7 1012 485 47.9 58.6 96.5*
CRP 789 582 73.8 840 372 44.3 58.6 145.7*
IPA 958 800 83.5 1008 670 66.5 74.8 75.6*
PMP 958 777 81.1 1008 627 62.2 71.7 85.9*

Discussion

The performance of UK and Irish graduates in both parts of the MRCPsych examinations was better than that of foreign medical graduates. This difference was evident in the written as well as in the clinical examinations. This pattern of results in which home graduates perform better at medical examinations compared with foreign graduates has been reported in the UK (Reference Wakeford, Farooqi and RashidWakeford et al, 1992), USA (Reference Meskauskas, Benson and HopkinsMeskauskas et al, 1977; Reference Benson, Meskauskas and GrossoBenson et al, 1981; Reference Quick and RobinowitzQuick & Robinowitz, 1981; Reference Mick and MouMick & Mou, 1991) and Canada (Reference Lowy and DongierLowy & Dongier, 1979). Indeed, there is evidence that US citizens who are foreign medical graduates do comparably worse than US medical graduates on standardised medical examinations (Reference Weinberg and BellWeinberg & Bell, 1978; Reference Norcini, Anderson and McKinleyNorcini et al, 2006). The finding that country of original medical qualification predicts performance suggests that the type and quality of undergraduate medical education may continue to have an effect on postgraduate education and performance. This is probably not the whole story; it may be that the culture of medical education and cultural aspects of communication are contributing to the outcome of examinations.

In an investigation of the performance of candidates from Asia in the oral examinations for the Membership of the Royal College of General Practitioners (MRCGP), Roberts et al (Reference Roberts, Sarangi and Southgate2000) showed that ‘the language of the oral examination is not a transparent medium through which information passes but a set of discourse that actively constructs a particular way of looking at the world’. They showed that there are at least three types of discourse: personal experience discourse; professional discourse; and institutional discourse. Success in the oral examination depended not simply on technical knowledge but on the facility of the candidate to manipulate different kinds of discourse that are not explicitly delineated. For example, examiners may ask questions seemingly in one area of discourse, yet they very often expect an institutional discourse response regardless of the apparent nature of the question. In other words, language and culture influence the outcome for candidates. Given the degree to which psychiatry as a subject is intricately dependent upon language and culture, it would be surprising if the same kind of issues were not relevant to the MRCPsych clinical examinations.

The performance of foreign medical graduates appears to improve over time, suggesting that there is a practice effect operating. It may be that the culture of examinations in the UK is being acquired at real attempts at the examination. Local tutors may have to ensure that foreign medical graduates have opportunities to practise at realistic ‘mock’ examinations before sitting the real thing.

The difference in performance holds true for all aspects of the College examinations and is even more salient in the written examinations. The written examinations include MCQ papers, essay papers and the critical review paper. The MCQ format requires a high degree of linguistic proficiency. It is possible that language comprehension is influencing the outcome in the MCQ. There is evidence that MCQs include imprecise terms for which consensus does not exist even among examiners (Reference Holsgrove and ElzubeirHolsgrove & Elzubeir, 1998). These imprecise terms might pose more difficulty for candidates who do not have English as a first language. In addition, the content of the MCQ paper may be an issue. For example, behavioural science is a major component of undergraduate medical education in the Western world, including the UK. However, this is not necessarily the case in other parts of the world. UK graduates already have grounding in this subject, whereas foreign graduates may find themselves introduced to this subject area for the first time. Organisers of local MRCPsych courses might need to be aware of this, and ensure that the behavioural science component of the courses is well taught.

In the previous study by Tyrer et al (Reference Tyrer, Leung and Smalls2002), age was associated with the outcome of sitting the MRCPsych examination. Older age as an important factor in determining poor performance is a recurring finding in studies of performance in postgraduate medical examinations (Reference BlacketBlacket, 1990; Reference Mick and MouMick & Mou, 1991). However, in an Israeli study investigating the results of medical licensing examinations, the highest success rate was in the 31- to 35-year age-group, particularly those with an average of 12 years of clinical experience (Reference SchenkerSchenker, 1993). In our study we did not examine the influence of age on performance. Furthermore, Tyrer et al found (Reference Tyrer, Leung and Smalls2002) gender to be associated with success in the MRCPsych examination. This was confirmed in the current study.

There is evidence that the quality of the training programme influences the pass rates in postgraduate qualifying examinations. For example, it has been shown that the number of trainees in a postgraduate training programme is associated with the outcome in examinations. In a Canadian study, small training programmes, that is those with three or fewer trainees, had significantly lower pass rates in written examinations. These training programmes also had a higher proportion of foreign medical graduates (Reference McKendry and DaleMcKendry & Dale, 1995). In the USA, foreign medical graduates and US citizens trained abroad performed worse in the certifying examination in internal medicine, and this poor performance was associated with attending different kinds of training programme than US citizens (Reference Norcini, Shea and WebsterNorcini et al, 1986). Although, there is concern that rural and remote training programmes in family medicine in Canada may disadvantage trainees compared with those attending urban training centres, investigation does not support this (Reference McKendry, Busing and DauphineeMcKendry et al, 2000). It may be helpful in future studies to investigate whether foreign graduates are more likely to be working in small or remote training programmes and whether this is associated with performance in the examinations.

It is important that the College examinations are fair to all candidates and that the outcome for candidates is a true reflection of knowledge and skills. Equally, it is important that foreign medical graduates have similar opportunities to UK graduates in order to gain adequate knowledge and clinical experience so as to be able to adequately prepare for the College examinations. Further research into the College examinations will help to clarify the mechanisms by which the factors that are established as influencing outcome operate.

Declaration of interest

F.O. was Chief Examiner of the Royal College of Psychiatrists from 2002 to 2005.

References

Ayres, P., Rigby, A. S. & Williams, R. (1996) Part 1 of Membership of the Faculty of Public Health Medicine (MFPHM). Trends over time and factors associated with success in recent years. Journal of Public Health Medicine, 18, 390395.Google Scholar
Benson, J. A., Meskauskas, J. A. & Grosso, L. J. (1981) Performance of US citizen–foreign medical graduates on certifying examinations in internal medicine. American Journal of Medicine, 71, 270273.Google Scholar
Blacket, R. B. (1990) Foreign medical graduates. The experience of the Australian Medical Examining Council and the Australian Medical Council, 1978–1989: implications for medical immigration and the medical workforce. Medical Journal of Australia, 153, 125132.Google Scholar
Holsgrove, G. & Elzubeir, M. (1998) Imprecise terms in UK multiple-choice questions: what examiners think they mean. Medical Education, 32, 343350.CrossRefGoogle ScholarPubMed
Krueger, P. M. (1998) Do women medical students outperform men in obstetrics and gynaecology? Academic Medicine, 73, 101102.Google Scholar
Lowy, F. H. & Dongier, M. (1979) The Canadian Certification Examination in Psychiatry. II. Who passes and who fails. Canadian Psychiatric Association Journal, 24, 282292.Google Scholar
McKendry, R. J. & Dale, P. (1995) Does the number of trainees in a postgraduate training programme influence the pass rates on certifying examinations? Clinical Investigative Medicine, 18, 7379.Google Scholar
McKendry, R. J., Busing, N., Dauphinee, D.W., et al (2000) Does the site of postgraduate family medicine training predict performance on summative examinations? A comparison of urban and remote programmes. Canadian Medical Association Journal, 163, 708711.Google Scholar
Mick, S. S. & Mou, T.W. (1991) The Foreign Medical Graduate Examination in the Medical Sciences (FMGEMS). An analysis of pass rates of the July 1984 through July 1987 examinations. Medical Care, 29, 229242.Google Scholar
Meskauskas, J. A., Benson, J. A. & Hopkins, E. (1977) Performance of graduates of foreign medical schools on the examinations of the American Board of Internal Medicine. New England Journal of Medicine, 297, 808810.Google Scholar
Norcini, J. J., Shea, J. A., Webster, G. D. et al (1986) Predictors of the performance of foreign medical graduates on the 1982 certifying examination in internal medicine. Journal of American Medical Association, 256, 33673370.Google Scholar
Norcini, J., Anderson, M. B. & McKinley, D.W. (2006) The medical education of US citizens who train abroad. Surgery, 140, 338346.Google Scholar
Quick, S. K. & Robinowitz, C. B. (1981) Examination success and opinions on American Board of Psychiatry and Neurology certification. American Journal of Psychiatry, 138, 340344.Google ScholarPubMed
Roberts, C., Sarangi, S., Southgate, L. et al (2000) Oral examinations – equal opportunities, ethnicity, and fairness in the MRCGP. BMJ, 320, 370375.Google Scholar
Schenker, J. G. (1993) Results of medical licensing examinations: 1988–1991. Harefuah, 124, 638640 (in Hebrew).Google Scholar
Tyrer, S. P., Leung, W.-C., Smalls, J. et al (2002) The relationship between medical school of training, age, gender and success in the MRCPsych examinations. Psychiatric Bulletin, 26, 257263.Google Scholar
Wakeford, R., Farooqi, A., Rashid, A., et al (1992) Does the MRCGP discriminate against Asian doctors? BMJ, 305, 9294.Google Scholar
Weinberg, E. & Bell, A. I. (1978) Performance of United States citizens with foreign medical education on standardised medical examinations. New England Journal of Medicine, 299, 858862.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Results by medical school, MRCPsych part I examinations

Figure 1

Table 2. Results by component parts, MRCPsych part I

Figure 2

Table 3. Overall results by medical school, MRCPsych part II

Figure 3

Table 4. Results by component parts, MRCPsych part II

Submit a response

eLetters

No eLetters have been published for this article.