Hostname: page-component-7c8c6479df-5xszh Total loading time: 0 Render date: 2024-03-29T06:14:04.927Z Has data issue: false hasContentIssue false

Learning portfolios in psychiatric training

Published online by Cambridge University Press:  02 January 2018

Kitty Seed
Affiliation:
South London and Maudsley NHS Foundation Trust, London
Lisa Davies
Affiliation:
Odgers, Ray and Berndtson, Hanover Square, London
Ronan J. McIvor
Affiliation:
Maudsley Hospital, 103 Denmark Hill, London SE5 8AZ, email: ronan.mcivor@slam.nhs.uk
Rights & Permissions [Opens in a new window]

Extract

Major changes are taking place in the way doctors are trained and assessed. A new curriculum, devised by the Academy of Medical Royal Colleges on behalf of Modernising Medical Careers, will be implemented for current junior doctors as part of the foundation and specialist training programmes. Every junior doctor will be expected to have a ‘personal learning plan’ to guide professional development and assist appraisal, and to build a portfolio to document their experiences. This marks a shift from traditional summative (i.e. examinations-based) evaluation to the use of more formative methods based on experience and workplace assessment. It reflects greater emphasis on continuing professional development and life-long learning (Wilkinson et al, 2002).

Type
Education & training
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Royal College of Psychiatrists, 2007

Major changes are taking place in the way doctors are trained and assessed. A new curriculum, devised by the Academy of Medical Royal Colleges on behalf of Modernising Medical Careers, will be implemented for current junior doctors as part of the foundation and specialist training programmes. Every junior doctor will be expected to have a ‘personal learning plan’ to guide professional development and assist appraisal, and to build a portfolio to document their experiences. This marks a shift from traditional summative (i.e. examinations-based) evaluation to the use of more formative methods based on experience and workplace assessment. It reflects greater emphasis on continuing professional development and life-long learning (Reference Wilkinson, Challis and HobmaWilkinson et al, 2002).

The term ‘learning portfolio’ usually implies two elements: a record of educational experience and a tool to encourage reflective learning (Reference Snadden and ThomasSnadden & Thomas, 1998; Reference ColeCole, 2005; Reference ReesRees, 2005). To work effectively for reflective learning, portfolio content needs to include training goals and identify gaps in knowledge or experience, leading to the formation of future goals (Reference Driessen, Van Tartwijk and OvereemDriessen et al, 2005; Reference ReesRees, 2005). Portfolios should include details of failures as well as successes. Portfolios simply used as a logbook for examination purposes are of limited benefit in this regard (Reference Snadden, Thomas and GriffinSnadden et al, 1996).

Portfolios have been in compulsory use for learning and assessment in nursing and allied health disciplines for a decade and are regulated by the English National Board for Nursing, Midwifery and Health Visiting. However, there has been comparatively little published concerning their use in postgraduate medical education. In one study conducted in the general practice setting, portfolio use was seen as a tool in promoting reflective learning in addition to aiding supervision and planning future learning goals (Reference Snadden, Thomas and GriffinSnadden et al, 1996; Reference Challis, Mathers and HoweChallis et al, 1997). However, considerable barriers were cited by participants to continued portfolio use, including resistance to forgoing didactic teaching methods, lack of time and preoccupation with passing examinations (Reference Snadden and ThomasSnadden & Thomas, 1998). These findings were mirrored in a recent study of nursing students (Reference McMullanMcMullan, 2006). Voluntary use of portfolios was limited and only increased if the process was compulsory (Reference Dornan, Carroll and ParboosinghDornan et al, 2002). Portfolio use tended to decline over time and depended on the learning style and attitude of the individual. Work done in an undergraduate medical setting and in other postgraduate disciplines broadly mirrored the findings in general practice (Reference Finlay, Maughan and WebsterFinlay et al, 1998; Reference Lonka, Slotte and HalttunenLonka et al, 2001).

Few studies have examined the benefits of portfolio use, although this has been attempted in the undergraduate setting. Finlay et al (Reference Finlay, Maughan and Webster1998) studied two groups of students, one randomised to portfolio use and tutorial support and the other to a standard teaching protocol. There were no significant differences in overall examination marks in the subject of interest (oncology) or in overall degree marks. However, researchers did find a statistically significant benefit of portfolio use in weaker students, who attained higher marks for factual knowledge.

Given the future importance of learning portfolios in medical education, we assessed the current knowledge, attitudes and usage of portfolios among psychiatric trainees in a large London psychiatric training rotation. For those already using them, we wanted to explore issues of attitudes and content.

Method

A self-report postal questionnaire was sent to all 76 permanent senior house officers (SHOs) on the South London and Maudsley training rotation in adult psychiatry employed between January and August 2005. A reminder was sent 4 weeks later to those who did not respond.

The questionnaire requested trainees to provide demographic and training details, and indicate their attitudes to portfolios. Trainees who had a portfolio were asked to provide information on content and sources of advice for compilation, ticking options as appropriate. Those with no portfolio were asked to tick a range of possible reasons exploring barriers to their use. Attitudes towards portfolios were requested from all respondents, using a number of statements scored on a 5-point Likert scale (strongly agree, scored 1; agree, 2; neutral, 3; disagree, 4; strongly disagree, 5). Space was provided at the end for a free-text response. A copy of the questionnaire is available from the authors. Data were analysed using SPSS, version 12 for Windows.

Results

Demographics

Forty-five doctors (59%) returned the questionnaire (23 male). They ranged in age from 26 to 38 years (mean 29.4, s.d.=2.2). The sample came from a broad range of medical schools, with 13 graduating overseas (29%), 11 in London (24%) and 7 in Cambridge (16%). Thirty-one doctors were White (71%), 2 (5%) Black, and 8 (14%) Asian, Indian or Chinese. The ethnic balance was broadly similar to the membership profile of the College (http://www.rcpsych.ac.uk/PDF/05_memfells.pdf). Time spent in psychiatry ranged from 8 to 84 months (mean 30.1, s.d.=16.8), with year of qualification ranging from 1992 to 2003.

Use and content of portfolios

Out of 10 doctors who had compiled a portfolio, 7 were female, 4 had graduated from London and 3 from Cambridge. Ages ranged from 27 to 31 years (mean 28.3, s.d.=1.2), whereas time spent in psychiatry ranged from 9 to 36 months (mean 23.8, s.d.=9.8). The most frequently used source of information in compiling a portfolio was senior advice (60%), followed by Royal College of Psychiatrists’ guidelines (40%) and other published information, peer advice and other sources (30% in total).

Most portfolios contained achievement-focused information; 90% of doctors included their curriculum vitae, General Medical Council certificate and job appraisal; 80% included evidence of research and course attendance; 70% detailed information on audit projects and qualification certificates, in addition to including publications and clinical presentations. Slightly less common were details of teaching experience (60%), awards (50%), conference attendance (40%) and management experience (30%), although this might reflect the relative lack of experience in their career to date. Relatively few included evidence of reflective practice, such as patient feedback (30%) and peer discussions on interesting patients.

Non-users of portfolios

Of those who did not have a portfolio (n=35), 18 (51.4%) had never heard of portfolios, 7 (20%) had thought about making one, 17 (48.6%) would only use one if it was compulsory, 5 (14.3%) considered they did not have the time to compile one and 8 (22.9%) thought a portfolio would not suit their style of learning.

Attitudes to portfolios

Seven attitudinal items were examined separately. Taking the sample together, most doctors gave neutral responses to the question ‘are portfolios helpful’ (n=17), although most agreed portfolios were useful in career planning (n=27), revalidation (n=24) and supervision (n=27). Most disagreed with the statement ‘it is easy to access advice on making portfolios’ (n=18) and felt portfolios were time-consuming to compile and maintain (n=23).

When comparing those who had complied portfolios with those who had not, there was one significant difference between individual items. Those who compiled portfolios disagreed more with the statement that portfolios are something you only do for appraisal (mean 3.80 s.d.=0.92 v. 2.97 s.d.=1.02, t=–2.31, d.f.=41, P=0.03). There was a tendency for those who had compiled portfolios to believe they were helpful in revalidation (mean 1.80, s.d.=0.79 v. 2.36, s.d.=0.86, t=1.85, d.f.=41, P=0.07).

No significant difference was shown when a ‘helpful’ sub-score was calculated from summing five items that were seen to indicate that portfolios were useful (‘portfolios are helpful’, ‘ portfolios are used for appraisal’, ‘can be used to plan career development’, ‘can be used in supervision’, ‘ can be used for revalidation’). Cronbach's α score was acceptable at 0.88.

Free-text responses

There were 17 respondents who included comments on their questionnaire. Of those who had compiled a portfolio (n=8), 3 out of 4 comments were broadly positive, emphasising their usefulness in summarising achievements and planning career development. The negative comment concerned the amount of time needed to compile a portfolio. Of the 9 trainees who did not have a portfolio, 6 made broadly negative comments, focusing on time constraints and uncertainty about potential benefits. There were also comments regarding the need for support and guidance.

Discussion

With the advent of Modernising Medical Careers, learning portfolios are set to become an integral component of medical training. This study shows a low level of portfolio use among psychiatric trainees, with limited understanding of their purpose or content. The content of portfolios within this training rotation suggests they are being used as a record of achievement. There seems to be difficulty in accessing advice on compiling portfolios, with sources of information drawn mainly from informal sources rather than educational bodies. It is worrying that more than half of those who did not have a portfolio had not even heard of them. The publication of Foundation Learning Portfolio (Modernising Medical Careers, 2005) may go some way to alleviate this knowledge gap, complemented by advice from senior colleagues.

Doctors’ attitudes to portfolio development were broadly neutral, both for those who had a portfolio and those who had not. Those who already had compiled portfolios realised that their usefulness extended beyond the appraisal process, with the possibility of ongoing benefits in continuing professional development. This supports previous findings that it is not until you actually start a portfolio that you begin to appreciate its potential benefits (Reference Rees and SheardRees & Sheard, 2004), with the opportunity for reflective learning being developed (Reference Roberts, Newble and O'RourkeRoberts et al, 2002).

Preliminary evidence shows that educational portfolios may benefit the educational process but additional studies are needed to confirm this. Whatever their efficacy, they are here to stay. This survey reinforces the need to make portfolios a compulsory feature of continued learning beyond the foundation years, with clear explanations regarding their content and rationale, otherwise their use may remain low.

Declaration of interest

None.

References

Challis, M., Mathers, A., Howe, N. et al (1997) Portfolio-based learning: continuing education for general practitioners – a mid-point evaluation. Medical Education, 31, 2226.CrossRefGoogle ScholarPubMed
Cole, G. (2005) The definition of ‘portfolio’. Medical Education, 39, 11401142.CrossRefGoogle ScholarPubMed
Dornan, T., Carroll, C. & Parboosingh, J. (2002) An electronic learning portfolio for reflective continuing professional development. Medical Education, 36, 767769.CrossRefGoogle ScholarPubMed
Driessen, E., Van Tartwijk, J., Overeem, K., et al (2005) Conditions for successful reflective use of portfolios in undergraduate medical education. Medical Education, 39, 12301235.CrossRefGoogle ScholarPubMed
Finlay, I., Maughan, T. & Webster, D. (1998) A randomized controlled study of portfolio learning in undergraduate cancer education. Medical Education, 32, 172176.CrossRefGoogle ScholarPubMed
Lonka, K., Slotte, V., Halttunen, M., et al (2001) Portfolios as a learning tool in obstetrics and gynaecology undergraduate teaching. Medical Education, 35, 11251130.CrossRefGoogle Scholar
McMullan, M. (2006) Students' perceptions on the use of portfolios in pre-registration nursing education: a questionnaire survey. International Journal of Nursing Studies, 43, 333343.CrossRefGoogle ScholarPubMed
Modernising Medical Careers (2005) Foundation Learning Portfolio. http://www.mmc.nhs.uk/download/Foundation%20LP_Updated_2.pdf Google Scholar
Rees, C. (2005) The use (and abuse) of the term ‘portfolio’. Medical Education, 39, 436437.CrossRefGoogle ScholarPubMed
Rees, C. & Sheard, C. (2004) Undergraduate medical students' views about a reflective portfolio assessment of their communication skills learning. Medical Education, 38, 125128.CrossRefGoogle ScholarPubMed
Roberts, C., Newble, D. & O'Rourke, A. (2002) Portfolio-based assessments in medical education: are they valid and reliable for summative purposes? Medical Education, 36, 899900.CrossRefGoogle ScholarPubMed
Snadden, D. & Thomas, M. (1998) Portfolio learning in general practice vocational training – does it work? Medical Education, 32, 401406.CrossRefGoogle ScholarPubMed
Snadden, D., Thomas, M., Griffin, E., et al (1996) Portfolio-based learning and general practice vocational training. Medical Education, 30, 148152.CrossRefGoogle ScholarPubMed
Wilkinson, T., Challis, M., Hobma, S., et al (2002) The use of portfolios for assessment of the competence and performance of doctors in practice. Medical Education, 36, 918924.CrossRefGoogle ScholarPubMed
Submit a response

eLetters

No eLetters have been published for this article.