© 2008 The Royal College of Psychiatrists
Mental health policy reforms and case complexity in CMHTs in England: replication study
Centre for Social Carework Research, School of Human Sciences, Swansea University, email: p.j.huxley{at}swansea.ac.uk
School of Human Sciences, Swansea University
Surrey and Borders Partnership NHS Trust
This study was funded by the Department of Health.
 TOP Abstract IntroductionMethodResultsDiscussionReferences |
|---|
AIMS AND METHOD
Community mental health team (CMHT) services in many Western countries have been remodelled to focus on people with the most severe illnesses and complex problems. Complexity scores using the Matching Resource to Care (MARC2) measure from CMHT cases in 2004–2005 (n=1481) are compared with scores in 1997–1998 (n=3178) in the same locations, before the introduction of the National Service Framework, and before the impact of the creation of integrated mental health trusts in England.
RESULTS
The 2004–2005 baseline complexity scores are all worse than those in 1997–1998.
CLINICAL IMPLICATIONS
If increased targeting brought about by the National Service Framework and other reforms has led to a greater proportion of people with complex problems in case-loads, what care services, if any, are now being received by people who were in receipt of CMHT services before the reforms?
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
Mental health policies in many Western countries have been remodelled to focus services on people with the most severe illnesses, greatest risk and most complex problems. However, these policies have had limited success in some places, such as the USA (Wang et al, 2002) and Australia (Rosen, 2006). In the UK, the New Labour Government introduced a focus on severe illness in the National Service Framework (Department of Health, 1999) but also modernised the care planning process (Kingdon, 1994; Department of Health, 1999a), community mental health services through the introduction of new teams (assertive outreach, early intervention and crisis resolution) (Department of Health, 2000) and partnership mental health trusts, which permitted the employment of social workers and other social care staff from the local authority in National Health Service (NHS) trusts; it was argued that the changes would produce a more integrated service (Venables et al, 2006). All these changes were intended to produce better outcomes (Holloway, 2001).
Many of the new teams created as part of the NHS plan were constituted from staff in existing community mental health teams (CMHTs), employing the same professionals in a new structure. Nevertheless, the Mental Health Policy Implementation Guide (Department of Health, 2001) stated that CMHTs should continue to have:
‘an important, indeed integral, role to play in supporting service users and families in community settings. They should provide the core around which newer service elements are developed. The responsibilities of CMHTs may change over time with the advent of new services, however they will retain an important role’. (Department of Health, 2001: p.7)
This paper explores the consequences for case complexity in CMHT case-loads of 7 years of service changes.
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
This study is a replication of one conducted in the same eight locations in the late 1990s. The data from 1997–1998 provide an assessment of the nature of provision by community-based staff in the period prior to the introduction of the National Service Framework for Mental Health, the Mental Health Policy Implementation Guide and other related policy measures.
The present paper compares case complexity using the Matching Resource to Care (MARC2) measure (Huxley et al, 2000a, b) and care programme approach (CPA) status in 1997–1998 with 2004–2005. The hypotheses are that, compared with the original study, the replication study will show: (a) a higher proportion of cases having higher complexity scores (because of better targeting of resources or more consistent use of eligibility criteria); and (b) professional staff carry cases of equal complexity (because of integration of health and social workers in the same teams).
Original study
In the original 1997–1998 Study data were collected using the MARC2,
a single page form that records the main characteristics associated with
severe mental illness on one side, and the Global Assessment Scale (GAS;
Endicott et al, 1976)
and Health of the Nation Outcome Scale (HoNOS;
Wing et al, 1998) on
the other.
The MARC2 is a 20-item scale, each item is equally weighted and each item is scored 0 or 1, aggregated to a total score (higher scores indicate greater complexity in terms of user characteristics (for example having been compulsorily admitted to hospital previously, psychotic illness, substance misuse problems), risk factors (for example risk of aggression and suicidal risk) and social problems (for example homelessness, unemployment)) (Huxley et al, 2000b). The reliability and validity of the instrument used (MARC2) has been described elsewhere (Huxley et al, 2000a).
Community mental health professionals within teams (mainly nurses, social workers and occupational therapists) in eight locations (representing a range of type of local authority and deprivation) across England completed the MARC2 form on a random half of their case-load within a 1-week census period, over the course of 11 months ending in summer, 1998. All CMHT keyworkers who carried case-loads and who were not on leave were included.
In the original study, a total of 3178 clients were included in the analysis. The average case-load size was 30 for nurses and 27 for social workers.
Present study
The design difference between the present study and the original one was
minimal; (a) an additional study site was included in 2004–2005, but
these results have been excluded from this paper, and (b) in order to reduce
the data collection burden, the proportion of case-loads selected for
inclusion was set at 20% rather than 50% (randomly selected using random
numbers by the research staff from case-load lists). All teams were integrated
in that the social workers were working in NHS-trust-managed-CMHTs by the time
of the replication study. Research staff were trained by the Royal College of
Psychiatrists’ Research Unit HoNOS trainers, and they in turn trained
all of the teams in the study in the use of HoNOS and the other instruments.
Shared care cases were always assigned to a primary care coordinator who
completed the research instruments. However, since no further checks were made
on the accuracy of the staff ratings (although research staff remained
available to be consulted over rating questions), there is a possibility of
individual rating idiosyncracies; rating drift is less likely given the short
(usually one-off) data collection period.
Statistical analysis
The MARC2 and GAS mean scores are normally distributed and so
t-tests and ANOVAs are used to make comparisons between the baseline
MARC2 scores in 1997–1998 and 2004–2005, professional group
differences in both years, and GAS outcomes.
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
There were six locations in the north west of England and two in the south east. At the time of the study few had actually introduced assertive outreach or early intervention teams, so the bulk of the sample was drawn from CMHTs. Sample size was 1481 and less than 2% of the cases came from assertive outreach teams (n=26 out of 1481). On the basis of known mean team sizes at the time of the study (Boardman & Parsonage, 2005) the response rate was at least 58% (n=413 out of 710), and could be higher if allowance is made for staff leave and vacancies. Sixty percent (n=884) of the sample of clients were categorised as having a psychotic illness compared with 63% in 1997–1998. Approximately half of the clients were female for both 1997–1998 (n=1629, 51.5%) and 2004–2005 (n=732; 49.4%). There were 68 cases (5%) on the highest CPA level in 2004–2005, compared with 17.8% in 1997–1998. The average case-load size was 25.
HoNOS and GAS
An independent sample t-test was used to compare the HoNOS, GAS
and MARC2 between the two research studies (1997–1998 and
2004–2005).
Table 1 shows that baseline mean scores were all significantly different, and that complexity and clinical severity were worse in 2004–2005 than in 1997–1998.
|
View this table: [in a new window] | Table 1. Results for Health of the Nation Outcome Scale, Global Assessment Scale and Matching Resource to Care measure baseline scores in 1997–1998 and 2004–2005 |
MARC2 scores by care programme approach level
A further indicator of change is the proportion of people on enhanced level
CPA. A difficulty in making this comparison is that CPA policy has changed
from a three level categorisation in 1997–1998 to two levels, standard
and enhanced. Standard CPA relates to individuals, who require support or
intervention from one agency or discipline, who pose no danger to themselves
or to others, and who will not be at high risk if they lose contact with
services. Enhanced CPA relates to individuals with multiple needs, who need to
be in contact with more than one professional group or agency (including
criminal justice agencies). This group may have more than one clinical
condition, or a condition that is accompanied by alcohol or drug misuse, so
requiring more intensive help from a range of services. Their circumstances
are the most complex.
The mean score of those on the highest level of CPA in 2004–2005 was double that in 1997–1998 (Table 2).
|
View this table: [in a new window] | Table 2. MARC2 scores by care programme approach level for 1997–1998 and 2004–2005 |
In each sample there is a significant difference in MARC2 scores between the CPA levels (1997–1998 data, f=34.83, d.f.=2, 3098, P<0.001; 2004–2005 data, t=–15.99, d.f.=871.72, P<0.001; mean difference –3.40, CI=–3.82 to –2.98).
MARC2 scores by professional group
There was a statistically significant difference in MARC2 scores for the
professional groups, with social workers having significantly higher mean
scores in both studies (Table
3).
|
View this table: [in a new window] | Table 3. Analysis of Variance of MARC2 scores for different professional groups |
In 2004–2005, the mean MARC2 scores for the nurse and occupational therapists are closer to those of social workers than in the original study, but mean scores for social workers are still significantly higher. A higher MARC2 mean score (>9) is significantly related to both the enhanced CPA level, and to the substantial and critical needs categories of the Fair Access to Care Criteria (FACS). Parabiaghi et al (2005) have reported that a mean clinical improvement score on HoNOS following treatment was 12 and for remission 5. In the present sample the mean HoNOS score for social workers’ cases was 13 and for nurses 11 (t=–3.5, d.f.=1117, P<0.01). The GAS scores of social worker cases were also significantly worse (means 58 and 54; t=2.91, d.f.=1158, P<0.01).
The individual MARC2 items where the case-loads of nurses and social workers differ is of some interest. At both time points a quarter of the social services’ cases had been homeless at some time, compared with a tenth of the nurses’ cases. In 1997–1998 a fifth of the social workers’ cases had a concurrent substance misuse problem, which was a higher proportion than that of nurses’ cases (16.3%). By 2005, a fifth of the community psychiatric nurses’ cases have concurrent substance misuse problems compared with 16% of social workers’ cases.
As in the previous study (1997–1998) the proportion of cases on social workers’ case-loads in 2004–2005 with a previous compulsory admission (52%), suicidal risk (47%) and self-neglect (69%) are all significantly higher than the proportions on community psychiatric nurses’ case-loads (41%, 38% and 56% respectively) in 2004–2005. There were the same proportions of cases on standard (32%) and enhanced (67%) CPA held by social workers and community psychiatric nurses. One could argue that it is appropriate that social workers should be working with people with a greater prevalence of social difficulties, and that this reflects a relevant division of labour within the teams.
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
The overall differences in mean scores in the replication study suggest that improved targeting has increased the proportion of complex cases in CMHT case-loads. Each of the three professional groups had experienced a similar increase in mean scores between the two studies, while the total case-load size in all these locations remained broadly similar at about 6000 cases. The mean MARC2 scores of social workers’cases remains significantly higher than the scores of nurses and occupational therapists. There could be a number of possible explanations for this finding: the nature of the MARC2 items, which contain several items relating to serious social problems, and if social workers accept cases with more social problems then there will be higher complexity scores in their case-loads; at the same time, it may be that the nurses in the teams are increasingly focused on evidence-based interventions with people facing less complex problems but ones that are amenable to modern effective interventions. This explanation is unlikely given that mean scores for nurses’ cases in 2004–2005 are much higher than in 1997–1998. Given the long treatment history of many of the patients it could be that those returning for episodes of care were given the same keyworker as before, and many of the cases seen in 1997–1998 were likely to still be in contact with services in 2004–2005. Since the 1997–1998 data showed that social workers carried more of these cases, they may still have done so in 2004–2005, hence increasing the mean MARC2 scores.
In conclusion, the current research has shown that the reforms introduced over the period between the two studies may have led to better targeting of services on people facing complex issues. The targeting of service towards those people facing the most complex circumstances and for whom the service is designed increases ‘vertical integration’. However, an increase in vertical integration may be achieved at the expense of less ‘horizontal integration’, so that while a greater number of people in the target group are receiving services, this may be at the expense of those with moderate needs who, in 2004–2005 compared with 1997–1998, were excluded from services. Given that most of these service users had nurses or occupational therapists as keyworkers in 1997-1998 the consequences of the change may have more implications for primary healthcare services than for social care services. Further research, however, will be required to assess how widely this finding might apply, and how a reduction in horizontal integration is being managed in the context of revised commissioning and organisational arrangements post-2005.
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
- BOARDMAN, J. & PARSONAGE, M. (2005) Defining a Good Mental Health Service: A Discussion Paper. Sainsbury Centre for Mental Health.
- DEPARTMENT OF HEALTH (1999) The National Service Framework for Mental Health: Modern Standards and Service Models. Department of Health.
- DEPARTMENT OF HEALTH (1999a) Effective Care Co-ordination in Mental Health Services–Modernising the CPA. Department of Health.
- DEPARTMENT OF HEALTH (2000) The NHS Plan – A Plan for Investment. A Plan for Reform. (Cm4818–I). Department of Health.
- DEPARTMENT OF HEALTH (2001) The Mental Health Policy Implementation Guide: CMHTS. Department of Health.
- ENDICOTT, J., SPITZER, R. L., FLEISS, J. L., et al
(1976) The Global Assessment Scale. Archives of
General Psychiatry, 33, 766
–771.
[Abstract/Free Full Text] - HOLLOWAY, F. (2001) Invited commentary on: Community
mental health team management in severe mental illness. British
Journal of Psychiatry, 178, 503
–505.
[Free Full Text] - HUXLEY, P., REILLY, S., GATER, R., et al (2000a) Matching resources to care: the acceptability, validity and inter-rater reliability of a new instrument to assess severe mental illness (MARC–1). Social Psychiatry and Psychiatric Epidemiology, 35, 312 –317.[CrossRef][Medline]
- HUXLEY, P., REILLY, S. & ROBINSHAW, E. (2000b) Matching resources to care needs: Targeting people with severe mental illness in health and social services. In Targeting in Mental Health Services: A Multidisciplinary Challenge (eds L. Cotterill & W. Barr). Ashgate.
- KINGDON, D. G (1994) The Care Programme Approach.
Psychiatric Bulletin,
18, 68
–70.
[Abstract/Free Full Text] - PARABIAGHI, A., BARBATO, A., D’AVANZO, B., et al (2005) Assessing reliable and clinically significant change on Health of the Nation Outcome Scales: method for displaying longitudinal data. Australian and New Zealand Journal of Psychiatry, 39, 719 –724.[CrossRef][Medline]
- ROSEN, A. (2006) The Australian experience of deinstitutionalization: interaction of Australian culture with the development and reform of its mental health services. Acta Psychiatrica Scandinavica, 113 (suppl. 429), 81–89.[Medline]
- VENABLES, D., HUGHES, J., REILLY, S., et al (2006) Patterns of care management arrangements for people with mental health problems in England. Australian Journal of Case Management, 7, 3 –9.
- WING, J. K., BEEVOR, A. S., CURTIS, R. H., et al
(1998) Health of the Nation Outcomes Scales. Research and
development. British Journal of Psychiatry,
172, 11
–18.
[Abstract/Free Full Text] - WANG, P. S., DEMLER, P. H., OLGA, M. S., et al
(2002) Adequacy of treatment for serious mental illness in the
United States. American Journal of Public Health,
92, 92
–98.
[Abstract/Free Full Text]
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||