© 2002 The Royal College of Psychiatrists
© 2002 The Royal College of Psychiatrists
Outcome of clinical risk management in the Gloucester rehabilitation service
Wotton Lawn, Horton Road, Gloucester GL1 3WL
University of Exeter
ACT, 136 Stroud Road, Gloucester
Wotton Lawn, Horton Road, Gloucester
 TOP Abstract IntroductionMethodResultsDiscussionReferences |
|---|
AIMS AND METHOD
To assess the impact of a clinical risk assessment and management policy introduced in a tertiary rehabilitation service, in response to UK government statute. The study assessed the effect of a formal risk management approach for high-risk cases over a year, in terms of changes in risk-associated behaviour and perceived levels of risk, and in achievement of clinical risk management goals.
RESULTS
Initially 35 of 107 patients were rated as high risk, mostly of neglect or of harm to others, and were subjected to formal risk management. At follow-up only 16 patients were still rated as high risk, most reduction occurring in risk of neglect. Half of the 112 risk management goals established were fully achieved, 58 partially and 18 not achieved. Total Social Behaviour Schedule ratings were significantly lower at follow-up.
CLINICAL IMPLICATIONS
Risk management appeared to be successful in terms of reducing overall levels of risk, the achievement of risk management goals and the reduction of risk-associated behaviours. The lack of a control group and blindness limits the validity of these findings. However, organised risk management procedures may help to support and promote good general clinical management.
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
The Royal College of Psychiatrists (1996) has advised that clinical risk management is an ‘integral part of psychiatric practice’, and that people presenting an increased risk of harm should be given the highest priority for resource allocation. It has been statutory procedure for policies in risk assessment and management to be in place in all mental health provider units since 1994. However, there is a lack of empirical evidence regarding the effect of the introduction of risk assessment in clinical practice. While it may be expected that the explicit management of risk might be effective and lead to risk reduction, there is a lack of evidence to support this contention. A literature search failed to identify any published outcome research in this area, and in literature cited to support the Green Paper for proposed changes to the Mental Health Act (1983) the Department of Health did not describe any directly relevant research (Department of Health, 2001).
This study aims to provide preliminary data regarding the impact of clinical risk management, both in terms of the achievement of the clinical goals established within the risk management plans, and also the effect on risk-associated behaviour, and change in overall levels of risk.
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
Service context
At the time of this study, the Gloucester rehabilitation service was treating approximately 160 patients with severe mental illness in the city of Gloucester. The community rehabilitation team worked extensively in a large supported lodgings scheme. There were 12 rehabilitation in-patients and a well-developed hostel system.
In response to a homicide inquiry in 1997, the Severn NHS Trust developed a clinical risk assessment and management policy, supported by a training programme. The rehabilitation service started a programme of clinical risk assessment through its annual clinical review process from autumn 1997.
Risk assessment and management
All staff in the rehabilitation service participated in the Trust training
in risk assessment and management, largely through joint team training. The
process of initial clinical risk assessment and risk management planning was
completed in Care Programme Approach (CPA) multi-disciplinary review meetings.
Prior to this the keyworker (usually a community psychiatric nurse, but in
some cases a social worker) had carried out a full evaluation of risk based on
case note information and (as advised in the training programme) identifying
actuarial indicators and contemporary factors relevant to the risk of neglect,
harm to self, or harm to others. At the end of the review, a discussion within
the multi-disciplinary team determined whether each patient posed a mild,
moderate or severe risk of harm to self or others, or self-neglect. This
judgement was qualitative, but related specifically to consensus reached in
the Trust training programme, which was completed as a team exercise.
For patients considered to be at high risk in any category, a formal risk management plan was developed, broken explicitly into management goals, which were to be achieved over the following year. This followed a model of clinical outcome monitoring previously described (Macpherson et al, 1999). All patients were also rated by keyworkers with reference to 1 month prior to the review meeting on ratings of: hostile social contacts; personal appearance and hygiene; inappropriate sexual behaviour; destructive behaviour; and self-harming behaviour; these items were taken directly from the Social Behaviour Schedule (SBS; Wykes & Sturt, 1986). Ratings on each domain range from 0 (no problem) up to 4, each increment having a clearly described level and frequency of abnormal behaviour.
At the follow-up CPA review meeting 1 year later, each patient was reassessed following the same risk assessment process and using the same SBS ratings, and within the review meeting it was determined whether risk management goals had been ‘fully achieved’, ‘partially achieved’ or ‘not achieved’ as described previously by Macpherson et al (1999). Finally, the keyworker was asked to rate whether risk management had been beneficial in each case on a five-point Likert scale: ‘disagree strongly’, ‘disagree a little’, ‘unsure’, ‘agree a little’ or ‘agree strongly’.
Data analysis
Data were entered into the Statistical Package for the Social Sciences,
version 10 for Windows. Non-parametric Wilcoxon matched-pairs signed ranks
test and Spearman's correlation coefficients were used to assess change in
risk ratings, and the relationship between perceived change in risk and risk
goal achievement respectively. Analysis of change in the rating of risk
between the two assessments was made by kappa correlation coefficients.
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
Risk ratings
Ratings were completed for 107 patients who were subjected to initial risk management and assessed at 12 months' follow-up. The project aimed to include the entire service case-load, but a number of patients were discharged or moved from the locality over the year of the study. The characteristics of the rehabilitation and study population are shown in Table 1.
|
View this table: [in a new window] | Table 1. Clinical and demographic characteristics of the rehabilitation service population and the high-risk study population |
Thirty-five patients (33%) were rated as high risk in at least one area at
the first assessment, and these patients represent the study group under
consideration. Their clinical characteristics are shown separately in
Table 1, and do not differ
substantially from the population on the rehabilitation register. The
remaining 72 patients were not subjected to formal risk management plans, as
they were not initially rated as high risk. However, they were followed up in
the same manner and, at review, three patients were (at that point) assessed
as being at high risk, all of self-neglect. At this point a further three
patients whose clinical management had been taken over by the rehabilitation
service were also assessed as being at high risk of harm, two of them of harm
to others and one of neglect. Ratings of risk at initial assessment and at 12
months' follow-up are presented in Table
2. At base-line, two patients were rated as being at high risk of
both neglect and harm to others. It can be seen that risk ratings changed over
the 12-month follow-up period, and 
correlations for risk ratings
between the two points were as follows: risk to self, =0.55; risk to
others, =0.68; risk of neglect, =0.28. Overall, there was a
reduction in perceived level of risk between the two assessments. The team
rated overall risk as ‘decreased’ in 24 cases,
‘unchanged’ in 7 cases and ‘increased’ in 4 cases.
|
View this table: [in a new window] | Table 2. Multi-disciplinary risk ratings in study groups at baseline and 12-month follow-up |
Risk management goals
In total, 112 risk management goals were developed for the 35 high-risk
patients (mean 3.2 per patient, range 1-5). The most common goals were
managing compliance, in 29 patients (83%), and developing structured
activities/day care, in 23 patients (66%).
At follow-up patients had fully achieved 56 goals (mean 1.6 per patient, range 0-4) and partially achieved 38 goals (mean 1.1, range 0-2). There were 18 non-achieved goals (mean 0.5, range 0-3). Compliance goals were achieved fully in 19, partially in 6 and not at all in 4 cases. Goals to establish or improve day care were achieved fully in 15, partially in 5 and not at all in 3 cases. Team ratings of change in risk goals (as ‘increased’, ‘decreased’ or ‘the same’) were weakly correlated with the total number of goals achieved, but not significantly correlated with the number of goals that had been set but not achieved (r=-0.41, P=0.02; r=0.31, P=0.22, respectively).
Behaviour ratings
Total behaviour ratings across the five domains of the SBS reduced
significantly over the study period, from mean 3.1 (s.d. 2.6, range 0-9) at
initial assessment to mean 2.2 (s.d. 2.8, range 0-11) at follow-up
(Z=-2.3, P=0.02).
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
The main findings of this study were: risk as assessed by staff in a high-risk rehabilitation population reduced over a 12-month period. Ratings of high risk of neglect were particularly likely to decrease. Staff tended to perceive that risk had reduced at follow-up. Ratings of challenging behaviour on five items of the SBS showed a significant reduction between the two assessments. A wide range of goals aimed to reduce risk were established, of which roughly half were fully achieved and one-third partially achieved. Goals in the area of treatment compliance and the development of structured day care/activities were generally achieved, at least partially. Staff perception of reduced risk was weakly related to the achievement of goals, but unrelated to the level of non-achievement of goals.
The finding that ratings of risk of neglect tended to change more than other risk areas over time is interesting. It could be argued that this area of risk is more nebulous and difficult to define. While numerous rating scales to predict dangerousness and suicidality have been devised, the area of self-neglect remains under-researched, and the need for a greater evidence base in this area emerged repeatedly within the Trust training programme. A recurrent issue raised by staff was the complex assessment of a patient whose neglect is substantial but is not causing concern to the individual or apparently to the wider society, but is a legitimate concern for health professionals. It is important to acknowledge that a small group of patients rated as low risk at initial assessment was considered at follow-up to be at high risk (in all cases, of neglect). This emphasises the need for active engagement and follow-up in complex cases of severe mental illness, as advocated in the contemporary model of assertive outreach (Burns & Guest, 1999), and it is interesting that the community rehabilitation team described has developed subsequently into a formal assertive outreach team.
The central findings of this study will, we hope, be welcomed, at a time when there is public concern about the ability of mental health services to deal effectively with risk. We have shown that in a standard clinical setting, rather than a major research centre, the adoption of a programme of clinical risk management was associated with the reduction in ratings of risk, reduced perception of risk among staff, and lower ratings of challenging behaviour. It has also been demonstrated that it is possible to integrate methods of rating and clinically managing risk into a standard health care setting, in a way that has helped to focus work on the key clinical areas, and can be demonstrated to have been effective: our findings can be seen to add to the evidence that the longer a patient remains under supervised care, the lower the risks of future violence and reoffending (Lamb et al, 1988; Bloom & Williams, 1994).
The development of a simple system of setting goals, with subsequent rating of their achievement, has in our view been essential to this piece of work. While most of the goals were in areas that were obviously linked to risk, for example targeting compliance, others reflected an awareness that areas that might not obviously link with risk (such as family work, drug changes targeting side-effects, art therapy concerned with childhood experiences) were all considered to be legitimate foci for risk management. In our experience, the danger of therapeutic nihilism resulting from the allocation of a ‘high-risk’ label (Kaliski, 1997) to a case does not appear to have been realised. The clinical approach reported in this paper was of holistic clinical management, based on comprehensive assessment of need. It may be relevant that within this service training has a high status in all disciplines, and team-based training in risk management was considered to have been a successful process. Research suggests that at present there are surprisingly low levels of training in risk management within most UK Trusts (Davies et al, 2001).
It is important to consider the limitations inherent within this study's methodology. The lack of a control group, without a specific risk management approach, means that change cannot necessarily be attributed to the clinical method described, and may have resulted from more general factors associated with the work of the team. We agree with Snowden et al (1999) that effective risk management does not require specific skills, but needs a sound, comprehensive, clinical approach. It is also important to note the evidence (reviewed by Buckley et al, 1995) of the value of clozapine in managing aggression. The service described in this paper operates a large clozapine clinic. The population in the study reported here was small, and from a rehabilitation service, which might have led to bias in favour of more chronic, long-term cases, including a number of forensic cases (the regional forensic service having no community provision in the county). A further limitation is the possibility that improvements noted in the study might be due to a temporal effect, in conditions such as affective disorders which are likely to change over time.
Petch (2001) has expressed concerns about clinical risk management, based on perceptions of the process as politically driven, lacking an evidence base, and a means of attributing responsibility to clinical services for problems such as massive levels of substance misuse, which are not being addressed by society. Risk management raises questions about which societal problems should properly be managed within the remit of psychiatry. We have sympathy for these views, but believe that our findings offer some encouragement, particularly if we consider the target of risk management to be the reduction of challenging behaviour such as violence and neglect. If simple audit methods such as this can be completed in standard clinical settings, we may learn more incrementally about the requirements for successful risk management.
A final methodological concern relates to prediction, in an area of practice where serious untoward events are thankfully rare (Taylor & Gunn, 1999). During the year of this study there was no homicide or suicide in the population studied. Kennedy (2001) has argued that for every homicide predicted accurately using standard methods, there would be 111 false positives, and we agree with him that in order to achieve a meaningful and practical approach within standard clinical settings, a focus on risk of violence rather than homicide is the only feasible approach, and that it is ‘worth the effort’. While our results indicate a reduction of perceived risk and challenging behaviour, an actual reduction in suicide or homicide risk cannot be inferred. Indeed, the service described believes strongly in the need for therapeutic risk-taking, as advocated by Davis (1997), in order to effectively support the patients we treat. The development of organised risk management systems might help to support and promote sound and defensible practice which could be reviewed appropriately in the event of untoward events.
In her review of schizophrenia and the risk of violence, Taylor (1995) concluded that patients with psychosis rarely reoffend on return to the community, and do better than patients who are non-psychotic. She argued that ‘it ought to be an attainable goal that secondary prevention of serious violence by people with psychosis could be almost complete.’ This study has presented findings that suggest that risk management can be effective in a number of ways. There is a need for larger-scale formal research to consider further the components necessary for effective risk management in different populations.
The authors would like to thank Professor Glyn Harrison for advice in the design of this project, and Julie Bundy for preparing the manuscript.
|
TOPAbstractIntroductionMethodResultsDiscussionReferences |
|---|
- BLOOM, J. D. & WILLIAMS, M. H. (1994) Management and Treatment of Insanity Acquitters. A Model for the 1990s. Washington, DC: American Psychiatric Press.
- BUCKLEY, P., BARTELL, J., DONENWIRTH, K., et al (1995) Violence and schizophrenia: clozapine as a specific anti-aggressive agent. Bulletin of the American Academy of Psychiatry and the Law, 23, 607-611.
- BURNS, T. & GUEST, C. (1999) Running an active community treatment team. Advances in Psychiatric Treatment, 5, 348-356.
- DAVIES, S., AMOS, T. & APPLEBY, L. (2001) How much
risk training takes place in mental health services? Psychiatric
Bulletin, 25,
217-219.
[Abstract/Free Full Text] - DAVIS, A. (1997) Risk work in mental health. In Good Practice in Risk Assessment and Risk Management (eds H. Kemshall & J. Pritchard), pp. 109-120. London: Jessica Kingsley.
- DEPARTMENT OF HEALTH (2000) Reforming the Mental Health Act. London: Department of Health.
- DEPARTMENT OF HEALTH (2001) Proposed Changes to the Mental Health Act (1983). London: Stationery Office.
- KALISKI, S. (1997) Risk management during the transition from hospital to community care. International Review of Psychiatry, 9, 249-256.[CrossRef]
- KENNEDY, H. (2001) Risk assessment is inseparable from
risk management. Comment on Szmuckler. Psychiatric
Bulletin, 24,
6-10.
[Free Full Text] - LAMB, H. R., WEINBERGER, L. E. & GROSS, B. H.
(1988) Court-mandated community out-patient treatment for persons
found not guilty by reason of insanity: a five year follow up.
American Journal of Psychiatry,
145,
450-456.
[Abstract/Free Full Text] - MACPHERSON, R., JERROM, W., LOTT, G., et al (1999) The outcome of clinical goal setting in a mental health rehabilitation service. A model for evaluating clinical effectiveness. Journal of Mental Health, 8, 95-102.
- PETCH, E. (2001) Risk management in UK mental health
services: an overvalued idea? Psychiatric Bulletin,
25,
203-205.
[Free Full Text] - ROYAL COLLEGE OF PSYCHIATRISTS (1996) Council Report CR53: Assessment and Clinical Management of Risk of Harm to other People. London: Royal College of Psychiatrists.
- SNOWDEN, P., MCKENNA, J. & JASPER, A. (1999) Management of conditionally discharged patients and others who present similar risks in the community: integrated or parallel. Journal of Forensic Psychiatry, 10, 583-596.
- TAYLOR, P. J. (1995) Schizophrenia and the risk of violence. In Schizophrenia (eds S. R. Hirsch & D. R. Weinberger). Oxford: Blackwell Science.
- TAYLOR, P. J. & GUNN, J. (1999) Homicides by people with mental illness: myth and reality. British Journal of Psychiatry, 274, 9-14.
- WORLD HEALTH ORGANIZATION (1993) The ICD—10 Classification of Mental and Behavioural Disorders: Diagnostic Criteria for Research. Geneva: WHO.
- WYKES, T. & STURT, E. (1986) The measurement of
social behaviour in psychiatric patients: an assessment of the reliability and
validity of the SBS schedule. British Journal of
Psychiatry, 148,
1-4.
[Abstract/Free Full Text]
This article has been cited by other articles:
 |
|
 |
|
  J. Langan Mental health, risk communication and data quality in the electronic age Br. J. Soc. Work, April 1, 2009; 39(3): 467 - 487. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. Turner-Stokes Goal attainment scaling (GAS) in rehabilitation: a practical guide Clinical Rehabilitation, April 1, 2009; 23(4): 362 - 370. [Abstract] [PDF]
|
|
|
|
 |
|
 L. A. Neal, D. Watson, T. Hicks, M. Porter, and D. Hill Root cause analysis applied to the investigation of serious untoward incidents in mental health services Psychiatr. Bull., March 1, 2004; 28(3): 75 - 77. [Full Text] [PDF]
|
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||