Hostname: page-component-7c8c6479df-nwzlb Total loading time: 0 Render date: 2024-03-27T04:09:43.568Z Has data issue: false hasContentIssue false

Validation of a short instrument to measure stigmatised attitudes towards mental illness

Published online by Cambridge University Press:  02 January 2018

Jason Luty
Affiliation:
The Taylor Centre, Queensway House, Essex Street, Southend on Sea, Essex SS4 1RB, e-mail: s1006h3607@blueyonder.co.uk
Daniel Fekadu
Affiliation:
Maudsley Hospital, London
Okon Umoh
Affiliation:
Child and Family Service, Southend on Sea, Essex
John Gallagher
Affiliation:
The Taylor Centre, Southend on Sea, Essex
Rights & Permissions [Opens in a new window]

Abstract

Aims and Method

One of the steps to change stigmatised attitudes involves identifying the concerns of people whose attitude is to be changed. This paper presents the Attitudes to Mental Illness Questionnaire (AMIQ), a short instrument aimed at systematically obtaining this information, and examines the feasibility, test–retest reliability as well as face and construct validity of the AMIQ on the UK general public. A postal survey of a random sample of 1079 adults was conducted. A self-reported questionnaire with 5-point Likert scale responses was validated in response to short fictional vignettes. A second subsample of 256 was used for a reliability test.

Results

The AMIQ is a short instrument with good psychometric properties. It shows good stability, test–retest reliability, alternative test reliability, face, construct and criterion validity. The self-selecting sample of 1079 UK adults showed highly stigmatised attitudes to people with addictive disorders but more positive attitudes to those with depression or self-harm. Results from a smaller follow-up sample showed that attitudes towards people with alcohol dependence and schizophrenia were intermediate.

Clinical Implications

The AMIQ can be used in various medical and mental health stigma research and intervention settings.

Type
Original papers
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Royal College of Psychiatrists, 2006

Stigma is a social construction that devalues people as a result of a distinguishing characteristic or mark (Reference Biernat, Dovidio, Heatherton, Kleck and HebelBiernat & Dovidio, 2000). Many studies have shown that negative attitudes towards people with mental illness are widespread (Reference Crisp, Gelder and RixCrisp et al, 2000). Discrimination seems to exist in every area of life, particularly for those with psychosis and drug dependence; moreover the shame and secrecy associated with a mental illness may also delay seeking treatment (Reference ByrneByrne, 2000). Docherty (Reference Docherty1997) identifies stigma as a major barrier to the management of depression. This view is echoed by the influential Safer Services report (Reference ApplebyAppleby, 1999) in which stigma is seen as a major barrier to treatment-seeking and suicide prevention.

Action on Mental Health was published in 2004 by the UK Office of the Deputy Prime Minister. This publication provides 12 individual fact sheets designed to encourage best practice to reduce the stigma and social exclusion experienced by people with mental illness. This report supplements the efforts of the Royal College of Psychiatrists’ 5-year Changing Minds campaign whose aim was to promote positive images of mental illness, challenge misrepresentations and discrimination, encourage patient advocacy and educate the public about the real nature and treatability of mental disorder (Reference Crisp, Gelder and RixCrisp et al, 2000). Both campaigns give practical advice to health agencies, employers and a variety of stakeholders as to how to tackle stigma. However, there are currently no practical means of assessing the effectiveness of these measures other than direct interviews with target populations.

Practical steps to change stigmatised attitudes have been suggested. Knox et al (Reference Knox, Smith and Hereby2003) showed that training members of the US airforce in the recognition and treatment of mental illness significantly reduced the suicide rate (Reference Knox, Smith and HerebyKnox et al, 2003). A central component of this programme was addressing the stigmatised attitudes to mental illness. One stage of such a process involves identifying the concerns of people whose attitude is to be changed. The objective of the current study was to validate a short questionnaire that might then be used to assess the attitude of members of the general public towards people with mental illness. This questionnaire could also be used to target and measure the effectiveness of anti-stigma methods.

Method

The Attitudes to Mental Illness Questionnaire (AMIQ) was adapted from Cunningham et al (Reference Cunningham, Sobell and Chow1993). Pilot work was carried out by telephone with a series of general openended questions (n=20 interviewees). The final questionnaire was submitted to adults selected at random throughout the UK using advertisements in regional newspapers and by randomly selecting addresses on streets using the wildcard function of the British Telecom online directory. Four local newspaper syndicates involving several different publications were used from the north and north-west of England, south-east England and central Scotland with a potential readership estimated at 2 million people. Unfortunately, the sample was necessarily self-selecting.

In the first part of the study, respondents were asked to read a short vignette describing one of five imaginary individuals and then answer five questions (see Appendix). Three of the vignettes were chosen deliberately to produce a strongly negative or positive response to test the face validity of the questionnaire (see Discussion). Vignettes were presented in random order on the questionnaire. The individual questions were scored on a 5-point Likert scale (maximum +2, minimum –2) with blank questions, ‘ neutral’ and ‘don’t know’ being scored 0. The score for the five questions was added giving a total score for each vignette between –10 and +10. The vignettes are given in Table 1. A smaller follow-up study took place several months later and included questions on an imaginary person with schizophrenia and a person with alcohol dependency and included questions from Corrigan’s attributions questionnaire (Reference Corrigan, Markowitz and WatsonCorrigan et al, 2003). Non-parametric (Mann–Whitney and Wilcoxon) tests were used to compare differences in subgroups.

Table 1. Overall scores using the Attitudes to Mental Illness Questionnaire (AMIQ) in 879 randomly selected members of the UK public

Vignette Mean score (s.e.)
John has been injecting heroin daily for 1 year. -5.38 (0.53)
Tim is depressed and took a paracetamol overdose last month to try and hurt himself. 2.35 (0.10)
Steve has been drinking heavily for 5 years. He is now going for treatment and has started attending Alcoholics Anonymous meetings. -1.03 (0.34)1
Robert is a convicted criminal. He has spent time in prison for several convictions for theft and shoplifting and is currently on bail for fraud and burglary. -5.90 (0.11)
Peter has diabetes. He needs to inject insulin every day and has a special diet. 5.62 (0.12)
Michael has schizophrenia. He needs an injection of medication every 2 weeks. He was detained in hospital for several weeks 2 years ago because he was hearing voices from the Devil and thought that he had the power to cause earthquakes. He has been detained under the Mental Health Act 1983 in the past. -1.86 (0.27)2
Steve is a practising Christian. He attends church every Sunday and attempts to lead a Christian life. 5.86 (0.09)

Results

In total 1079 completed questionnaires were received. A further 37 questionnaires were received with more than half the responses being incomplete and these were disregarded. The mean age of respondents was 46.3 years (s.d.=15.7) with 55% of the participants in paid employment, 17% retired and 36% men. Factor analysis using principal component analysis with varimax rotation showed that one component accounted for 80.2% of the variance that involved significant contributions from all five questions – this factor might best be described as ‘stigmatisation’. Although three questions (1, 4 and 5) were based on other people’s expectations of a patient’s future and the other two questions assessed social distance, these factors could not be identified separately on factor analysis. The results indicate excellent construct validity. Follow-up questionnaires were sent to a sample of respondents after 2–4 weeks. Pearson’s correlation coefficient was 0.702 (n=256), indicating reasonable test–retest validity. The AMIQ was also compared with a 21-item attributions questionnaire that has been validated as a measure of stigmatised attitudes towards people with mental illness (Reference Corrigan, Markowitz and WatsonCorrigan et al, 2003). Fifty participants received the AMIQ and attributions questionnaire and were asked to complete both in relation to the schizophrenia vignette. The attribution questionnaire was scored from 0 to a maximum of 64 with a mean score of 38.7 (s.e.=1.8). Kendall’s tau b=0.563 (P<0.001) and Spearman’s rank correlation rho=0.704 (P<0.001) indicated good alternative test reliability.

Discussion

The 5-item AMIQ is a brief, self-completion questionnaire with good psychometric properties that can be used in most situations. Content validity and reliability is high, as indicated by Cronbach’s alpha score, factor analysis and test–retest correlation coefficients. Vignettes describing highly stigmatised individuals (such as a convicted criminal) produce consistently negative scores and those describing non-stigmatised individuals (a Christian and a diabetic) produce positive scores. This indicates good face validity. The correlation between the AMIQ and Corrigan’s attributions questionnaire was also good, indicating reasonable alternative test reliability. The results confirmed the widely reported observation that many people with mental illness (especially those with opiate addiction) are subjected to very negative and stigmatised views (Reference Erickson and GoodstadtErickson & Goodstadt, 1993; Reference ByrneByrne, 2000; Reference Luty and GrewalLuty & Grewal, 2002). However, a hypothetical patient with depression and self-harm was viewed more sympathetically than people who suffer from addictive disorders and schizophrenia.

The results were unusual among surveys of public attitude, as there was no significant difference in results between subgroups determined by gender, age (analysed using subgroups based on 10-year age intervals) or awareness of the Royal College of Psychiatrists’ anti-stigma Changing Minds campaign. The results were not affected by the media publicity concerning the detention of the boxer, Frank Bruno, on 23 September 2003 (at which point approximately 70 completed questionnaires had already been received).

Ritsher et al (Reference Ritsher, Otilingam and Grajales2003) have validated a 29-item self-completion instrument (the Internalized Stigma of Mental Illness scale) that can be used to determine the degree of stigma experienced by people with mental illness. However, it was not designed to determine the attitude of members of the general population towards people with mental illness. The Community Attitudes Towards Mental Illness scale is widely used to assess attitudes towards various aspects of mental illness although, once again, this instrument is interviewer-rated (Reference Taylor, Dear and HallTaylor et al, 1979). Other instruments have been used to measure stigmatised attitudes within the general population, although few have been fully validated. Pinfold et al (Reference Pinfold, Toulmin and Thornicroft2003) reported the use of a questionnaire including four factual and five attitudinal statements, which can be scored using a Likert response, in 472 secondary school children. Students attended two 1-h mental health awareness workshops. Overall, there was a small but positive shift in students’ understanding of mental illness. Unfortunately, the questionnaire used in this study referred only to ‘ people with mental illness’. This could not be used to compare attitudes towards those with mental illness with attitudes towards other groups such as people without mental illness. Crisp et al (Reference Crisp, Gelder and Rix2000) reported a survey of 1737 adults throughout the UK. Although attitudes were scored using a 5-point Likert scale, this report used interview questionnaires that are too costly and cumbersome for routine use. Some researchers have used questionnaires with a ‘most people would say…’ approach (Reference Link, Cullen and StrueningLink et al, 1989). We chose to develop a short questionnaire to assess what an individual themself believes. However, it is possible that many respondents are likely to give their estimate of general public opinion rather than their own view, particularly in response to issues to which they may be ambivalent.

Some limitations should be acknowledged. Unfortunately, it was not possible to distinguish between respondents recruited by newspaper advertisements and those recruited directly from the postal survey. The large circulation of the newspapers also precludes any estimate of the overall response rate. Clearly, only a small proportion of the residents from households who subscribe to a particular newspaper or who received mailshots were likely to respond to the survey and it is thus self-selecting. However, the age and employment status of the participants were reasonably matched to those from census surveys, although there was an excess of women respondents. Subgroup analysis showed no significant difference in response according to gender. These results suggest that the sample provides an acceptable view of the attitudes of British adults as far as can be reasonably expected in surveys of this nature. In the ideal situation, interviews would be conducted using a quota-survey of households, with repeat visits for non-responders (Reference Crisp, Gelder and RixCrisp et al, 2000). Unfortunately, this procedure is prohibitively expensive. An alternative is to use organisations of professional interviewers, such as the Market and Opinion Research Institute (MORI) or Gallup, who canvass members of the general public. However, these samples are also self-selecting as interviewers tend to approach passers-by at preferred public places (Reference OppenheimOppenheim, 1992). As a further example, a recent MORI poll of the ‘trustworthy professions’ was commissioned by the British Medical Association and reported results from ‘a representative quota sample’ of 2017 UK adults (http://www.mori.com/polls/2005/bma.shtml). Although canvassers were given lists of addresses to approach at sites likely to be representative of the community as a whole, canvassers were only expected to obtain interviews from a minority of households within each area. The majority of people approached at the selected households declined or were unavailable.

The AMIQ was validated against in-depth unstructured pilot interviews by the authors and the original questionnaire described by Cunningham et al (Reference Cunningham, Sobell and Chow1993). However, the limited resources meant that it was not practical to validate the questionnaire against a large number of face-to-face interviews. There is an extensive body of work on stigma in social psychology. However, there remains no agreed gold standard interview against which to validate a stigma questionnaire. The Opinions About Mental Illness questionnaire is a widely used self-completion instrument used to measure stigmatised attitudes towards mental illness (Reference Struening and CohenStruening & Cohen, 1963). The 51-item scale was developed by factor analysis and measures attitudes towards the causes and treatment of mental illness rather than attitudes towards people with mental illness (Reference Link, Yang and PhelanLink et al, 2004). Hence the AMIQ was validated against Corrigan’s attributions questionnaire that has been specifically validated to assess people’s attitudes towards patients with mental illness. It is hoped that the AMIQ will be useful to other workers to assess stigmatised attitudes in target populations or in other representative surveys.

Appendix

Attitudes to Mental Illness Questionnaire (AMIQ)

Please read the following statement: John has been injecting heroin daily for 1 year. Please underline the answer which best reflects your views:

  1. 1. Do you think that this would damage John’s career? Strongly agree–2/Agree–1/Neutral0/Disagree+1/Strongly disagree+2/Don’t know0

  2. 2. I would be comfortable if John was my colleague at work?

    Strongly agree+2/Agree+1/Neutral0/Disagree–1/Strongly disagree–2/Don’t know0

  3. 3. I would be comfortable about inviting John to a dinner party?

    Strongly agree+2/Agree+1/Neutral0/Disagree–1/Strongly disagree–2/Don’t know0

  4. 4. How likely do you think it wouldbe for John’s wife to leave him?

    Very likely–2/Quite likely–1/Neutral0/Unlikely+1/Very unlikely+2/Don’t know0

  5. 5. How likely do you think it would be for John to get in trouble with the law?

    Very likely–2/Quite likely–1/Neutral0/Unlikely+1/Very unlikely+2/Don’t know0

Acknowledgement

The research was supported by British Academy grant no. SG-35479.

References

Appleby, L. (1999) Safer Services. London: Department of Health.Google Scholar
Biernat, M. & Dovidio, J. F. (2000) Stigma and stereotypes. In The Social Psychology of Stigma (eds Heatherton, T. F., Kleck, R. E. & Hebel, M. R.), pp. 88125. New York: Guilford Press.Google Scholar
Byrne, P. (2000) Stigma of mental illness and ways of diminishing it. Advances in Psychiatric Treatment, 6, 6572.CrossRefGoogle Scholar
Corrigan, P., Markowitz, F. E., Watson, A., et al (2003) An attribution model of public discrimination towards people with mental illness. Journal of Health and Social Behaviour, 44, 162179.CrossRefGoogle Scholar
Crisp, A. H., Gelder, M. G., Rix, S., et al (2000) Stigmatisation of people with mental illnesses. British Journal of Psychiatry, 177, 47.CrossRefGoogle ScholarPubMed
Cunningham, J. A., Sobell, L. C. & Chow, V. M. C. (1993) What's in a label? The effects of substance types and labels on treatment considerations and stigma. Journal of Studies on Alcohol, 54, 693699.CrossRefGoogle Scholar
Docherty, J. B. (1997) Barriers to the diagnosis of depression in primary care. Journal of Clinical Psychiatry, 58, 510.Google Scholar
Erickson, P. G. & Goodstadt, M. S. (1993) Legal stigma for marijuana possession. Criminology, 17, 208216.CrossRefGoogle Scholar
Knox, T., Smith, J. & Hereby, H. (2003) Risk of suicide and related adverse outcomes after exposure to a suicide prevention programme in the US air force: cohort study. BMJ, 327, 13761378.CrossRefGoogle ScholarPubMed
Link, B. G., Cullen, F.T., Struening, E. L., et al (1989) A modified labelling theory approach to mental disorder: an empirical assessment. American Sociological Review, 54, 400423.CrossRefGoogle Scholar
Link, B. G., Yang, L. H., Phelan, J. C., et al (2004) Measuring mental illness stigma. Schizophrenia Bulletin, 30, 511541.CrossRefGoogle ScholarPubMed
Luty, J. S. & Grewal, P. (2002) A survey of British public's attitudes towards drug dependence. Journal of Substance Use, 7, 9395.CrossRefGoogle Scholar
Office of the Deputy Primeminister (2004) Action on Mental Health – A Guide to Promoting Social Inclusion. http://www.socialexclusion.gov.uk/page.asp?id=257 Google Scholar
Oppenheim, A. N. (1992) Questionnaire, Design, Interviewing and Attitude Measurement. London: Continuum.Google Scholar
Pinfold, V., Toulmin, H., Thornicroft, G., et al (2003) Reducing psychiatric stigma and discrimination: evaluation of educational interventions in UK secondary schools. British Journal of Psychiatry, 182, 342346.CrossRefGoogle ScholarPubMed
Ritsher, J. B., Otilingam, P. G. & Grajales, M. (2003) Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Research, 121, 3149.CrossRefGoogle ScholarPubMed
Struening, E. L. & Cohen, J. (1963) Factor invariance and other psychometric characteristics of five opinions about mental illness factors. Educational and Psychological Measurements, 23, 289298.CrossRefGoogle Scholar
Taylor, S. M., Dear, M. J. & Hall, G. B. (1979) Attitudes towards the mentally ill and reactions to mental health facilities. Social Science and Medicine, 130, 281290.Google Scholar
Figure 0

Table 1. Overall scores using the Attitudes to Mental Illness Questionnaire (AMIQ) in 879 randomly selected members of the UK public

Submit a response

eLetters

No eLetters have been published for this article.