The accuracy of the Italian version of the Hypomania Checklist (HCL-32) for the screening of bipolar disorders and comparison with the Mood Disorder Questionnaire (MDQ) in a clinical sample
© Carta et al; licensee BioMed Central Ltd. 2006
Received: 11 February 2006
Accepted: 08 March 2006
Published: 08 March 2006
The study measured the accuracy of the Italian version of the Hypomania Checklist (HCL-32) for self-assessment as a screening instrument for bipolar disorder (BPD) in a psychiatric setting and compared results with a previous study, carried out in a comparable sample and in the same setting, using the Mood Disorder Questionnaire (MDQ).
123 consecutive subjects attending a psychiatric division were screened for BPD using the Italian translation of the HCL-32, and diagnostically interviewed with the SCID by physicians. The sample of the previous study using the MDQ consisted of 154 subjects.
On the basis of the SCID: 26 received a diagnosis of bipolar/schizoaffective disorder, 57 were diagnosed as having at least another psychiatric disorder in Axis-I, whilst 40 were unaffected by any type of psychiatric disorder. Comparing the bipolar with all other patients the HCL-32 showed a good accuracy: cut-off 8: sensitivity 0.92-specificity 0.48; cut-off 10: sensitivity 0.88-specificity 0.54; cut-off 12: sensitivity 0.85-specificity 0.61. The accuracy for BPD-II (10) remains good: cut-off 8: sensitivity 0.90-specificity 0.42; cut-off 10: sensitivity 0.80-specificity 0.47; cut-off 12: sensitivity 0.80-specificity 0.54. The comparison with the MDQ performance shows that both screening tools may show good results, but HCL-32 seems to be more sensitive in detecting BPD-II.
Our results seem to indicate good accuracy of HCL-32 as a screening instrument for BPD in a psychiatric setting, with a low rate of false negatives, and a fairly good degree of identification of BPD-II.
Bipolar disorder is a recurring psychiatric condition, of chronic nature and highly invalidating. It is often under-diagnosed, thus delaying the administration of efficient treatments; it has been estimated that as many as one to two thirds of individuals with bipolar disorder do not receive appropriate treatment due to misdiagnosis . Particularly hypomania as an element of bipolar-II disorder is very often not experienced and recognized by the subject as pathological, therefore not reported to doctors and under-diagnosed in 25 to 50% of depressive patients .
Thus an easily administered screening instrument for self-assessment may be useful in clinical practice, particularly in settings in which a great number of medical patients are referred for psychiatric screening before medical treatments, such as interferon, hormone therapies with a burden of risk for psychiatric disorders.
The aim of the present study, carried out in a sample of psychiatric patients attending a mental health clinic, with an elevated proportion of patients coming from the general hospital for psychiatric evaluation, was to obtain a preliminary standardization of one Italian version of the HCL-32 as a screening instrument for bipolar disorders,  and to compare results with a previous study, carried out in a comparable sample and the same setting, using the Mood Disorder Questionnaire (MDQ) . The MDQ is a internationally recognized screening instrument for bipolar disorders [4–6] (Hirschfeld et al. 2000, 2003a, 2003b) that seems to be sensitive for identifying bipolar-I disorders but probably less so for bipolar disorders-II .
The study design consisted in the evaluation of the accuracy of one Italian version of HCL-32 , using the Structured Clinical Interview for DSM-IV Axis-I Disorders (SCID)  as a gold standard. The results were compared with the findings of a previous study, carried out in the same setting and with the same methodology, in which the Mood Disorder Questionnaire (MDQ) was applied.
The SCID was administered by physicians working in the field of psychiatry for at least three years, all of whom had undergone specific training for the use of the SCID.
Immediately prior to the interview all subjects had filled in the Italian version of the HCL-32. Written informed consent was obtained from all study participants. The questionnaire had been translated into Italian before the start of the research project, had been back-translated into English, and approval had been obtained from one of the authors of the original version.
A consecutive series of 123 subjects (41 males, mean age 36.6 ± 11.0 years; 81 females, mean age 37.9 ± 12.4 years) referred to the Division of Psychiatry of the University of Cagliari (Italy). The subjects were either (a) seeking psychiatric care, (b) had been referred by a general medical hospital for psychiatric evaluation before receiving medical treatments involving an elevated psychiatric risk (interferon, hormone therapy, etc.), or (c) were applying for legal certification of their mental capacities (for driving and/or gun licences, etc). The sample of the previous study using the MDQ consisted of 154 subjects (61 males, mean age 35.9 ± 12.3 years; 93 females, mean age 38.4 ± 12.5 years) also referred consecutively to the Division of Psychiatry of the University of Cagliari (Italy).
The HCL-32 is a self-administered paper and pencil inventory made up of 32 yes/no items used to identify the hypomanic component in patients with depressive episodes in order to help the clinician to diagnose bipolar-II and minor bipolar disorders in psychiatric and general medical practice . In order to help diagnose hypomania the instrument is designed to assess the personal and social role consequences of hypomanic symptoms. It also takes into account the subject's current overall affective status (low – as usual – high) as a potentially interfering variable in answering the questions. Several questions also have the potential to reveal the extent to which the patient has insight into his condition, which is important for treatment considerations .
We evaluated the discriminatory capacity (patients with a diagnosis of bipolar I or II disorder or schizoaffective bipolar type versus patients with other psychiatric diagnoses or with no psychiatric diagnosis, according to the findings of the SCID) of all 32 items of the HCL-32. A specific evaluation concerning the accuracy in detecting bipolar II disorders was also carried out.
The accuracy of the HCL-32 was calculated in terms of sensitivity and specificity for each theoretically possible cut-off point (number of positive answers). Overall performance of the scale was graphically assessed by means of the Receiver Operating Characteristic Analysis .
Psychiatric diagnoses in Axis-I formulated according to findings of the SCID semi-structured interview .
PSYCHIATRIC DIAGNOSES IN AXIS-I
Bipolar or Schizoaffective disorder
At least another 1 disorder in Axis-I
Best performing cut-off of HCL-32 and MDQ for bipolar II disorders.
Bipolar II disorders
The results of this study seem to indicate a fairly good performance of the HCL-32, at least from a preliminary point of view, in a specialist setting applying a traditional gold standard (SCID diagnoses).
Results confirm the preliminary validation conducted on an Italian and a Swedish sample where HCL-32 distinguished between bipolar and major depressive out-patients. That result was based on the hypothesis that DSM-IV criteria for hypomania are too strict . For this reason the previous study used a modified version of SCID with its diagnoses as the gold standard.
Our study used a naturalistic sample of patients referred to the Division of Psychiatry of the University of Cagliari (Italy) for psychiatric treatment or legal certification. The use of different cut-off points depends on the intended use of the scale. For two-stage investigations (in which it is important that "cases" are recognized during the screening phase because all positive cases will subsequently undergo clinical assessment), it is necessary to reduce the "false negatives" to a bare minimum. It is therefore preferable to use a very high sensitivity, even though this may prejudice the specificity. Cut-off point 4 of HCL-32 (sensitivity 0.90, specificity 0.58) would for example allow an accurate two-stage investigation to be carried out, whilst reducing interviews by more than 50%. It should moreover be taken into account that epidemiologic studies are performed in a specific setting (general population, general practitioners) where the proportion of psychiatric disorders is obviously lower than that observed in a clinical sample recruited from a University Division of Psychiatry. The latter would reasonably lead us to presume that the screening instrument would perform better. For a one-stage study in a general psychiatry setting the ideal cut-off point could be 12 (sensitivity 0.85, specificity 0.61). The latter is the nearest point to the 0.1 vertex of the ROC diagram. Indeed, this point represents the ideal screener (sensitivity 1, specificity 1). On the other hand, the area depicted by the curve beyond the diagonal of the diagram represents the area of validity of the screener. It should moreover be underlined that the HCL-32 is a simple and easy-to-use tool. The comparison with the MDQ performance shows that both screening tools may show good results, but HCL-32 seems to be more sensitive in detecting bipolar II disorders. Cut-offs with same sensitivity (0.80, at cut-off 4 for MDQ, and at cut-off 12 for HCL-32) show a better specificity for HCL-32 (0.45 for MDQ, 0.54 for HCL-32); cut-offs showing the same specificity (cut-off 5 for MDQ = 0.55 and cut-off 12 HCL-32 = 0.54) have better sensitivity for HCL-32 (0.80 versus 0.70).
An important problem is the recognition of bipolar-II disorders in patients with major depressive episodes; thus the HCL-32 for the self-assessment of hypomanic symptoms might be very helpful for identifying suspected and manifest cases of bipolar disorders.
Further studies are needed to verify the accuracy of this tool in non-psychiatric settings and in the general population.
R.Agabio, M.Aleffi, L.Bona, G.Casti, A.R.Collu, C.Contu, A.Garofalo, R.Girau, G.Intilla, F.A.Mannu, S.Massa, P.Marras, S.Medda, D.Mura, G.Mura, G.Pani, F.Pinna, E.Russino, C.Spada, D.Sitzia.
- Carta MG, Angst J: Epidemiological and clinical aspects of bipolar disorders: controversies or a common need to redefine the aims and methodological aspects of surveys. Clinical Practice and Epidemiology in Mental Health. 2005, 1: 4-10.1186/1745-0179-1-4.PubMed CentralView ArticlePubMedGoogle Scholar
- Angst J, Adolfsson R, Benazzi F, Gamma A, Hantouche E, Meyer TD, Skeppar P, Vieta E, Scott J: The HCL-32: towards a self-assessment tool for hypomanic symptoms in outpatients. Journal of Affective Disorders. 2005, 88: 217-233. 10.1016/j.jad.2005.05.011.View ArticlePubMedGoogle Scholar
- Hardoy MC, Carta MG, Cadeddu M, Murru A, Dell'Osso B, Morosini PL, Calabrese JR: Validation of the Italian version of the "Mood Disorder Questionnaire" for the screening of bipolar disorders. Clinical Practice and Epidemiology in Mental Health. 2005, 1: 8-10.1186/1745-0179-1-8.PubMed CentralView ArticlePubMedGoogle Scholar
- Hirschfeld RMA, Williams JBW, Spitzer RL, Calabrese JR, Flynn L, Keck PE, Lewis L, McElroy SL, Post RM, Rapport DJ, Russell JM, Sacks GS, Zajecka J: Development and validation of a screening instrument for bipolar spectrum disorder: the Mood Disorder Questionnaire. American Journal of Psychiatry. 2000, 157 (11): 1873-1875. 10.1176/appi.ajp.157.11.1873.View ArticlePubMedGoogle Scholar
- Hirschfeld RM, Holzer C, Calabrese JR, Weissman MM, Reed M, Davies MA, Frye MA, Keck PE, McElroy SL, Lewis L, Tierce J, Wagner KD, Hazard E: Validity of the Mood Disorder Questionnaire: a general population study. American Journal of Psychiatry. 2003, 160 (1): 178-180. 10.1176/appi.ajp.160.1.178.View ArticlePubMedGoogle Scholar
- Hirschfeld RMA, Calabrese JR, Weissman MM, Reed M, Davies MA, Frye MA, Keck PE, Lewis L, McElroy SL, McNulty JP, Wagner KD: Screening for bipolar disorder in the community. Journal of Clinical Psychiatry. 2003, 64 (1): 53-59.View ArticlePubMedGoogle Scholar
- Zimmerman M, Posternak MA, Chelminski I, Solomon DA: Using questionnaires to screen for psychiatric disorders: a comment on the study of screening for bipolar disorder in the community. Journal of Clinical Psychiatry. 2004, 65 (5): 605-610.View ArticlePubMedGoogle Scholar
- First MB, Spitzer RL, Gibbon M, Williams JBW: Structured Clinical Interview for DSM-IV Axis I Disorders, Clinician Version (SCID-CV). 1996, Washington DC: American Psychiatric Press IncGoogle Scholar
- American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV). 1994, Washington DC: American Psychiatric AssociationGoogle Scholar
- Sweet JA: Operating characteristic analysis. Psychology Science. 1975, 5: 990-1000.Google Scholar
- Akiskal HS, Bourgeois ML, Angst J, Post R, Moller H, Hirschfeld RM: Re-evaluating the prevalence of and diagnostic composition within the broad clinical spectrum of bipolar disorder. Journal of Affective Disorders. 2000, 59 (Suppl 1): S5-S30. 10.1016/S0165-0327(00)00203-2.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.