- Study protocol
- Open Access
- Open Peer Review
Needs-oriented discharge planning and monitoring for high utilisers of psychiatric services (NODPAM): Design and methods
© Puschner et al; licensee BioMed Central Ltd. 2008
- Received: 01 July 2008
- Accepted: 21 July 2008
- Published: 21 July 2008
Attempts to reduce high utilisation of psychiatric inpatient care by targeting the critical time of hospital discharge have been rare.
This paper presents design and methods of the study "Effectiveness and Cost-Effectiveness of Needs-Oriented Discharge Planning and Monitoring for High Utilisers of Psychiatric Services" (NODPAM), a multicentre RCT conducted in five psychiatric hospitals in Germany. Inclusion criteria are receipt of inpatient psychiatric care, adult age, diagnosis of schizophrenia or affective disorder, defined high utilisation of psychiatric care during two years prior to the current admission, and given informed consent. Consecutive recruitment started in April 2006. Since then, during a period of 18 months, comprehensive outcome data of 490 participants is being collected at baseline and during three follow-up measurement points.
The manualised intervention applies principles of needs-led care and focuses on the inpatient-outpatient transition. A trained intervention worker provides two intervention sessions: (a) Discharge planning: Just before discharge with the patient and responsible clinician at the inpatient service; (b) Monitoring: Three months after discharge with the patient and outpatient clinician. A written treatment plan is signed by all participants after each session.
Primary endpoints are whether participants in the intervention group will show fewer hospital days and readmissions to hospital. Secondary endpoints are better compliance with aftercare, better clinical outcome and quality of life, as well as cost-effectiveness and cost-utility.
If a needs-oriented discharge planning and monitoring proves to be successful in this RCT, a tool will be at hand to improve patient outcome and reduce costs via harmonising fragmented mental health service provision.
- Intervention Session
- High Utiliser
- German Version
- Psychiatric Service
- Coordinate Centre
Large numbers of psychiatric patients do not receive aftercare in the community during the period immediately following hospital discharge. The average rate of utilisation of aftercare is about 50%, with a wide range between 22 and 90% depending on the definition of aftercare [1–3]. More specifically, one third to one half of patients with schizophrenia and related disorders miss their first scheduled outpatient appointment after discharge . In addition, for those who receive follow-up, the delay between discharge and receipt of aftercare (operationalised as first outpatient visit) has been found to be substantial [1, 5]. Thus, limited continuity of service provision is pervasive, and time lags arising in this process have been found to increase the probability of relapse and to negatively affect patients' quality of life .
There have been some research efforts aimed at identifying the causes for this failure to utilise psychiatric services (for an overview see ). Results based on patient variables have been mostly negative, while service system variables, e.g. availability of discharge planning, have been found to facilitate access to aftercare. There is some evidence suggesting that patients who receive discharge planning are more likely to utilise outpatient mental health services and are less prone to become socially isolated and require rehospitalisation. Thus, in a sample of N = 104 inpatients with schizophrenia or schizoaffective disorder, Olfson et al.  found that those who had received discharge planning showed significantly better aftercare compliance (98.1 vs. 62.7%), fewer rehospitalisations (40% reduction), and better clinical outcome (34.5 vs. 41.0 BPRS-points, ES = .57) at three-month follow-up. Furthermore, in a sample of 229 inpatients with a primary psychiatric diagnosis, Boyer et al.  found that patients were significantly more likely to keep their initial outpatient appointment if they were involved in the outpatient programme before discharge (OR = 2.14 – 3.89) or if the discharge plan was discussed between inpatient staff and outpatient clinicians (OR = 3.17).
It appears that rather simple measures – such as timely face-to-face contact of the inpatient with the follow-up outpatient therapist(s) and/or smooth transition between in- and outpatient treatment – are likely to bring about an increase in successful community tenure. Also a time-limited critical time intervention [6, 7] has been shown to yield clinical improvement. The impact of extensive strategies such as case management or the introduction of discharge coordinators, on the other hand, has been limited or controversial.
Nonetheless, the use of bridging strategies in routine practice is idiosyncratic at best. Boyer et al.  showed that while discussions between in- and outpatient teams regarding the arrangement of aftercare occur rather frequently (in two thirds of the cases), patient involvement with outpatient programmes while they are still in hospital is less common.
Since the 1980s considerable research effort has been devoted to high utilisation (HU) of psychiatric services. According to Hadley et al. , "the concept of 'heavy use' typically applies to those persons whose frequency of admission or duration of inpatient service is substantially beyond that of the majority of persons receiving similar treatment" (p. 280). Two extensive literature reviews on the topic (Kent et al. : 200 publications identified, 72 described; Roick et al. : 250 publications identified, 105 described) showed that overall, 10 – 30% of psychiatric patients are identified as high utilisers who consume between 50 and 80% of service resources.
Study instruments by raters and measurement points.
Objectives and purpose of the study
Objective of the study is to test the following hypotheses.
High utilisers of psychiatric services who receive a needs-oriented discharge planning and monitoring programme will show fewer hospital days and readmissions to hospital.
Subjects receiving the intervention will show better compliance with aftercare as well as better clinical outcome and quality of life. Furthermore, the intervention will show cost-effectiveness and cost-utility, and community-based psychiatrists whose patients receive the new discharge protocol will show better compliance with treatment recommendations.
A clinical trial entitled "Effectiveness and Cost-Effectiveness of Needs-Oriented Discharge Planning and Monitoring for High Utilisers of Psychiatric Services" (NODPAM) will be conducted. Coordinating centre (CC) is Ulm University's Department of Psychiatry II (Günzburg). Participating centres are the Departments of Psychiatry and Psychotherapy at the Universities of Düsseldorf, Greifswald, and Regensburg, and Ulm University's Department of Psychiatry I (Ravensburg). This paper describes design and methods of the NODPAM trial as outlined in the trial protocol which has been submitted to the funding body (German Research Foundation) on July 15, 2005 after having attended to the funders' and independent reviewers' comments on the original proposal and its revision. Before the start of recruitment in April 2006, minor changes have been applied1.
A central randomisation procedure will be conducted by an independent unit (Ulm University's Institute for Biometrics). Stratification will be applied since we will conduct a multicentre trial, and, furthermore, since the intervention might have different effects as to diagnostic criteria, gender, and chronicity. In order to ensure an adequate distribution of patients with regard to these aspects, strata will be centre (five centres), primary diagnosis (ICD-10 Chapter V codes F20 – F29 vs. F30 – F39), gender (male vs. female) and chronicity (shorter vs. equal to or longer than three years). If during recruitment a patient fulfils inclusion criteria and has given informed consent, a fax will be sent to the randomisation centre which will perform randomisation, generate a patient code, and send it back to the study centre.
Cluster randomisation (at the clinician level) will not be employed since it would severely disrupt clinical routine and might result in undesired between-centre effects. Furthermore, in many wards of the participating services, only one clinician is present. Moreover, cross-contamination among inpatient clinicians is not to be expected since the intervention is low profile, restricted to one pre-discharge session, and will be carried out by a research worker with limited clinician involvement.
Due to the nature of the intervention, patients, clinicians, and intervention workers cannot be blinded to patient allocation. The natural flow of the study will also prevent the research worker from being blinded. Furthermore, blinding to patient allocation and centre affiliation of principal and responsible investigators as well as of the person performing randomisation is considered neither feasible nor necessary because no related bias is expected, and a blinded intermediate risk assessment, e.g. in order to identify excess mortality of participants as could be the case with invasive interventions or acutely critical conditions, is not required.
Inclusion and exclusion criteria
Psychiatric inpatients between 18–65 years with a primary diagnosis of schizophrenia, bipolar affective disorder, or major depression (ICD-10 Chapter V codes F20 – F29 or F30 – F39). Furthermore, subjects have to be identified as high utilisers of psychiatric inpatient care. In order to avoid misclassification, a two-fold criterion consisting of number of hospitalisations and cumulative LOS prior to the index admission will be applied; a subject will be included for participation if he or she, during a 24-month-period prior to admission: a) has been psychiatrically hospitalised at least twice with a cumulative LOS exceeding 30 days or b) has been psychiatric hospitalised at least once with a cumulative psychiatric LOS of more than 50 days. This criterion is in accordance with existing evidence and is also more comprehensive than the one suggested for psychiatric inpatient care in Germany by Roick et al.  who, regardless of LOS, categorised patients as high utilisers who, during a 30-month period, had had more than three admissions.
(a) Primary diagnosis of substance abuse; (b) Presence of moderate or severe mental handicap (learning disability) or organic mental disorder; (c) Current treatment by forensic psychiatric services; (d) Insufficient command of the German language in order to receive the intervention, take part in the assessment interviews, and complete patient questionnaires; (e) Lacking capacity to give valid consent to participate; (f) Foreseeable inpatient or day care mental health treatment (including rehabilitation) extending seven days after discharge from psychiatric inpatient treatment.
Assessment will take place at baseline and three (3, 6 and 18 months) follow-up measurement points in each participating centre (see Figure 1). Patients will receive a remuneration of 30 € for each assessment. Secondary outcomes will be provided by independent raters (research workers trained in study instrument use), clinicians, and patients. See Table 1 for an overview of the instruments used.
Rater perspective (T0 – T3)
Cumulated LOS and number of readmissions during the study period (primary outcomes) will be assessed by a research worker at T1 – T3 via the German version of the "Client Sociodemographic and Service Receipt Inventory" (CSSRI-EU). This is a standardised instrument for the comprehensive assessment of mental health service use and costs  of which a German version is available . It provides detailed information on direct (e.g. hospital in-patient days, out-patient/day care attendances, community-based service contacts, medication profile) and indirect (e.g. days of work loss, state benefits, source/level of income) costs and has been used in a number of German studies2.
Assessment of needs will be carried out with the German version of the "Camberwell Assessment of Need – European Version" (CAN-EU ), an interviewer-administered instrument comprising 22 individual domains of need. Staff and user ratings can be obtained; we administered only the user rating. Psychopathology will be assessed using the "Brief Psychiatric Rating Scale" (BPRS ) which is a standardised instrument for the assessment of psychopathological symptoms. Depression will be tapped into using the "Hamilton Depression Scale" (HAM-D ). Quality of life will be measured via a) the "Manchester Short Assessment of Quality of Life" (MANSA ) which is a disease specific instrument for the multidimensional assessment of objective and subjective quality of life in persons with severe mental illness and b) the EuroQol group's EQ-5D, a generic quality of life assessment instrument which has been developed for the computation of quality adjusted life years (QALYs) and whose psychometric properties and applicability in persons with severe mental illness have been tested .
Clinician perspective (T0 [inpatient clinician] and T1 [outpatient clinician])
Psychosocial functioning will be rated via the "Global Assessment of Functioning Scale" (GAF ) which has been shown to be a practical and valid instrument in psychiatric research . Overall psychological impairment will be tapped into via the "Clinical Global Impression Scale" (CGI ). Therapeutic relationship (clinicians' point of view) will be assessed using a retranslated German version of the "Scale to assess the therapeutic relationship in community mental health care" clinician scale (STAR-C ).
Satisfaction with therapeutic work in the ambulatory setting (T1 only) will be covered with a self-developed scale (ZUF-THERA ) consisting of six rephrased items of the ZUF-8 , the German version of the "Client Satisfaction Questionnaire" (CSQ ). The items were rephrased in that way that outpatient clinicians could give an evaluation of the quality of the given treatment. Satisfaction with discharge planning (T1 and intervention group only) will be assessed with a self-developed nine item rating scale.
Patient perspective (T0 – T3)
Psychological impairment will be measured using the German version  of Derogatis'  "Symptom-Check-List" (SCL-90-R), a widely used and validated self-report scale. Therapeutic relationship (patients' point of view) will be assessed using the "Scale to assess the therapeutic relationship in community mental health care" patient scale (STAR-P ). Satisfaction with outpatient treatment (T1 only) will be covered for the outpatient setting with the German version (ZUF-8 ) of the "Client Satisfaction Questionnaire" (CSQ ). Satisfaction with discharge planning (T1 and intervention group only) will be assessed with a self-developed eight item rating scale.
Power calculation for a panel study with four points of assessment was based on the approach suggested by Hedeker et al. . For a high utiliser population, previous research  found mean number of inpatient days during 12 months after discharge to be 47 (SD = 83) days (projected mean number for 18 months = 71 days). Based on existing studies, the mean reduction of inpatient days due to the planned intervention was assumed to be 40%. A small effect size (0.2 SD) should be detected with a power of 0.80 at a two-tailed significance level of 0.05. Panel attrition was estimated 10% at each measurement point. With regard to data analysis, a constant group effect over time with a random-effect structure and auto-correlated results was expected. A baseline sample size of 242 participants in each group was calculated to be sufficient.
Accordingly, after rounding to no decimals, a total sample size of 490 participants (N = 98 at each site) will be included in the study. Participants will be randomly assigned to the intervention (N = 245, N = 49 per site) or control group (N = 245, N = 49 per site).
For the intervention group, an intervention worker will provide a coherent package of needs-oriented discharge planning and monitoring focusing on the care process. The NODPAM intervention will apply principles of needs-led care (e.g. ) and focus on the inpatient-outpatient transition, with the intervention worker emphasising continuity of the care process vis-à-vis both patient and clinicians (e.g. ). The intervention worker will provide (and patients will be actively involved in) two manualised intervention sessions (each of about 45 minutes duration, see Figure 1, lower part):
Pre-discharge intervention session
The intervention worker obtains the relevant information of patients' met and unmet needs in a basic plan (results of the CAN rating) from the research worker. The first joint (pre-discharge) intervention session in general takes place seven days prior to hospital discharge with the following people participating: in-patient clinician, patient and carers if the patient wants to. There is a guided discussion of the critical domains of need identified on the basis of CAN ratings which require both current and post-discharge measures and/or interventions. The handwritten draft of the post-discharge treatment plan contains every addressed need with a precise problem definition, objectives, time-frame regarding goal attainment and persons responsible for the implementation. The treatment plan is signed by all participants. A typed version of the pre-discharge treatment plan will be sent to the outpatient clinician and the patient, and the accompanying letter will include the advice to discuss the plan and monitor its progress during every contact between them. The inpatient clinician is remunerated with CME credit points for each NODAPM intervention session and with a book voucher worth 50 € (once).
Post-discharge intervention session
Three months after discharge, the intervention worker arranges a second (post-discharge) intervention session including all stakeholders involved in the outpatient treatment phase: outpatient clinician, patient and relatives if the patient wants them to be present. Initially, a written protocol is drafted to summarise critical domains of need from the first session, their development since discharge, and the current CAN ratings (at 3-month follow-up). Participants are asked if they can name reasons for change (improvement or deterioration) or stability of ratings in the related domains.
Subsequently, a revised version of the pre-discharge treatment plan is developed on the basis of current met and unmet needs and signed by all participants. A typed version of the plan will be sent to the outpatient clinician and the patient with the advice that the plan should be continuously integrated in outpatient treatment, i. e. discussed and monitored during every contact between the outpatient clinician and patient for a period of at least three months. The outpatient clinician in private practice is remunerated with CME credit points and 100 € for each NODPAM intervention session.
The primary endpoints will be derived from the difference in LOS and number of hospitalisations between T0 and T1, T2, and T3. The secondary endpoints will be calculated from the differences in sum (or – if applicable – subscale) scores of the secondary outcome measures between T0 and T1, T2, and T3. Multiple measurement points have been chosen in order to scrutinise the intervention's effect over time, especially the question of whether short- and mid-term effects would persist.
Analyses will start once baseline data have been collected and cleaned. Descriptives of all outcome measures will be produced, and outcome trajectories from T0 – T3 will be examined via exploratory analyses. The effect of the intervention on reduction of number of inpatient days as well as on clinical outcomes, quality of life, and compliance will be tested by means of random-effect regression models including a constant group effect across time [35–37]. Due to the application of a generalised least square (GLS) estimation weighted for the lengths of the time series for each case, these models allow the inclusion of cases with incomplete (unbalanced) data across panels. Due to expected skewness of the primary dependent variable (LOS), bootstrapping methods will be applied for the estimation of standard errors and confidence intervals. Cost-effectiveness of intervention will be tested by means of the net-benefit approach , and its cost-utility by using QALYs generated from EQ-5D.
Analysis will be carried out according to the principle of intention-to-treat. In case attrition should exceed the projected rate of 10%, additional per-protocol analysis will be performed.
Data monitoring and safety
All trial data will be stored safely at the participating centres. The CC is responsible for the merging of the data from the centres and – after data cleaning – redistributing it to the centres for analysis.
Data Monitoring will be carried out by persons independent of trial conduct. Before start of data collection, each participating centre will name a person responsible for data entry and monitoring to the CC. The following monitoring strategy will be adhered to.
Monitoring of patient recruitment, data collection and application of the intervention
Study visits and regular telephone conferences will allow for a 100% check of essential trial parameters. In particular, the CC will see to that: (a) All informed consent forms which have been signed by patients are complete and safely stored at the participating centres; (b) Every participating patient meets inclusion criteria; (c) Both the intervention and assessment of outcome criteria, in each individual patient, are carried out according to the trial protocol and intervention manual. In addition, before start of recruitment, trial staff responsible for data collection and application of the intervention will be trained in the use of study instruments at the CC, also by external experts if applicable. As the study progresses, adherence to instrument and intervention manuals will be continuously monitored and training refreshed if necessary, especially in case of staff changes.
Monitoring of flow and quality of data
At each centre, data will be entered via identical templates programmed by CC staff using EpiData http://www.epidata.dk/, a reliable software for entering and documenting data allowing for e.g. the definition of out-of-range and outlier data as well as logic checks; (b) After data entry, centres will send copies of data files and completed questionnaires to the CC which will carry out: (i) Review: 10% of the data will be entered again by the CC and subsequently compared with the data in the files received from the participating centres. In case of major differences, proportion of the reviewed data will be increased; (ii) Query: In case of mismatch, the CC will contact the respective participating centre in order to correct data problems. Results of these queries will be communicated to the group.
Furthermore, a trial steering committee (TSC) was established in its function as an independent board of members to provide overall supervision and protection for the trial participants and the principal investigators. In view of the non-invasive intervention, the risk for participating patients is considered marginal. Should, for any unforeseeable reason, the intervention or data collection place a burden on a given participant and should at the same time he or she be unwilling to terminate participation, the research worker and/or intervention worker are required to report this to the TSC who will then decide on whether or not the participant will have to be excluded. Such instances will be documented thoroughly.
The advisory board, the TSC and Ulm University Hospital will be continuously informed of study progress including data quality issues.
Patient confidentiality will be strictly maintained, i.e. by no means will publications contain person-related information. However, the conduct of a longitudinal trial requires patient follow-up. Thus, study participants' personal data (e.g. names and addresses) will be recorded for the duration of the trial. Patient ID data will be stored safely and kept separate from the data set used for analyses.
In the course of recruitment, the research worker will devote special attention to providing the patients with detailed information on the trial so they have a sound basis on which to decide on informed consent. It will be made clear to the patient that he or she can withdraw consent at any time during the course of the study without any consequences. In case the patient is under legal custody, the custodian's consent does not suffice. All participating centres' ethics committees will have issued positive votes on NODPAM before the start of the study.
There is broad consensus that relapse prevention is one of the major aims of aftercare. However, the success of attempts to reduce high re-hospitalisation rates in people suffering from severe mental disorders has been limited so far. Insufficient discharge planning and follow-up is considered one of the main reasons for limited community tenure and unfavourable clinical outcomes. Only a small number of RCTs have been conducted to test this assumption.
Literature reviews conclude that specific interventions targeting the needs of high utilisers and subsequently preventing unnecessary high service use should be developed and evaluated as to their use for patients and clinicians [9, 10, 39].
Furthermore, taking into account the finding that health service costs make up 76% of the total costs, and that 59% of these are inpatient costs , any intervention that is effective in reducing the heavy inpatient bed use of heavy users should have a substantial effect on the total service costs [12, 38]. Since service use patterns of high utilisers appear to depend on service system rather than on individual patient variables , it has been specifically recommended to identify gaps in current service provision , and – as outlined above – discharge from psychiatric hospital obviously can be considered such a gap, particularly in fragmented service systems such as the German one.
If this needs-oriented discharge planning and monitoring intervention proves to be successful in this RCT, a tool will be at hand (a) to harmonise fragmented service provision, i.e. improve collaboration of in- and outpatient services and continuity of care; (b) to improve community tenure, clinical impairment, and quality of life; and (c) to reduce unnecessary inpatient treatment costs.
1 These were: (a) Randomisation strata: Originally planned strata were centre, primary diagnosis, and GAF score at admission. GAF score at admission was replaced by gender and illness duration. (b) Original exclusion criterion was only that subjects with a primary diagnosis of substance abuse will be excluded. (c) Originally the Helping Alliance Questionnaire (HAQ) was intended to be used for the assessment of the quality of the therapeutic relationship (changed to STAR); (e) Application of instruments to assess treatment satisfaction (ZUF-8 and ZUF-THERA) and satisfaction with discharge planning; (d) Specification of details on amount and kind of clinician remuneration.
2 The CSSRI-EU also serves to assess necessary information pertaining to SES (work, financial and living situation) and service utilisation beyond inpatient care. Furthermore, basic patient data will be available via the "BADO" which has been implemented at all participating centres.
This study is supported by a grant from the German Research Foundation (DFG) in the Special Programme "Clinical Studies" (Grant number BE 2502/3-1). We are grateful to the responsible investigators at the participating centres – Birgit Janssen (Düsseldorf), Carsten Spitzer (Greifswald), Hermann Spießl (Regensburg), and Jan Bergk (Ulm/Ravensburg) – as well as to the NODPAM advisory board, especially to Mike Slade (Institute of Psychiatry, King's College London), for their substantial contributions during the preparation of NODPAM. We also thank Annette Schmidtmann at German Research Foundation (DFG) and the anonymous reviewers for their significant suggestions.
- Boyer CA, McAlpine DD, Pottick KJ, Olfson M: Identifying risk factors and key strategies in linkage to outpatient psychiatric care. Am J Psychiatr. 2000, 157: 1592-1598. 10.1176/appi.ajp.157.10.1592.View ArticlePubMedGoogle Scholar
- Klinkenberg WD, Calsyn RJ: Predictors of receipt of aftercare and recidivism among persons with severe mental illness: A review. Psychiatr Serv. 1996, 47: 487-496.View ArticlePubMedGoogle Scholar
- Miner CR, Rosenthal RN, Hellerstein DJ, Muenz LR: Prediction of compliance with outpatient referral in patients with schizophrenia and psychoactive substance use disorders. Arch Gen Psychiat. 1997, 54: 706-712.View ArticlePubMedGoogle Scholar
- Saarento O, Oiesvold T, Sytema S, Gostas G, Kastrup M, Lonnerberg O, Muus S, Sandlund M, Hansson L: The Nordic Comparative Study on Sectorized Psychiatry: continuity of care related to characteristics of the psychiatric services and the patients. Soc Psychiatry Psychiatr Epidemiol. 1998, 33: 521-527. 10.1007/s001270050089.View ArticlePubMedGoogle Scholar
- Sytema S: Service utilization research: goals and prospects. Epidemiol Psichiatr Soc. 1997, 6: 127-136.View ArticlePubMedGoogle Scholar
- Olfson M, Mechanic D, Boyer CA, Hansell S: Linking inpatients with schizophrenia to outpatient care. Psychiatr Serv. 1998, 49: 911-917.View ArticlePubMedGoogle Scholar
- Hermann D, Opler L, Felix A, Valencia E, Wyatt RJ, Susser E: A critical time intervention with mentally ill homeless men: Impact on psychiatric symptoms. J Nerv Ment Dis. 2000, 188: 135-140. 10.1097/00005053-200003000-00002.View ArticleGoogle Scholar
- Hadley TR, Culhane D, McGurrin M: Identifying and tracking heavy users of acute psychiatric inpatient services. Adminin Pol Ment Health. 1992, 19: 279-290. 10.1007/BF00708320.View ArticleGoogle Scholar
- Kent S, Fogarty M, Yellowlees P: A review of studies of heavy users of psychiatric services. Psychiatr Serv. 1995, 46: 1247-1253.View ArticlePubMedGoogle Scholar
- Roick C, Gärtner A, Heider D, Angermeyer MC: Heavy User psychiatrischer Versorgungsdienste: Ein Überblick über den Stand der Forschung [Heavy users of psychiatric care: A review of the state of research]. Psychiat Prax. 2002, 29: 334-342. 10.1055/s-2002-34658.View ArticleGoogle Scholar
- Junghan UM: Das ungleiche Ausmass der Nutzung psychiatrischer Akutstationen: Eine wichtige Beobachtung für die gemeindepsychiatrische Versorgungsplanung [Disproportionate extent of use of psychiatric acute care: An important observation for planning community psychiatric services]. Schizophrenie Beiträge zu Forschung, Therapie und psychosozialem Management. 2000, 15: 24-34.Google Scholar
- Lucas B, Harrison-Read P, Tyrer P, Ray J, Shipley K, Hickman M, Patel A, Knapp M, Lowin A: Costs and characteristics of heavy inpatient service users in outer London. Int J Soc Psychiatry. 2001, 47: 63-74. 10.1177/002076400104700206.View ArticlePubMedGoogle Scholar
- Hadley TR, McGurrin MC, Pulice RT, Holohean EJ: Using fiscal data to identify heavy service users. Psychiatr Q. 1990, 61: 41-48. 10.1007/BF01065163.View ArticlePubMedGoogle Scholar
- Lang FH, Forbes JF, Murray GD, Johnstone EC: Service provision for people with schizophrenia: I. Clinical and economical perspective. Br J Psychiatry. 1997, 171: 159-164.View ArticlePubMedGoogle Scholar
- Roick C, Heider D, Angermeyer MC: Entwicklung eines Screening-Instruments zur Identifikation von Patienten mit starker Inanspruchnahme stationär-psychiatrischer Versorgung [Development of a screening instrument for the identification of high utilisers of psychiatric inpatient care]. Fortschr Neurol Psychiat. 2003, 71: 378-386. 10.1055/s-2003-40563.View ArticlePubMedGoogle Scholar
- Chisholm D, Knapp M, Knudsen HC, Amaddeo F, Gaite L, van Wijngaarden B, the EPSILON study group: Client Sociodemographic and Service Receipt Inventory – European version. Br J Psychiatry. 2000, 177: 28-33. 10.1192/bjp.177.39.s28.View ArticleGoogle Scholar
- Roick C, Kilian R, Matschinger H, Mory C, Angermeyer MC: Die deutsche Version des Client Sociodemographic and Service Receipt Inventory: Ein Instrument zur Erfassung psychiatrischer Versorgungskosten [German adaptation of the client sociodemographic and service receipt inventory – an instrument for the cost of mental health care]. Psychiat Prax. 2001, 28: 84-90. 10.1055/s-2001-17790.View ArticleGoogle Scholar
- McCrone P, Leese M, Thornicroft G, Griffiths G, Padfield S, Schene A, Knudsen HC, Vazquez-Barquero JL, Lasalvia A, White IR: Reliability of the Camberwell Assessment of Need – European Version: EPSILON Study 6. Brit J Psychiatr. 2000, 177: 34-40. 10.1192/bjp.177.39.s34.View ArticleGoogle Scholar
- Lukoff D, Nuechterlein KH, Ventura J: Manual for expanded Brief Psychiatric Rating scale (BPRS). Schizophrenia Bull. 1986, 12: 594-602.Google Scholar
- Hamilton M: Development of a rating scale for primary depressive illness. Br J Soc Clin Psychol. 1967, 6: 278-296.View ArticlePubMedGoogle Scholar
- Priebe S, Huxley P, Knight S, Evans S: Application and results of the manchester short assessment of quality of life (MANSA). Int J Soc Psychiatr. 1999, 45: 7-12. 10.1177/002076409904500102.View ArticleGoogle Scholar
- Prieto L, Novick D, Sacristán JA, Edgell ET, Alonso J, on behalf of the SOHO Study Group: A rasch model analysis to test the cross-cultural validity of the EuroQoL-5D in the schizophrenia outpatient health outcome study. Acta Psychiatr Scand. 2003, 107: S24-S29. 10.1034/j.1600-0447.107.s416.6.x.View ArticleGoogle Scholar
- Saß H, Wittchen H-U, Zaudig M: Skala zur Globalbeurteilung des Funktionsniveaus für DSM-IV [Global Assessment of Functioning Scale]. Diagnostisches und Statistisches Manual psychischer Störungen. 1996, Göttingen: HogrefeGoogle Scholar
- Startup M, Jackson MC, Bendix S: The concurrent validity of the Global Assessment of Functioning (GAF). Brit J Clin Psychol. 2002, 41: 422.View ArticleGoogle Scholar
- Haro JM, Kamath SA, Ochoa S, Novick D, Rele K, Fargas A, Rodriguez MJ, Rele R, Orta J, Kharbeng A, Araya S, Gervin M, Alonso J, Mavreas V, Lavrentzou E, SOHO Study Group: The Clinical Global Impression-Schizophrenia scale: a simple instrument to measure the diversity of symptoms present in schizophrenia. Acta Psychiatr Scand. 2003, 416: 16-23. 10.1034/j.1600-0447.107.s416.5.x.View ArticleGoogle Scholar
- McGuire-Snieckus R, McCabe R, Catty J, Hansson L, Priebe S: A new scale to assess the therapeutic relationship in community mental health care: STAR. Psychol Med. 2006, 37: 85-95. 10.1017/S0033291706009299.View ArticlePubMedGoogle Scholar
- Puschner B, Bauer S, Kraft S, Kordy H: Zufriedenheit von Patienten und Therapeuten mit ambulanter Psychotherapie [Patient and therapist satisfaction in outpatient psychotherapy]. Psychother Psychosom Med Psychol. 2005, 55: 517-526. 10.1055/s-2005-867050.View ArticlePubMedGoogle Scholar
- Schmidt J, Lamprecht F, Wittmann WW: Zufriedenheit mit der stationären Versorgung: Entwicklung eines Fragebogens und erste Validitätsuntersuchungen [Satisfaction with inpatient management. Development of a questionnaire and initial validity studies]. Psychother Psychosom Med Psychol. 1989, 39: 248-255.PubMedGoogle Scholar
- Attkisson CC, Zwick R: The Client Satisfaction Questionnaire. Eval Program Plann. 1982, 5: 233-237. 10.1016/0149-7189(82)90074-X.View ArticlePubMedGoogle Scholar
- Franke GH: Die Symptom-Checkliste von Derogatis – Deutsche Version [Derogatis' Symptom Checklist – German version]. 1995, Göttingen: Beltz TestGoogle Scholar
- Derogatis LR: SCL-90-R: Self Report Symptom Inventory. Internationale Skalen für Psychiatrie. 1986, Edited by Collegium Internationale Psychiatriae Scalarum. Weinheim: BeltzGoogle Scholar
- Hedeker D, Gibbons RD, Waternaux C: Sample size estimation for longitudinal designs with attrition: comparing time-related contrasts between two groups. J Educ Behav Stat. 1999, 24: 70-93.View ArticleGoogle Scholar
- Kilian R, Matschinger H, Becker T, Angermeyer MC: A longitudinal analysis of the impact of social and clinical characteristics on the costs of schizophrenia treatment. Acta Psychiatr Scand. 2003, 107: 351-360. 10.1034/j.1600-0447.2003.00072.x.View ArticlePubMedGoogle Scholar
- Slade M, Leese M, Taylor R, Thornicroft G: The association between needs and quality of life in an epidemiologically representative sample of people with psychosis. Acta Psychiatr Scand. 1999, 100: 149-157. 10.1111/j.1600-0447.1999.tb10836.x.View ArticlePubMedGoogle Scholar
- Baltagi BH: Econometric analysis of panel data. 2001, Chichester, New York: John Wiley & SonsGoogle Scholar
- Raudenbush SW, Bryk AS: Hierarchical linear models: applications and data analysis methods. 2001, Newbury Park, CA: Sage, 2Google Scholar
- Wooldridge JM: Econometric Analysis of Cross Section and Panel Data. 2002, Cambridge: MIT PressGoogle Scholar
- Hoch JS, Briggs AH, Willan AR: Something old, something new, something borrowed, something blue: A framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ. 2002, 11: 415-430. 10.1002/hec.678.View ArticlePubMedGoogle Scholar
- Junghan UM: "Heavy Users": Probleme bei der Identifikation von Patienten mit überdurchschnittlicher Inanspruchnahme stationärer Akutversorgung [Heavy users: Problems in the identification of patients with disproportionate use of acute inpatient care]. Fortschritte in Psychiatrie und Psychotherapie. Interdisziplinäre und integrative Aspekte. Edited by: Konrad P. 2002, Wien: Springer, 161-175.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1472-6963/8/152/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.