Abstract

Objective: Although national guidelines specify appropriate strategies for the treatment of schizophrenia, this disorder presents challenges to clinicians and health-care organizations. To improve care, it is useful to understand how often patients receive appropriate treatment. Most research evaluating treatment was performed when first-generation antipsychotic medications were the modal treatment. Given that most prescriptions are now for second-generation medications, this study describes current clinical problems and the appropriateness of treatment in routine practice. Method: Between 2002 and 2004, a random sample of patients (n = 398) were interviewed at baseline and 1 year at 3 Department of Veterans Affairs mental health clinics. Symptoms and side effects were assessed. Analyses examined whether prescribing were consistent with guidelines in patients with significant psychosis, depression, parkinsonism, akathisia, tardive dyskinesia, or elevated weight. Results: Few patients met criteria for depression, parkinsonism, or akathisia. A total of 44% of patients had significant psychosis, 11% had tardive dyskinesia, and 46% were overweight. Medication was appropriate in 27% of patients with psychosis, 25% of patients with tardive dyskinesia, and 2% of patients with elevated weight. Management of elevated weight improved modestly over time. Treatment was more likely to improve for patients whose psychiatrists had more than 12 patients with schizophrenia in their caseload. Conclusion: Compared with the 1990s, outpatients are more likely to have significant psychosis. The rate of appropriate treatment of psychosis is unchanged. Weight gain has become a prevalent side effect, yet treatment is rarely changed in response to weight. There is a need for interventions that improve management of psychosis and weight.

Introduction

Clinical research in schizophrenia has supported the development of national practice guidelines and treatment recommendations, including the American Psychiatric Association's (APA) Practice Guideline,1 the Schizophrenia Patient Outcomes Research Team (PORT) treatment recommendations,2 and the Texas Medication Algorithm Project.3 Appropriate medication management reduces relapse and hospitalization and improves functioning and quality of life.1,4 However, available medications have important side effects and may not fully control symptoms. Also, researchers have found large gaps between actual treatment and recommended medication practices.5 This problem with treatment “appropriateness” is widely acknowledged6; however, most research on the appropriateness of care was performed when the majority of prescriptions were for the first-generation antipsychotic medications. Although first- and second-generation medications have similar average efficacy (except for clozapine), they have very different side effect profiles.7,8 In clinical trials of second-generation agents, extrapyramidal side effects (EPS) are less common than with first-generation agents, while weight gain is more common.9 A very high proportion of new prescriptions are now for second-generation agents. It is not clear how the remarkable dissemination of this new medication class has affected the appropriateness of medication treatment, nor how this dissemination should change efforts to improve care.

In schizophrenia, medication prescribing and treatment appropriateness can be affected by a variety of organizational, clinician, and patient factors.10,11 Organizational factors can include formulary restrictions, lacking a clozapine clinic, or scheduling short patient visits during which psychiatrists do not have time to adequately discuss side effects or medication changes with patients.6 Clinician factors contributing to inappropriate care can include low levels of competence (ie, values, knowledge, skills) or inadequate assessment.12 Patient factors can include refusal to accept a recommended medication change or poor adherence with prescribed medications.13,14

Numerous studies have found that routine treatment for schizophrenia varies markedly from evidence-based recommendations.5 Most of this research has not included direct patient assessment and has instead relied on medical records. Because medical records in schizophrenia contain little reliable and valid information on clinical status,15 researchers have been unable to systematically assess the extent to which care is concordant with most treatment guidelines.16 By necessity, they have been limited to examining domains that can be measured with computerized data, such as the dosage of antipsychotic medications. In the 1990s, researchers found that about one-third of outpatients are prescribed medication within the recommended dosage range.17–19 The relevance of this approach to the second-generation agents is not clear because these agents lack many of the dose-related side effects of the first-generation agents. An alternative approach evaluates the appropriateness of treatment using assessment of patients’ clinical status. This approach assesses the extent to which treatment responds to the clinical needs of individual patients.20 Before second-generation medications became the dominant treatment, one such study of appropriateness found that 17% of patients had severe psychotic symptoms and no appropriate medication change, while 27% of patients had severe side effects and no appropriate medication change.21

This study uses measures of treatment appropriateness that make use of clinical assessment and applies these methods to clinics that are primarily using second-generation antipsychotic medications. To determine the extent to which treatment changes over time, appropriateness is evaluated at baseline and 1 year later. Also, one of the most consistent findings in quality of care research is that when treatment is complex, high volume clinicians provide better treatment.21,22 This may be due to provider specialization or selective referral to expert providers. This association is examined here for schizophrenia. Data were obtained from a research project at 3 large Department of Veterans Affairs (VA) mental health clinics, starting in 2001. The appropriateness of medication management was defined using national guidelines, updated with recent leading literature reviews, and was consistent with previous definitions.21 The resultant appropriateness criteria examined key aspects of medication prescribing that are likely to have a large effect on patient outcomes.

Methods

Study Design

“Enhancing QUality-of-care In Psychosis” (EQUIP) was a longitudinal project that included evaluation of routine treatment for schizophrenia.23,24 As part of EQUIP, data were collected during 2002 and 2003 at 3 large VA clinics in Southern California: the West Los Angeles, Long Beach, and Sepulveda mental health clinics. The West Los Angeles and Long Beach clinics serve populations of patients in 2 different urban areas. The Sepulveda clinic serves a suburban area. Patient sampling was designed so that results could be generalized to the overall population with schizophrenia at each clinic. Patients at the clinics were eligible if they (1) were at least 18 years old, (2) had a diagnosis of schizophrenia or schizoaffective disorder as determined by an abbreviated version of the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders (SCID),25 and (3) had at least one mental health clinic visit during a 5-month sampling period. We used real-time, visit-based sampling21 to identify a random sample of adults that met criteria. At each clinic, during a 5-month period in 2002–2003, a random sample of eligible patients was approached regarding enrollment. To ensure that visit frequency did not affect the probability of being selected, patients were eligible only at their first visit during the enrollment period.

Fifty-one percent of eligible patients consented to participate (n = 398). A total of 158 patients were enrolled at Clinic 1, 140 were enrolled at Clinic 2, and 100 were enrolled at Clinic 3. Institutional Review Board approval was obtained for the study. Written informed consent was obtained after the study had been fully explained. Patients were interviewed in person at baseline and 1 year later. During this 1-year period, the project did not affect treatment at the sites. Data on medication prescribing were obtained from computerized databases.

Measures

The SCID and Brief Psychiatric Rating Scale (BPRS) were performed by masters or doctoral level clinical research interviewers who were trained to a high level of reliability. Each completed an established training and quality assurance program.26,27 Interviewers were also trained to assess akathisia using the Barnes Scale28 and tardive dyskinesia (TD) using the Abnormal Involuntary Movement Scale.29 Body Mass Index (BMI) was calculated from weight and height, which was measured during the interview. The total number of patients with schizophrenia in each psychiatrist's practice was estimated by multiplying the number of study subjects in their practice by the inverse of the rate at which patients at their clinic were sampled for the study.

Criteria for Evaluation of Appropriateness

Criteria for inappropriate care were based on a previous project that used a comprehensive literature review, national treatment recommendations, and an expert panel.21 The previous medication management criteria for psychotic symptoms, akathisia, parkinsonism, and TD are used in this study. In the current project, management of elevated weight was added as a criteria given the weight gain liability of second-generation antipsychotics. Because much of the relevant research on weight gain was performed after development of the APA and PORT guidelines, weight criteria were based also on recent literature reviews and expert panels.9,30,31 the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) and other studies have found that switching to an antipsychotic medication with less weight gain liability results, on average, in substantial weight loss.32 Although research on adjunctive medications to control weight is inconsistent, we considered this strategy to be appropriate to ensure that no possibly effective treatments were missed. A criterion was also added for management of depression, based on treatment recommendations from the Schizophrenia PORT.2

The medication management criteria are (1) patients with significant psychotic symptoms should have had a increase in antipsychotic medication dosage or have started a new antipsychotic medication within the past 3 months or been treated with clozapine (a medication with greater efficacy); (2) patients with significant akathisia or parkinsonism should have had a reduction in the dose of antipsychotic medication, a switch to a different antipsychotic medication, or a change or addition of a side effect reducing medication during the previous month; (3) patients with significant TD should have had a reduction in the dose of antipsychotic medication within the past 3 months or have been treated with quetiapine or clozapine (medications that causes little or no TD); (4) patients with significantly elevated weight should have (a) been treated with an antipsychotic medication with little or no weight gain potential (ziprasidone, aripiprazole, or a first-generation medication other than chlorpromazine or thioridizine) or (b) been switched to a medication with less weight gain potential or been prescribed an augmenting weight loss medication within the past 3 months; and (5) patients with significant depression and no significant psychosis should have started treatment with an antidepressant medication or had an increase in dosage of antidepressant medication within the past 3 months.

Measurement of Appropriateness of Medication Treatment

We operationalized “significant” symptoms and side effects using information from the patient baseline and follow-up interviews. Cut points were set high enough to ensure that symptoms and side effects above the cut point would be clinically meaningful and likely to affect outcomes. Patients were categorized as having significant psychotic symptoms if their BPRS ratings were “moderately severe” or greater for hallucinations, suspiciousness, unusual thought content, or conceptual disorganization. Patients were categorized as having significant akathisia if they met Barnes28 criteria for moderate, marked, or severe akathisia; significant parkinsonism if they responded “a great deal” to items regarding muscle stiffness and slowing of movements; and significant TD if the Abnormal Involuntary Movement Scale ratings met clinical criteria described by Schooler and Kane.33 Patients were categorized as being significantly overweight if they had (a) a BMI > 30 or a BMI > 27 plus diabetes, hypertension, or cardiovascular disease and (b) had not lost 8% or more of prior weight in the past 6 months.9,30 Patients were defined as having significant depression if their BPRS rating was “moderately severe” or greater on depression and they did not experience significant psychotic symptoms (as defined above).

Participants were classified as receiving overall inappropriate medication management if they met criteria for poor symptom management or poor side effect management in any of the following 4 domains: psychotic symptoms, TD, elevated weight, and depression. The akathisia/parkinsonism domain was excluded due to the small number of people who experienced akathisia (1%, n = 4) or parkinsonism (5%, n = 19). Medication appropriateness was based on automated prescription data and did not take into consideration provider recommendations to patients or patient adherence with prescribed medications.

Statistical Analyses

Data were analyzed using chi-square tests for proportions and Pearson correlations. Repeated-measures logistic regressions were used to examine the appropriateness of care over time as well as clinic by time interactions. Two-tailed tests of significance were used and differences were considered statistically significant at P < .05.

Results

Participants

Study participants (n = 398) were primarily male (92%), averaged 51.8 ± 9.6 years old, and had been ill for an average of 24.5 ± 11.4 years. Sixty-one percent of participants were white, 27% were African American, 7% were Hispanic, and 5% were from other ethnic groups. Most (72%) were unemployed, and approximately half of the sample had never married (50%). Of the 398 participants, 88% (n = 351) completed the follow-up interview. Attrition analyses revealed that completers did not differ significantly from noncompleters in regard to age, gender, ethnicity, employment status, or baseline symptom severity.

Appropriateness of Medication Management

At baseline, 73% of patients were prescribed a second-generation antipsychotic medication, 17% were prescribed a first-generation medication, and 10% were simultaneously prescribed medications from both classes. Second-generation medication prescriptions were for risperidone (31% of patients), olanzapine (24% of patients), quetiapine (19% of patients), ziprasidone (3% of patients), and clozapine (7% of patients). Aripiprazole had not yet been approved during the Clinic 1 and Clinic 2 interviews and was not yet available on formulary during the Clinic 3 interviews. As shown in table 1, 128 participants (32%) had inappropriate management of psychotic symptoms, and 7 (2%) had inappropriate management of depressive symptoms. In regard to side effects, 32 (8%) had inappropriate management of TD, and 180 (45%) had inappropriate management of weight. Overall, 268 participants (67%) received inappropriate medication management in one or more domains. There were no significant differences between the 3 clinics in the prevalence of symptoms or side effects or the appropriateness of medication management.

Table 1.

Comparison Between Clinics of the Number of Subjects With Symptoms, Side Effects, and No Appropriate Management of These Problemsa

Treatment Domain Clinic 1 (n = 158), n (%) Clinic 2 (n = 140), n (%) Clinic 3 (n = 100), n (%) Total (n = 398), n (%) χ2 
Significant psychosis 72 (45.6) 58 (41.4) 46 (46.0) 176 (44.2) 0.71 
No appropriate management of psychosis 50 (31.6) 42 (30.0) 36 (36.0) 128 (32.2) 0.77 
Moderate or severe tardive dyskinesia 20 (12.7) 10 (7.1) 12 (12.0) 42 (10.6) 0.26 
No appropriate management of tardive dyskinesia 16 (10.1) 8 (5.7) 8 (8.0) 32 (8.0) 0.67 
Weight problem 76 (48.1) 61 (43.6) 47 (47.0) 184 (46.2) 0.73 
No appropriate management of weight 72 (45.6) 61 (43.6) 47 (47.0) 180 (45.2) 0.16 
Significant depression 4 (2.5) 5 (3.6) 2 (2.0) 11 (2.8) 0.75 
No appropriate management of depression 2 (1.3) 3 (2.1) 2 (2.0) 7 (1.8) 0.78 
No appropriate medication management in one or more domains 108 (68.4) 87 (62.1) 73 (73.0) 268 (67.3) 0.20 
Treatment Domain Clinic 1 (n = 158), n (%) Clinic 2 (n = 140), n (%) Clinic 3 (n = 100), n (%) Total (n = 398), n (%) χ2 
Significant psychosis 72 (45.6) 58 (41.4) 46 (46.0) 176 (44.2) 0.71 
No appropriate management of psychosis 50 (31.6) 42 (30.0) 36 (36.0) 128 (32.2) 0.77 
Moderate or severe tardive dyskinesia 20 (12.7) 10 (7.1) 12 (12.0) 42 (10.6) 0.26 
No appropriate management of tardive dyskinesia 16 (10.1) 8 (5.7) 8 (8.0) 32 (8.0) 0.67 
Weight problem 76 (48.1) 61 (43.6) 47 (47.0) 184 (46.2) 0.73 
No appropriate management of weight 72 (45.6) 61 (43.6) 47 (47.0) 180 (45.2) 0.16 
Significant depression 4 (2.5) 5 (3.6) 2 (2.0) 11 (2.8) 0.75 
No appropriate management of depression 2 (1.3) 3 (2.1) 2 (2.0) 7 (1.8) 0.78 
No appropriate medication management in one or more domains 108 (68.4) 87 (62.1) 73 (73.0) 268 (67.3) 0.20 
a

P >> .05 for all domains.

Repeated-measures logistic regression was utilized to determine if the appropriateness of medication management changed over time and to characterize clinic by time interactions. The appropriateness of management for psychotic and depressive symptoms did not change over time (χ21 = 0.07, P = .79 and χ21 = 0.67, P = .41, respectively) nor were there any clinic by time interactions (χ22 = 0.59, P = .74 for psychosis and χ22 = 0.49, P = .78 for depressive symptoms). The appropriateness of management of TD also did not change over time (χ21 = 0.02, P = .88). However, there was a significant time by clinic interaction indicating no change in the appropriateness of management of TD at Clinic 1, a decline in appropriateness at Clinic 2 and an improvement in appropriateness at Clinic 3 (χ22 = 6.6, P < .05). Management of elevated weight improved over time (from 45% to 35% poor care; χ21 = 19.6, P < .0001), though there was no clinic by time interaction (χ22 = 4.84, P = .09). Overall medication management improved over time (from 67% to 53% poor care; χ21 = 28.0, P < .0001), and there was a significant time by clinic interaction (χ22 = 12.4, P < .001) with an improvement of 15% in Clinic 1, 3% in Clinic 2, and 28% in Clinic 3.

Psychiatrist Specialization and the Appropriateness of Medication Management

Some psychiatrists had practices that included many more patients with schizophrenia, typically because they were specializing in the treatment of this disorder. The number of patients with schizophrenia in each psychiatrist's practice varied from 1 to 456, with a median of 12 patients per psychiatrist. The number of patients with schizophrenia in a psychiatrist's practice was not significantly associated with the appropriateness of care they delivered at baseline (r = 0.10, P = .51). However, when we examined psychiatrist specialization in relation to change in appropriateness of care over time, we found that compared with those psychiatrists with 12 or fewer patients with schizophrenia, psychiatrists with more than 12 patients were significantly more likely to improve their care over time (χ22 = 19.7, P < .001). Of the 18 psychiatrists who treated more than 12 patients with schizophrenia, 14 psychiatrists (78%) provided better care to their patients over time, 1 (6%) provided worse care, and 3 (17%) did not change. In contrast, of the 26 psychiatrists who treated 12 or fewer patients with schizophrenia, 3 (12%) provided better care over time, 6 (23%) provided worse care, and 17 (65%) did not change. Most resident trainees (n = 16, 84%) were in the low volume group. Of the 19 residents, 5 (26%) provided better care over time, 5 (26%) provided worse care, and 10 (47%) did not change.

Discussion

Over the past decade, the widespread dissemination of second-generation antipsychotic agents has resulted in major changes in treatment for schizophrenia. This study estimated the prevalence of significant symptoms and side effects and the prevalence of appropriate medication management at three clinics. Figure 1 presents these findings in comparison to a similar study conducted during 1996, when most patients were prescribed first-generation antipsychotic medication.21 With regard to side effects, a decade ago clinically significant akathisia and parkinsonism were present in about a quarter of patients, but these problems are now rare. TD is also less common now but is still present in 11% of patients. Second-generation agents cause much less TD than first-generation agents,34,35 and current TD could be mostly due to prior exposure to first-generation agents. On the other hand, elevated weight is now a very common problem. Forty-six percent of patients at these clinics were significantly overweight. Nearly all these patients were on medications that cause weight gain and were receiving medication management that did not change in response to their weight problem. With regard to psychotic symptoms, we found that significant psychosis was more common than a decade previously. The cause of this increase is unclear. It could be due to the reduced availability of hospitalization in treating psychotic patients36 or an improved ability to maintain patients with psychosis in the community.

Fig. 1.

Comparing the prevalence of clinical problems and lack of appropriate treatment between this study and results from 1996.

Fig. 1.

Comparing the prevalence of clinical problems and lack of appropriate treatment between this study and results from 1996.

These results reinforce concerns that weight has become the most important side effect of antipsychotic medications. Researchers have found that clinicians are aware of weight and related metabolic consequences of antipsychotic medication; however, this awareness has not translated into routine monitoring of metabolic side effects.37–39 This study finds that clinicians are also rarely changing medication in response to weight gain. Obesity increases the risk for diabetes, cardiovascular morbidity, and death.9 Other medical consequences include hypertension, strokes, gallstones, osteoarthritis, sleep apnea, and colon, breast, and endometrial cancer.40–45 Given the problems associated with elevated weight, national expert panels have recommended that treatment changes be considered for patients with schizophrenia who have BMI > 25, for women who have a waist size of 35 inches or greater, and for men who have a waist size of 40 inches or greater.9,30 Antipsychotic agents differ substantially in their weight gain liabilities, and changing medication to an agent with less weight gain potential results, on average, in significant weight loss.31 Also, weight control programs that emphasize nutrition, exercise, and behavioral change can stabilize or reduce weight in patients with schizophrenia.46–49

This study is one of the first to look longitudinally at the appropriateness of treatment for schizophrenia. We found that management of side-effects improved somewhat over time for individual patients. On the other hand, management of psychotic symptoms did not improve over time, suggesting that new strategies are needed for this problem. The CATIE study and treatment guidelines support greater use of clozapine.50 Although clozapine is the best available treatment for persistent and non-responsive psychosis, it is underutilized. Only 26 (6.5%) participants in this study were prescribed clozapine during the year in which they were evaluated. Prescription of clozapine can be challenging for psychiatrists who are not trained in the use of this medication, and care is often not organized in a way that makes clozapine easy to use.

This study is also one of the first to study the prevalence of severe depression and the appropriateness of its treatment in schizophrenia. We found that 11% of patients had depression that was moderately severe or greater. Most of these patients had severe psychosis. Given the efficacy of clozapine for refractory psychosis and related mood symptoms, more frequent use of this medication could be an effective strategy for improving depression in this population.

This study has important limitations. Medication prescribing and treatment appropriateness in schizophrenia could be affected by a variety of organizational, clinician, and patient factors. We did not assess these factors and therefore cannot explain the underlying causes of inappropriate care or why treatment appropriateness changed over time. For example, clinicians could have become increasingly aware of the problems related to elevated weight, or, alternatively, they may have become more persuasive in getting patients to accept appropriate medication changes. Further, while treatment guidelines define treatments that will, on average, result in the best outcomes for patients, there are patients for whom these changes are not clinically indicated. Because data on prior clinical status were unavailable, it is possible that patients had previously received appropriate treatments, and they were not helpful. However, given the low levels of use of clozapine and medications with low weight gain liability, this seems unlikely. Another possibility is that clinicians may be reluctant to switch patients to medications with less weight gain potential due to fear of exacerbating symptoms. However, research indicates that these switches are usually well tolerated.51 Development of benchmarks for best practices would clarify the extent to which care should be improved. And the development of stronger interventions to improve care would benefit from further research to clarify patient, clinician, and organizational barriers to improving treatment.

Finally, this study was performed at three VA medical centers in southern California, and replication is needed. We do not know the extent to which these results generalize beyond a primarily male VA population or to other systems of care. Prior research has found small, inconsistent differences between the quality of VA and non-VA care for schizophrenia.21,52 Also, while results were similar across these three diverse urban and suburban areas, other clinics may have formulary restrictions or other barriers to treatment access that could affect the care they provide.

Consistent with research from the 1990s, this study finds important problems with the quality of treatment for schizophrenia. However, problems in care have changed substantially. The emphasis of efforts to improve care will need to shift from improving management of EPS and neurologic side effects to a focus that includes weight gain and its associated complications. With regard to symptoms, efforts to better manage psychosis need to be redoubled.

Schizophrenia can be a challenging disorder to evaluate and treat. At these clinics, psychiatrists who specialized in the treatment of schizophrenia had more improvement in their care over time. However, much greater improvement in care is needed. This may require attention to a range of organizational, clinician, and patient factors that impede the delivery of appropriate treatment. We do not yet know how to best improve the quality of care in this disorder nor what benchmarks indicate that best practices are being provided. Quality improvement research will be critical to answering these questions. Researchers should partner with clinicians and policy makers, study novel treatments and approaches to reorganizing care, and determine how to best implement improved treatment and outcomes in this population.

Funding

Department of Veterans Affairs, Veterans Health Administration through the Office of Research and Development Health Services Research and Development Service (RCD 00-033, CPI 99-383, MNT 03-213), and the Desert Pacific Mental Illness Research, Education and Clinical Center, Los Angeles, CA; and by the National Institute of Mental Health UCLA-RAND Center for Research on Quality in Managed Care, Los Angeles, CA (MH 068639).

The views expressed in this article are those of the authors and do not necessarily reflect the positions or policies of affiliated institutions.

References

1.
American Psychiatric Association
Practice guideline for the treatment of patients with schizophrenia 2nd edition
Am J Psychiatry
 , 
2004
, vol. 
161
 (pg. 
1
-
56
)
2.
Lehman
AF
Kreyenbuhl
J
Buchanan
RW
, et al.  . 
The Schizophrenia Patient Outcomes Research Team (PORT): updated treatment recommendations 2003
Schizophr Bull
 , 
2004
, vol. 
30
 (pg. 
193
-
217
)
3.
Miller
AL
Hall
CS
Buchanan
RW
, et al.  . 
The Texas Medication Algorithm Project antipsychotic algorithm for schizophrenia: 2003 update
J Clin Psychiatry
 , 
2004
, vol. 
65
 (pg. 
500
-
508
)
4.
Kane
JM
Marder
SR
Psychopharmacologic treatment of schizophrenia
Schizophr Bull
 , 
1993
, vol. 
19
 (pg. 
287
-
302
)
5.
Lehman
AF
Quality of care in mental health: the case of schizophrenia
Health Aff (Millwood)
 , 
1999
, vol. 
18
 (pg. 
52
-
65
)
6.
Institute of Medicine
Improving the Quality of Health Care for Mental and Substance-Use Conditions: Quality Chasm Series
  
Washington, DC: National Academies Press; 2006
7.
Lieberman
JA
Stroup
TS
McEvoy
JP
, et al.  . 
Effectiveness of antipsychotic drugs in patients with chronic schizophrenia
N Engl J Med
 , 
2005
, vol. 
353
 (pg. 
1209
-
1223
)
8.
Tandon
R
Belmaker
RH
Gattaz
WF
, et al.  . 
World Psychiatric Association Pharmacopsychiatry Section statement on comparative effectiveness of antipsychotics in the treatment of schizophrenia
Schizophr Res
 , 
2008
, vol. 
100
 (pg. 
20
-
38
)
9.
Marder
SR
Essock
SM
Miller
AL
, et al.  . 
Physical health monitoring of patients with schizophrenia
Am J Psychiatry
 , 
2004
, vol. 
161
 (pg. 
1334
-
1349
)
10.
Young
AS
Sullivan
G
Duan
N
Patient, provider, and treatment factors associated with poor-quality care for schizophrenia
Ment Health Serv Res
 , 
1999
, vol. 
1
 (pg. 
201
-
211
)
11.
Leslie
DL
Rosenheck
RA
Adherence of schizophrenia pharmacotherapy to published treatment recommendations: patient, facility, and provider predictors
Schizophr Bull
 , 
2004
, vol. 
30
 (pg. 
649
-
658
)
12.
Hoge
MA
Paris
M
Jr.
Adger
H
Jr
, et al.  . 
Workforce competencies in behavioral health: an overview
Adm Policy Ment Health
 , 
2005
, vol. 
32
 (pg. 
593
-
631
)
13.
Cramer
JA
Rosenheck
R
Compliance with medication regimens for mental and physical disorders
Psychiatr Serv
 , 
1998
, vol. 
49
 (pg. 
196
-
201
)
14.
Valenstein
M
Copeland
LA
Blow
FC
, et al.  . 
Pharmacy data identify poorly adherent patients with schizophrenia at increased risk for admission
Med Care
 , 
2002
, vol. 
40
 (pg. 
630
-
639
)
15.
Cradock
J
Young
AS
Sullivan
G
The accuracy of medical record documentation in schizophrenia
J Behav Health Serv Res
 , 
2001
, vol. 
28
 (pg. 
456
-
465
)
16.
Young
AS
Routinely measuring schizophrenia treatment quality–shortcomings with medical records
Med Care
 , 
2007
, vol. 
45
 pg. 
104
 
17.
Lehman
AF
Steinwachs
DM
Patterns of usual care for schizophrenia: initial results from the Schizophrenia Patient Outcomes Research Team (PORT) Client Survey
Schizophr Bull
 , 
1998
, vol. 
24
 (pg. 
11
-
20
)
18.
Fischer
EP
Owen
RR
Quality of public sector care for schizophrenia in Arkansas
Ment Health Serv Res
 , 
1999
, vol. 
1
 (pg. 
213
-
221
)
19.
Rosenheck
RA
Desai
R
Steinwachs
D
Lehman
A
Benchmarking treatment of schizophrenia: a comparison of service delivery by the national government and by state and local providers
J Nerv Ment Dis
 , 
2000
, vol. 
188
 (pg. 
209
-
216
)
20.
Young
AS
Evaluating and improving the appropriateness of treatment for schizophrenia
Harvard Review of Psychiatry
 , 
1999
, vol. 
7
 (pg. 
114
-
118
)
21.
Young
AS
Sullivan
G
Burnam
MA
Brook
RH
Measuring the quality of outpatient treatment for schizophrenia
Arch Gen Psychiatry
 , 
1998
, vol. 
55
 (pg. 
611
-
617
)
22.
Birkmeyer
JD
Stukel
TA
Siewers
AE
Goodney
PP
Wennberg
DE
Lucas
FL
Surgeon volume and operative mortality in the United States
N Engl J Med
 , 
2003
, vol. 
349
 (pg. 
2117
-
2127
)
23.
Young
AS
Mintz
J
Cohen
AN
Chinman
MJ
A network-based system to improve care for schizophrenia: the medical informatics network tool (MINT)
J Am Med Inform Assoc
 , 
2004
, vol. 
11
 (pg. 
358
-
367
)
24.
Brown
AH
Cohen
AN
Chinman
MJ
Kessler
C
Young
AS
EQUIP: implementing chronic care principles and applying formative evaluation methods to improve care for schizophrenia: QUERI Series
Implementation Science
 , 
2008
, vol. 
3
 pg. 
9
 
25.
First
MB
Spitzer
RL
Gibbon
M
Williams
JBW
Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Patient Edition, Version 2.0
 , 
1995
New York, NY
New York State Psychiatric Institute
26.
Ventura
J
Liberman
RP
Green
MF
Shaner
A
Mintz
J
Training and quality assurance with the Structured Clinical Interview for DSM-IV (SCID-I/P)
Psychiatry Res
 , 
1998
, vol. 
79
 (pg. 
163
-
173
)
27.
Ventura
J
Green
MF
Shaner
A
Liberman
RP
Training and quality assurance with the Brief Psychiatric Rating Scale: “the drift busters
Int J Methods Psychiatr Res
 , 
1993
, vol. 
3
 (pg. 
221
-
244
)
28.
Barnes
TR
A rating scale for drug-induced akathisia
Br J Psychiatry
 , 
1989
, vol. 
154
 (pg. 
672
-
676
)
29.
Munetz
MR
Benjamin
S
How to examine patients using the Abnormal Involuntary Movement Scale
Hosp Commun Psychiatry
 , 
1988
, vol. 
39
 (pg. 
1172
-
1177
)
30.
American Diabetes Association
Consensus development conference on antipsychotic drugs and obesity and diabetes
Diabetes Care
 , 
2004
, vol. 
27
 (pg. 
596
-
601
)
31.
Newcomer
JW
Metabolic considerations in the use of antipsychotic medications: a review of recent evidence
J Clin Psychiatry
 , 
2007
, vol. 
68
 
suppl 1
(pg. 
20
-
27
)
32.
Weiden
PJ
Switching antipsychotics as a treatment strategy for antipsychotic-induced weight gain and dyslipidemia
J Clin Psychiatry
 , 
2007
, vol. 
68
 
suppl 4
(pg. 
34
-
39
)
33.
Schooler
NR
Kane
JM
Research diagnoses for tardive dyskinesia
Arch Gen Psychiatry
 , 
1982
, vol. 
39
 (pg. 
486
-
487
)
34.
Marder
SR
Essock
SM
Miller
AL
, et al.  . 
The Mount Sinai conference on the pharmacotherapy of schizophrenia
Schizophr Bull
 , 
2002
, vol. 
28
 (pg. 
5
-
16
)
35.
Jeste
DV
Tardive dyskinesia rates with atypical antipsychotics in older adults
J Clin Psychiatry
 , 
2004
, vol. 
65
 
suppl 9
(pg. 
21
-
24
)
36.
Rosenheck
RA
Banks
S
Pandiani
J
Hoff
R
Bed closures and incarceration rates among users of Veterans Affairs mental health services
Psychiatr Serv
 , 
2000
, vol. 
51
 (pg. 
1282
-
1287
)
37.
Buckley
PF
Miller
DD
Singer
B
Arena
J
Stirewalt
EM
Clinicians’ recognition of the metabolic adverse effects of antipsychotic medications
Schizophr Res
 , 
2005
, vol. 
79
 (pg. 
281
-
288
)
38.
Newcomer
JW
Nasrallah
HA
Loebel
AD
The Atypical Antipsychotic Therapy and Metabolic Issues National Survey: practice patterns and knowledge of psychiatrists
J Clin Psychopharmacol
 , 
2004
, vol. 
24
 (pg. 
S1
-
6
)
39.
Motsinger
C
Slack
M
Weaver
M
Reed
M
Physician patterns of metabolic screening for patients taking atypical antipsychotics: a retrospective database study
Primary care companion to the Journal of clinical psychiatry
 , 
2006
, vol. 
8
 (pg. 
220
-
223
)
40.
Davidson
MH
Hauptman
J
DiGirolamo
M
, et al.  . 
Weight control and risk factor reduction in obese subjects treated for 2 years with orlistat: a randomized controlled trial
JAMA
 , 
1999
, vol. 
281
 (pg. 
235
-
242
)
41.
Gordon
A
Price
LH
Mood stabilization and weight loss with topiramate
Am J Psychiatry
 , 
1999
pg. 
156
 
42.
Heck
AM
Yanovski
JA
Calis
KA
Orlistat, a new lipase inhibitor for the management of obesity
Pharmacotherapy
 , 
2000
, vol. 
20
 (pg. 
270
-
279
)
43.
McMahon
FG
Fujioka
K
Singh
BN
, et al.  . 
Efficacy and safety of sibutramine in obese white and African American patients with hypertension: a 1-year, double-blind, placebo-controlled, multicenter trial
Arch Intern Med
 , 
2000
, vol. 
160
 (pg. 
2185
-
2191
)
44.
Norton
J
Potter
D
Edwards
K
Sustained weight loss associate with topiramate
Epilepsia
 , 
1997
, vol. 
38
 pg. 
58
 
45.
Sjostrom
L
Rissanen
A
Andersen
T
, et al.  . 
Randomised placebo-controlled trial of orlistat for weight loss and prevention of weight regain in obese patients. European Multicentre Orlistat Study Group
Lancet
 , 
1998
, vol. 
352
 (pg. 
167
-
172
)
46.
Littrell
KH
Hilligoss
NM
Kirshner
CD
Petty
RG
Johnson
CG
The effects of an educational intervention on antipsychotic-induced weight gain
J Nurs Scholarsh
 , 
2003
, vol. 
35
 (pg. 
237
-
241
)
47.
Menza
M
Vreeland
B
Minsky
S
Gara
M
Radler
DR
Sakowitz
M
Managing atypical antipsychotic-associated weight gain: 12-month data on a multimodal weight control program
J Clin Psychiatry
 , 
2004
, vol. 
65
 (pg. 
471
-
477
)
48.
Vreeland
B
Minsky
S
Menza
M
Rigassio Radler
D
Roemheld-Hamm
B
Stern
R
A program for managing weight gain associated with atypical antipsychotics
Psychiatr Serv
 , 
2003
, vol. 
54
 (pg. 
1155
-
1157
)
49.
Faulkner
G
Cohn
T
Remington
G
Interventions to reduce weight gain in schizophrenia
Schizophr Bull
 , 
2007
, vol. 
33
 (pg. 
654
-
656
)
50.
McEvoy
JP
Lieberman
JA
Stroup
TS
, et al.  . 
Effectiveness of clozapine versus olanzapine, quetiapine, and risperidone in patients with chronic schizophrenia who did not respond to prior atypical antipsychotic treatment
Am J Psychiatry
 , 
2006
, vol. 
163
 (pg. 
600
-
610
)
51.
Newcomer
JW
Campos
JA
Marcus
RN
, et al.  . 
A multicenter, randomized, double-blind study of the effects of aripiprazole in overweight subjects with schizophrenia or schizoaffective disorder switched from olanzapine
J Clin Psychiatry
 , 
2008
(pg. 
e1
-
e11
)
52.
Leslie
DL
Rosenheck
RA
Benchmarking the quality of schizophrenia pharmacotherapy: a comparison of the Department of Veterans Affairs and the private sector
J Ment Health Policy Econ
 , 
2003
, vol. 
6
 (pg. 
113
-
121
)