Treatment Progress Indicator: Application of a New Assessment Tool to Objectively Monitor the Therapeutic Progress of Patients With Depression, Anxiety, or Behavioral Health Impairment

Treatment Progress Indicator: Application of a New Assessment Tool to Objectively Monitor the Therapeutic Progress of Patients With Depression, Anxiety, or Behavioral Health Impairment

Phillip Tuso, MD

Perm J 2014 Summer;18(3):55-59 [Full Citation]

https://doi.org/10.7812/TPP/13-091

Abstract

Depression, anxiety, and behavioral health impairment are common in the US. Efforts to treat patients with depression, anxiety, and chemical dependency are surpassed by the great demand for psychiatrist and therapist appointments. Unlike other specialties, psychiatry lacks a vital sign or tests (eg, blood pressure for hypertension and hemoglobin A1c for diabetes) to objectively measure a patient's response to therapy. A new tool called the Treatment Progress Indicator (TPI) appears to offer clinicians an objective approach to assess patients and to monitor therapy over time. The TPI report shows an Expected Treatment Response that allows clinicians to compare their patients' responses to therapy with those of a cohort of patients with a similar diagnosis and severity. The TPI allows for objective population-level management of disease. This should result in sharing of best practices that will lead to more effective and efficient care plans. Widespread implementation of the TPI has the potential to improve the time required to diagnose conditions and triage patients. As a result, implementation of the tool has the potential to improve behavioral health access and affordability.

Introduction

Disorders such as depression, anxiety, and substance abuse are among the most common and disabling health conditions in the US.1 They often co-occur with chronic medical conditions, and untreated, they can worsen associated health care outcomes.2 When behavioral health problems are not effectively treated they can be associated with poor health outcomes, increased mortality, decreased work productivity, and an increase in health care costs.3-6

According to Unützer et al,7 most medical patients with depression, anxiety, and/or chemical dependency may not receive adequate therapy. Efforts to improve the treatment of these disorders in primary care initially focused on screening, education of physicians, development of treatment guidelines, and referral to psychiatry. Although these interventions have not been shown to independently improve care, each area has the potential to contribute to improved mental health outcomes.8

Every day clinicians must make decisions about patient care. They must decide whether a patient's condition warrants treatment, referral, or watchful waiting. If treatment or referral seems appropriate for a patient, the clinician determines if the patient will be treated with medication or individual, group, or combination psychotherapy. After treatment begins, the physician must evaluate whether the patient is responding satisfactorily. All of these decisions pose unique challenges for behavioral health conditions because there are no vital signs, radiologic studies, or blood tests to rely on for diagnosis, treatment planning, and monitoring of the underlying disorder.

Some psychiatrists use one or more psychological tests to assess severity of the disorder and the patient's progress (eg, Patient Health Questionnaire-9, Beck Depression Inventory, Symptom Checklist 90, Generalized Anxiety Disorder scale). These tests can be very useful but are typically narrowly focused on a single disorder (eg, depression or anxiety). Patients in specialty care commonly report symptoms of multiple disorders. Attempts to establish a broadly acceptable battery of measures have been unsuccessful, owing to differing views of which measures to include, and the length of time required for patients to complete the battery.

Currently, patients with diagnosed depression, anxiety, and/or chemical dependency may be treated in primary care or referred for psychotherapy or to psychiatry. However, most primary care physicians do not have an effective tool to objectively determine if a patient could benefit from a primary care intervention such as a health education class or an appointment with a case manager versus an appointment with a psychiatrist. The patient may wait several days to see a psychiatrist whereas intervention with a frontline case manager or social worker would be immediately available. This delay in care is concerning to patients and may prevent early interventions with the potential to stabilize an acute disorder.

Medical patients are considered to have a positive response to treatment when their symptoms remediate, their life functioning improves, and they feel better. A universally accepted mental health services screening and treatment progress indicator tool may be helpful in providing similar indicators of patient response to treatment for mental health conditions. It could be helpful for visualizing trends in improved functioning and symptom remission over the course of therapy, and in promoting multidisciplinary collaboration for improved mental health outcomes.

Treatment Progress Indicator

The Treatment Progress Indicator (TPI) was created to improve access to care and help clinicians get a better assessment of a patient's overall behavioral health impairment (BHI) and monitor their response to treatment. TPI is a Web-based self-report assessment tool (see Sidebar: Treatment Progress Indicator Self-Assessment Tool). It screens for the most common behavior disorders and measures the severity of the patient's depression, anxiety, global symptoms, social functioning status, global functioning status, and subjective well-being. These data are combined to derive a global BHI score useful for tracking response to treatment and for risk stratification. The TPI alerts the clinician to severity and presence or absence of indicators of substance abuse, obsessive-compulsive disorder, bipolar disorder, posttraumatic stress disorder, and panic disorder. It includes items for treatment history, use of psychoactive medications, and resilience. It does not assess psychosis, schizophrenia, phobia, or personality disorders.

The TPI system was developed over a decade by Polaris Health Directions (www.polarishealth.com) with extensive involvement of researchers, experts in assessment of mental health treatment outcomes, clinicians, and information technology specialists. The work was sponsored by the National Institute of Mental Health and grounded in a decade of basic research.8-13 Measures of the severity of multiple mental health conditions were developed and validated in both medical and mental health settings.8,9,14 Concurrent validation of the depression scale versus clinician evaluations has been established using patient samples from private and public clinics.14,15 Foundational research for the TPI also included a series of studies relating "doses" (sessions) of treatment to improvement in behavioral health symptoms and functioning, and in the global BHI score.16-20 The TPI was developed using item reduction analysis to reduce the length of the assessment to 29 questions by deleting items that had minimal impact on the reliability of the scales or the correlations of the shorter with the longer versions of the same scale. Internal consistency reliability is acceptable for all 6 TPI scales and good or excellent for 5 of them (Table 1).

The TPI can be administered using a computer or fax form, typically upon admission to treatment and at clinic-specified intervals throughout an episode of care. The interval between assessments is at the discretion of the clinic. Most commonly it is administered immediately before every treatment session, or at two-week intervals. Assessment reports are available for clinician review immediately upon completion of the computer assessment and within 24 hours for the fax version. Excerpts of assessment reports are shown in Table 2 and Figure 1.

Table 2 shows the percentile score for the overall BHI and subscale percentile scores for depression, anxiety, and functional impairment. In this particular case the data show that the patient improved on all metrics except the social functional impairment metric. Despite this observation the overall Behavioral Impairment (BHI score) percentile improved markedly. Of note is the finding that the BHI score went from 80% to 19% despite only moderate improvement in depression and anxiety scores.

Treatment Progress Indicator: Application of a New Assessment Tool to Objectively Monitor the Therapeutic Progress of Patients With Depression, Anxiety, or Behavioral Health Impairment

Treatment Progress Indicator: Application of a New Assessment Tool to Objectively Monitor the Therapeutic Progress of Patients With Depression, Anxiety, or Behavioral Health Impairment

Treatment Progress Indicator: Application of a New Assessment Tool to Objectively Monitor the Therapeutic Progress of Patients With Depression, Anxiety, or Behavioral Health Impairment

Expected Treatment Response

In addition to providing data for an individual, the TPI chart shown in Figure 1 also provides a graph showing the patient's actual treatment response compared to the Expected Treatment Response (ETR) for BHI. The ETR algorithm was constructed from TPI data for thousands of patients presenting for treatment at Kaiser Permanente (KP) Southern California psychiatry clinics. The ETR curve was derived through hierarchical linear modeling of change in the patient's global behavioral health condition as a function of initial severity and other prognostic factors, including treatment history, patient strengths, and expectations.13,15,18,19Therefore, the ETR provides a standardized, databased method for monitoring response to therapy for an individual patient compared to similar patients in the database at specific time intervals. The clinician's decision concerning intervention is guided by projections of the likely course. If the clinician decides to treat, the actual treatment response can be compared with the expected treatment response to determine whether the patient is making adequate progress.

Although few patient trend scores will precisely track the ETR, a series of two or more scores that are substantially less favorable than the ETR may indicate that the patient is not responding as well as expected to therapy (see Figure 1, second assessment actual BHI score). However with treatment adjustment, the actual treatment response may improve more than the ETR for a similar patient profile (see Figure 1, third assessment actual BHI score), indicating that response to therapy is better than expected. This is potentially a very powerful tool as it may help guide therapy and may open the door to identify and spread best practices across the continuum of care.

Treatment Progress Indicator Benefits

By providing a global measure of behavioral health status as well as measures for common disorders and comorbidities, TPI may offer an efficient method for helping clinicians decide whether to treat. If the decision is to treat, TPI can help to determine whether the patient is making satisfactory progress in relation to an evidence-based expectation of progress. Monitoring treatment response may enable clinicians to identify patients who need more intensive therapy, or those that can be safely discharged or stepped down. Treatment approaches that consistently achieve unusually positive outcomes compared to ETR may be identified as best practices and shared.       

Traditional evidence-based medicine supports treatment practices that have been shown to improve care. However, no behavioral health treatment is effective for all patients. The TPI enables us to determine whether a patient is receiving the "right" treatment based not upon a specific evidence-supported approach but based upon the answer to the question, "Is the patient making the progress that would be expected on the basis of their initial severity and other factors known to impact the rate and amount of patient improvement?" In clinical practice it is less important to know whether a treatment works in general than to know whether it is working for the patient under care.

The TPI can also be used to identify patients who present in psychiatry clinics who may be candidates for other care pathways. Those with mild, uncomplicated presentations may be candidates for Wellness Coaching or Health Education. Patients with unipolar depression and no significant comorbidities may be candidates for Depression Care Management. Analyses of data for 11,700 patients from 9 KP psychiatry clinics indicates that as many as 15% may be candidates for these less intensive interventions. In addition, having a way to objectively measure BHI sets the stage for triage to occur upstream, even in the primary care setting. Some patients' care might be shifted to other departments including health education, frontline depression case managers, and social workers in primary care. This has the potential to improve access in psychiatry for patients who would most benefit from specialty care (eg, patients with severe bipolar disorders or schizophrenia, and patients at risk for self-harm). The TPI may allow us to assess which patients need to be referred to the Psychiatry Department and "with further research" which patients could be managed in primary care. The TPI's evidence-based tracking of patients' responses to therapy should help clinicians identify patients who can safely be returned to primary care. By reducing the need for follow-up appointments in Psychiatry, this could further increase access to new referrals.

The Future for the Treatment Progress Indicator

Every day thousands of patients are treated for depression, anxiety, and functional impairment. Each patient represents potential for learning and performance improvement. Our goal as clinicians is to better understand which types of interventions are most effective for which types of patients. Because there is currently no objective way to measure a patient's emotional vital sign in the behavioral health setting, there is no optimal way to identify and to share standardized best practices among clinicians. The TPI is designed to harvest data to allow clinicians to better understand what works and for whom.

The utility of ETR curves will continually increase as new patient data are added to the TPI database. The capacity to routinely capture and make use of the treatment histories of real patients constitutes a learning system and a potential milestone for behavioral health. Large patient volume gives organizations like KP a unique opportunity to use the TPI to establish and to continually refine ETRs for all treatment modalities. ETRs can be established for group psychotherapy, individual psychotherapy, medication management, and combinations of the three (eg, medication and individual psychotherapy).

Numerous measures exist for detecting individual disorders such as depression, but there are very few instruments that measure all components assessed by the TPI or do so efficiently. TPI compares well with alternative tools when practical issues such as the number of items, time required for completion, mode of administration, complexity of scoring, customizability, and special training requirements are considered. The scope of the TPI is important because patients often report multiple problem areas. The ability of the TPI to monitor treatment response for patients with multiple problems is therefore important, and could be further strengthened when ETRs are derived for specific treatment modalities. 

Detecting depression, anxiety, chemical dependency, suicidality, and functional status would be helpful both for the behavioral health specialists as well as primary care physicians. In each setting, determination of appropriate care pathways is best for the patient and for improving access to the most intensive treatments. In both settings, evidence-based tracking of patient response to treatment is critical. If a patient is responding to therapy, improvement can be documented using the TPI instead of relying on subjective, nonquantitative documentation in the patient chart. The TPI gives us the ability to identify best treatment strategies that could be shared with other physicians. The TPI would allow identification of psychiatry clinic patients who improve with therapy and who could return to their primary care physician. If symptoms recur, the TPI could be administered to determine if the patient needs to be referred back to behavioral health medicine. Return to the primary care physician will help increase access to behavioral health medicine.

Finally, the TPI can be used to quickly identify patients who are not responding to therapy. As a result, treatment plans can be reviewed and adjusted (eg, check for adherence to medication prescription, appropriate dosage of medication, or intensity of psychotherapy). A simple self-administered measure to complete either in the clinic, by secure messaging, online, or by telephone administration would be an efficient means to assess the nature and severity of conditions screened for by the TPI.

Conclusion

Physicians prefer to quantify a disorder when possible. The TPI might be considered a type of laboratory test or an emotional vital sign. Like blood glucose readings, the TPI may serve as an entry point for patients with behavioral issues and their physicians to communicate about disease control, decide among treatment options (including "watch and wait"), monitor progress, and, when appropriate, adjust therapy.

Multisymptom screening together with brevity, reliability, and construct and criterion validity makes the TPI tool an attractive dual-purpose instrument for making diagnoses and assessing severity of depression, anxiety, and chemical dependency disorders, particularly in the busy setting of clinical practice.

Disclosure Statement

The author has no conflicts of interest to disclose.

Acknowledgment

Leslie Parker, ELS, provided editorial assistance.

References

   1.  Kasper J, O'Malley Watts M, Lyons B. Chronic disease and co-morbidity among dual eligibles: implications for patterns of Medicaid and Medicare service use and spending. Pub no. 8081. Washington, DC: The Kaiser Commission on Medicaid and the Uninsured; 2010 Jul.

   2.  Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B. Depression, chronic diseases, and decrements in health: results from the World Health Surveys. Lancet 2007 Sep;370(9590):851-8. DOI: https://doi.org/10.1016/S0140-6736(07)61415-9.

   3.  Wang PS, Simon GE, Kessler RC. Making the business case for enhanced depression care: the National Institute of Mental Health-Harvard Work Outcomes Research and Cost-effectiveness Study. J Occup Environ Med 2008 Apr;50(4):468-75. DOI: https://doi.org/10.1097/JOM.0b013e31816a8931.

   4.  Katon W. The impact of depression on workplace functioning and disability costs. Am J Manag Care 2009 Dec;15(11 Suppl):S322-7.

   5.  Daumit GL, Anthony CB, Ford DE, et al. Pattern of mortality in a sample of Maryland residents with severe mental illness. Psychiatry Res 2010 Apr 30;176(2-3):242-5. DOI: https://doi.org/10.1016/j.psychres.2009.01.006.

   6.  Wang PS, Demler O, Kessler RC. Adequacy of treatment for serious mental illness in the United States. Am J Public Health 2002 Jan;92(1):92-8. DOI: https://doi.org/10.2105/AJPH.92.1.92.

   7.  Unützer J, Schoenbaum M, Druss BG, Katon WJ. Transforming mental health care at the interface with general medicine: report for the presidents commission. Psychiatr Serv 2006 Jan;57(1):37-47. DOI: https://doi.org/10.1176/appi.ps.57.1.37.

   8.  Sperry L, Brill PL, Howard KI, Grissom GR. Treatment outcomes in psychotherapy and psychiatric interventions. New York, NY: Brunner/Mazel, Inc; 1996.

   9.  Grissom GR, Lyons JS, Lutz W. Standing on the shoulders of a giant: development of an outcome management system based on the Dose Model and Phase Model of Psychotherapy. Psychotherapy Research 2002;12(4):397-412. DOI: https://doi.org/10.1093/ptr/12.4.397.

10.  Grissom G, Lyons JS. Pragmatic case studies and evidence-based treatment: research and clinical applications of a computerized outcomes management system. Pragmatic Case Studies in Psychotherapy 2006;2(3):1-28.

11.  Howard KI, Kopta SM, Krause MS, Orlinsky DE. The dose-effect relationship in psychotherapy. Am Psychol 1986 Feb;41(2):159-64. DOI: https://doi.org/10.1037/0003-066X.41.2.159.

12.  Howard KI, Lueger RJ, Maling MS, Martinovich Z. A phase model of psychotherapy outcome: causal mediation of change. J Consult Clin Psychol 1993 Aug;61(4):678-85. DOI: https://doi.org/10.1037/0022-006X.61.4.678.

13.  Howard KI, Moras K, Brill PL, Martinovich Z, Lutz W. Evaluation of psychotherapy: efficacy, effectiveness, and patient progress. Am Psychol 1996 Oct;51(10):1059-64. DOI: https://doi.org/10.1037/0003-066X.51.10.1059.

14.  Grissom GR, Howard K. COMPASS-PC. In: Maruish ME, editor. Handbook of psychological assessment in primary care settings. New York, NY: Routledge; 2000.

15.  Martinovich Z. Evaluating a phase model of psychotherapy outcome: an application of hierarchical logistic modeling [dissertation]. Evanston, IL: Northwestern University; 1998.

16.  Kopta SM, Howard KI, Lowry JL, Beutler LE. Patterns of symptomatic recovery in psychotherapy. J Consult Clin Psychol 1994 Oct;62(5):1009-16. DOI: https://doi.org/10.1037/0022-006X.62.5.1009.

17.  Krause M, Howard KI, Lutz W. Exploring individual change. J Consult Clin Psychol 1998 Oct;66(5):838-45. DOI: https://doi.org/10.1037/0022-006X.66.5.838.

18.  Lueger RJ, Howard KI, Martinovich Z, Lutz W, Anderson EE, Grissom G. Assessing treatment progress of individual patients using expected treatment response models. J Consult Clin Psychol 2001 Apr;69(2):150-8. DOI: https://doi.org/10.1037/0022-006X.69.2.150.

19.  Lutz W, Martinovich Z, Howard KI. Patient profiling: an application of random coefficient regression models to depicting the response of a patient to outpatient psychotherapy. J Consult Clin Psychol 1999 Aug;67(4):571-7. DOI: https://doi.org/10.1037/0022-006X.67.4.571.

20.  Maling M, Gurtman M, Howard K. The response of interpersonal problems to varying doses of psychotherapy. Psychotherapy Research 1995;5(1):63-75. DOI: https://doi.org/10.1080/10503309512331331146.

Circulation

27,000 print readers per quarter, 9,725 eTOC readers, and in 2016, 1.4 million page views on TPJ articles in PubMed from a broad international readership.

The Permanente Press

Sponsored by the National Permanente Medical Groups, The Permanente Press publishes The Permanente Journal and books related to Kaiser Permanente and health care.

Letters

Articles, editorials, letters to the editor, and other material represent the opinion of the authors. Send your comments to permanente.journal@kp.org.


Copyright 2017 Kaiser Permanente - The Permanente Journal. All Rights Reserved.