Introduction
Despite the burden that cardiovascular diseases place on Americans
1 and clear evidence that team-based health care improves control of cardiovascular risk factors,
2–10 many medical practices have not adopted this innovation. A classic trial to reduce cardiac surgical mortality provides clues about the components that make practice improvement interventions successful. Nearly 20 years ago the Northern New England Cardiovascular Disease Study Group showed that surgical outcomes could be improved with a simple 3-component intervention: feedback of outcome data, training in continuous quality improvement techniques, and site visits to other Medical Centers.
11 Even though the surgeons were not provided with detailed process improvement instructions, the intervention was associated with a 24% reduction in in-hospital mortality.
11 The authors suggested that, along with the 3 prongs of the intervention, giving each care team the autonomy to change their operations as they saw fit led to the rapid decline in mortality.
In his appendix to
Crossing the Quality Chasm,
12 Plsek
13 suggests that, rather than using the principles of mechanical systems to try to improve health care, innovators should employ the principles of complex adaptive systems. The behavior of mechanical systems (eg, automobiles) can always be predicted if the system is described in adequate detail. The same is not true for complex adaptive systems like human social interaction because people are autonomous. Although the behavior of complex adaptive systems cannot be predicted using the rules that apply to mechanical systems, simple rules can suffice. For example, the behavior of flocks of birds, schools of fish, and herds of mammals can be explained with just three rules: avoid collisions, attempt to match velocity, and attempt to stay close to the nearest neighbor.
14Kottke and colleagues
15 have hypothesized that only five conditions need to be met to create value in health care. These conditions are: 1) the stakeholders agree on a set of mutual, measurable goals for the health system; 2) the extent to which the goals are being achieved is reported to the public; 3) resources are available to achieve the goals; 4) stakeholder incentives, imperatives, and sanctions are aligned with the agreed-on health system goals; and 5) leaders among all stakeholders endorse and promote the agreed-on health system goals. When these conditions are met, the stakeholders will organize themselves to perform. This observation is consistent with the reported experience of the Northern New England Cardiovascular Disease Study Group.
11The goal we set was to test whether a group practice that comprises 5 privately owned primary care clinics would implement systems of team-based care if we used the principles of complex adaptive systems to design the intervention. We defined success as the satisfaction of 3 objectives. The first objective was that, relative to patients with Type 2 diabetes mellitus, the care system would increase the proportion of patients with coronary heart disease (CHD) who satisfy a composite measure (blood pressure < 140/90 mmHg, low-density lipoprotein [LDL] cholesterol level < 100 mg/dL, no use of tobacco, and taking at least 81 mg/day of aspirin unless contraindicated). The second objective was that the system would be associated with increased satisfaction among both patients and staff. The third objective was that the financial impact of the system would be positive or neutral for the practice. We also collected qualitative data from providers during the implementation period so that we could better understand the process that the clinics experienced as they implemented their systems.
In this article, we report the results of the first two objectives. Regarding the third objective, we were unable to generate a revenue stream that offset the cost of the team-based care system. We are in the process of preparing a detailed report. Finally, the results of the qualitative analysis demonstrate that the task of implementing team-based care is complex. Among other tasks, roles must be defined and individuals must learn how to work in teams; patient registry and clinical data retrieval technology must be developed and implemented; and care processes for previsit planning and between-visit care management must be defined and implemented. Success requires an ongoing effort of creation, revision, retraining, and reinforcement.
16Methods
The HealthPartners Institute for Education and Research institutional review board approved the study as Protocol 09-132.
Clinical Setting
We conducted the study in a for-profit primary care practice of 46 primary care physicians and advanced care providers who care for small town and rural patients as well as a commuter population in western Wisconsin. The practice is made up of 5 clinics in 3 divisions (1 division has a main practice site and 2 satellite clinics). Each division has its own administrator and Clinical Services Manager. Physicians own and govern the practice. Clinic assistants, primarily certified medical assistants, support the providers during patient visits to increase work flow efficiency. A few months before we began our trial, the practice created a new position of care coordinator in all its divisions to coordinate the care of patients who might benefit from follow-up services. The practice also implemented an electronic medical record system at about the same time. The clinics had already used continuous quality improvement methods to innovate, and in 2013, all 3 divisions achieved National Committee for Quality Assurance Medical Home accreditation.
Patient Management System
We took three concepts into account when we designed the implementation process: 1) health services delivery systems are complex adaptive systems, not mechanical systems
13; 2) adoption of any system of care requires adaptation and reinvention
17–19; and 3) the long-term survival of any system of care requires that a new process, at a minimum, does not threaten the viability of the overall system. We accepted the long-term financial success of the practice in a highly competitive market as
prima facie evidence that the physicians in the group knew the fundamentals of designing care delivery systems; they did not need guidance at that level.
Therefore, rather than provide the clinics with an operational structure that we expected them to implement in parallel with their other care processes, our only firm requests were that they use the study resources to improve their Minnesota HealthScores vascular disease quality scores
20 and hire a registered nurse (RN) Care Manager to coordinate the team-care program. Although we paid her salary with grant resources, the RN Care Manager was a clinic employee who reported to one of the Clinical Services Managers and a lead primary care physician; she did not report to the investigators. Otherwise, the clinics could use or modify existing care processes to the extent they wished but could also develop new processes as they believed necessary. Although each of the five clinics shared information and worked to develop common treatment goals, they were free to implement the processes that best fit their existing procedures.
The clinics used the concepts of the medical home
21 and the chronic care model
22 to develop their patient care systems. The systems’ personnel were composed of the RN Care Manager, information technology staff, and clinic assistant care coordinators. These care coordinators supported providers in the following tasks: developing treatment protocols and processes; verifying the accuracy of patient data; reviewing the lists of patients who were not at goal with the responsible provider; and developing and carrying out care and follow-up plans. The RN Care Manager rotated to a different clinic every month, but care coordinators and providers from all five clinics could contact her by phone and e-mail during the trial. The RN Care Manager also helped the care coordinators refine patient education and counseling techniques, identified resources for patients (eg, smoking cessation options), addressed barriers to care that the patients were facing (eg, transportation, paying for medications), and helped refine and revise clinic systems (eg, previsit planning, after-visit care, between-visit follow-up, and team communications).
For some tasks, the system development teams were able to use existing clinic care and information technology systems; for other tasks, however, they needed to develop new protocols, processes, and capabilities. For example, they needed to develop protocols for hypertension, lipid management, and tobacco use cessation. The clinics also needed to develop previsit planning and postvisit follow-up protocols. All protocols needed to be approved by clinic leaders.
All patients were assigned to provider panels. This allowed the staff to generate quarterly provider-specific lists of patient names and risk factor levels that could be reviewed with each provider to develop treatment and follow-up plans. These plans were then implemented by the care coordinators and the RN Care Manager.
Evaluation Design
We tested the hypothesis that the patient management system would increase the proportion of patients who met goals for controlling their risk factors. To do so, we reviewed the medical records of independent random samples of patients who received care in the 12 months before the system was implemented and during the 12-month period that started 6 months after each clinic implemented its care system (
Figure 1). We excluded the first 6 months of the implementation period from the evaluation because we considered it an early learning period. We compared the differences in the 2 samples of patients with CHD with 2 randomly selected samples of diabetic patients who were treated during the same periods. We selected patients with diabetes as the reference group because, with the exception of hemoglobin A
1c concentration, their chronic care management goals are identical. Patients who had both CHD and diabetes were included in our sample of patients with CHD. To ensure that a primary care provider had an opportunity to take corrective action if a patient was not at goal, we required that patients in all 4 samples have 2 or more primary care visits during each evaluation period.
The preimplementation evaluation period was March 1, 2009, to February 28, 2010. Applying prespecified exclusion rules to the 1231 patients identified for the preimplementation sample, we excluded 2 patients because they had a diagnosis of dementia (International Classification of Diseases, Ninth Revision Clinical Modification Codes 290-294), we excluded 4 patients because they resided in a nursing home, we excluded 44 patients because they did not have 2 or more primary care visits in the preimplementation period, and we excluded 145 patients because they did not have CHD or diabetes diagnosis codes. The final preimplementation CHD sample comprised 551 patients, and the final preimplementation diabetes sample comprised 485 patients.
The postimplementation evaluation period was December 1, 2011, to March 31, 2013. The postimplementation period was greater than 1 year because implementation was staggered in the 5 clinics. Applying prespecified exclusion rules to the 1202 patients identified for the postimplementation sample, we excluded 3 patients because of a diagnosis of dementia, 3 patients because they died during the observation period, 5 patients because they resided in a nursing home, 4 patients because they did not have 2 or more primary care visits in the postimplementation period, and 149 because they did not have CHD or diabetes diagnosis codes. The final postimplementation CHD sample comprised 529 patients, and the final postimplementation diabetes sample comprised 509 patients.
Surveys
Providers
To test whether the new system would improve provider satisfaction with the delivery of preventive services, we invited all primary care providers and administrative staff who provided primary care services to complete a survey before implementation. After system implementation, we invited the individuals who had completed the preimplementation survey to complete it again.
Patients
We invited community-living patients who were age 40 years or older, treated by the practice for CHD, and without terminal illness to complete a survey about the care they received and their satisfaction with their clinic. We adapted the survey instrument from a patient satisfaction survey we used in a previous trial.
23We mailed surveys to randomly selected patients with CHD, whom we identified via the clinics’ patient management system, if they met study inclusion criteria and had been seen at least once in primary care during an 18-month preintervention period. An attempt was made to contact patients by telephone if they did not respond to the mailing.
The patients who participated in the preintervention survey were invited to participate in the postintervention survey. The postintervention survey instrument and protocol were the same as those for the preintervention survey.
Clinical Performance Data Sources
We used risk factor data that had been collected as part of routine patient care to evaluate the main trial outcomes. Two trained nurses abstracted the data from the patients’ medical records. Because the clinics had not yet instituted an electronic medical record system at the beginning of the study, the nurses abstracted the preintervention data from paper charts. The clinics implemented an electronic medical record system (Cerner Corp, North Kansas City, MO) in May 2010; thus, we collected postimplementation data from electronic records.
We defined the primary outcomes for patients with CHD and patients with diabetes according to the goals of the Minnesota Community Measurement.
20 Patients with CHD had to meet a composite measure comprising the following criteria to be considered at goal: systolic blood pressure under 140 mmHg and diastolic blood pressure below 90 mmHg, LDL cholesterol less than 100 mg/dL, no tobacco use, and taking aspirin unless contraindicated. Patients with diabetes had to meet a composite measure comprising the same criteria plus have a hemoglobin A
1c level less than 8%.
To document the reliability of the data extraction process from the electronic records, the 2 nurse abstractors extracted the same data from the records of 50 patients. Kappa statistics for the comparison between the electronically extracted data and the data extracted by the nurses were as follows for systolic blood pressure, diastolic blood pressure, LDL cholesterol, tobacco use, and hemoglobin A1c, respectively: 0.82, 0.82, 0.86, 0.81, and 0.91. Kappa statistics for interrater reliability between the 2 chart auditors were 0.86, 1.00, 0.89, 0.82, and 0.87 for the same 5 data elements, respectively.
Statistical Analysis
We used statistical analysis software (SAS Version 9.3, SAS Institute, Cary NC) to generate all descriptive statistics (means, standard deviations, and proportions) and multivariable analyses. To compare differences between periods and subgroups, we used the Student t-test for continuous data and the χ2 test for categorical data. We used a difference-in-differences analysis to compare differences in blood pressure and LDL cholesterol between the CHD and diabetic pre- and postimplementation samples.
We employed a series of mixed model logistic regressions to compute predicted probabilities of binary outcomes (whether or not at goal for each component of the composite measure) and ordinal outcomes (the composite care score). We used an interaction term for time and condition (CHD, diabetes) to test our hypothesis that the increase in the proportion of patients satisfying the CHD composite measure would be greater than the increase in the proportion of patients satisfying the composite diabetes measure.
For our analysis of the provider survey, we compared individual item responses before and after implementation. For our analysis of the patient survey data, we also compared preimplementation responses with postimplementation responses.
Discussion
Using the principles of complex adaptive systems, we were able to help five private primary care clinic sites organize themselves to provide team-based care for their patients with CHD. Both LDL cholesterol control and aspirin documentation improved whereas patient satisfaction with their preventive services remained high and provider satisfaction with delivery of preventive services increased. However, the system did not generate sufficient revenue to offset the cost of team-based care.
These facts are evidence that the principles of complex adaptive systems can be used to implement nurse-led team-based care in a private primary care practice. As with the trial conducted by the Northern New England Cardiovascular Disease Study Group,
11 the clinicians themselves were able to locally develop and apply the systems and procedures that they needed to succeed. Analyses of large numbers of efforts to diffuse innovations suggest that autonomy to adapt an intervention to fit local conditions is necessary for success.
18,19Despite the fact that the composite scores of patients with CHD were not improved relative to the improvement in composite scores of patients with diabetes, there is other evidence of success: LDL cholesterol levels were significantly lower in the postimplementation sample of patients with CHD, a difference that did not occur between the two samples of patients with diabetes. Documentation of aspirin use also increased, but it did so both among patients with CHD and among patients with diabetes. Documentation of aspirin was responsible for the significant improvement in the composite scores. It is possible that hypertension control did not improve because of a ceiling effect. Even before team-based care, blood pressure control for patients in this practice was outstanding relative to the Healthcare Effectiveness Data and Information Set’s national average and that in other medical groups.
24Our trial has several limitations. Randomizing several clinics to intervention and control groups would have been a stronger study design. However, this was not an option for us. Although there is considerable evidence that a complex adaptive system strategy will succeed in other settings, this is not assured. Migration to an electronic record system and hiring of the RN Care Manager could have confounded the results. In fact, we believe that the RN Care Manager role was crucial to the results because the nurse was the communication and organizing node in the center of physicians, clinical care coordinators, and informatics. She also had time free from patient care that allowed her to work on system development. It is notable that one of the clinics hired the RN Care Manager in a new position of Quality Nurse after funding for the trial ended.
Because the patients with diabetes were treated by the same care teams that treated the patients with CHD, we do not know whether the improvement in aspirin documentation in both groups was caused by contamination by the newly implemented patient management system or whether it was due to another cause. We also believe that most of the change in documentation of aspirin use was simply change in documentation. If we were to consider only our primary hypothesis that the increase in the proportion of patients meeting the composite measure would be greater for patients with CHD than for diabetic patients, we would need to conclude that the study failed. However, we believe that there is still much to be learned from this trial.