Safe and Effective Implementation of Telestroke in a US Community Hospital Setting

Safe and Effective Implementation of Telestroke  in a US Community Hospital Setting


Kori Sauser-Zachrison, MD, MSc; Ernest Shen, PhD; Navdeep Sangha, MD;
Zahra Ajani, MD; William P Neil, MD; Michael K Gould, MD, MS;
Dustin Ballard, MD; Adam L Sharp, MD, MS

Perm J 2016 Fall; 20(4):15-217
E-pub: 07/29/2016

Safe and Effective Implementation of Telestroke  in a US Community Hospital Setting


Context: There is substantial hospital-level variation in use of tissue plasminogen activator (tPA) for treatment of acute ischemic stroke. Telestroke services can bring neurologic expertise to hospitals with fewer resources.
Objective: To determine whether implementation of a telestroke intervention in a large integrated health system would lead to increased tPA utilization and would change rates of hemorrhagic complications.
Design: A stepped-wedge cluster randomized trial of 11 community hospitals connected to 2 tertiary care centers via telestroke, implemented at each hospital incrementally during a 1-year period. We examined pre- and postimplementation data from July 2013 through January 2015. A 2-level mixed-effects logistic regression model accounted for the staggered rollout.
Main Outcome Measures: Receipt of tPA. Secondary outcome was the rate of significant hemorrhagic complications.
Results: Of the 2657 patients, demographic and clinical characteristics were similar in pre- and postintervention cohorts. Utilization of tPA increased from 6.3% before the intervention to 10.9% after the intervention, without a significant change in complication rates. Postintervention patients were more likely to receive tPA than were preintervention patients (odds ratio = 2.0; 95% confidence interval = 1.2-3.4). Before implementation, 8 of the 10 community hospitals were significantly less likely to administer tPA than the highest-volume tertiary care center; however, after implementation, 9 of the 10 were at least as likely to administer tPA as the highest-volume center.
Conclusion: Telestroke implementation in a regional integrated health system was safe and effective. Community hospitals’ rates of tPA utilization quickly increased and were similar to the largest-volume tertiary care center.


Tissue plasminogen activator (tPA) is the only treatment approved by the US Food and Drug Administration for acute ischemic stroke, but tPA continues to be underutilized.1-3 There are many reasons for this underutilization, including patient factors as well as physician and hospital factors. Among the patient factors that exclude patients from receiving tPA are that patients present outside the treatment window or otherwise fail to meet inclusion criteria for the treatment. Physician and hospital-level factors contributing to less-than-ideal tPA utilization include emergency physicians’ discomfort with the medication and its risk profile, and varying levels of hospital resources and support. Indeed, in a previous analysis of our 14-hospital regional integrated health care system, we found considerable hospital-level variation in tPA utilization.4

Because of this substantial variation between hospitals’ tPA utilization in our health care system, a systemwide telestroke project was implemented. Telestroke refers to the use of telecommunication technologies to provide medical information and services for stroke care, and it is a valuable tool to fill gaps in access to acute stroke services.5,6 In the provision of emergent neurologic expertise, telestroke may enable Medical Centers to overcome major barriers to tPA utilization6,7 and has a Class I recommendation based on Level A evidence supporting this application.8

Kaiser Permanente Southern California (KPSC) is ideally organized for implementation of telestroke. The system includes 2 tertiary Medical Centers with in-house stroke neurology and neurologic intensive care units, as well as 12 community Medical Centers that lack such resources. By connecting the resources of the tertiary centers with the needs at the other hospitals, implementation of telestroke could improve the care of all patients with ischemic stroke in the system.


We performed a stepped-wedge cluster randomized trial; this design has advantage over a simple pre-post analysis in that it allows for modeling the effect of time on the effectiveness of the intervention. The telestroke intervention was implemented in 11 Medical Centers and incrementally rolled out over the study period. Each Medical Center’s Emergency Department (ED) was connected to an on-call stroke neurologist through telemedicine technology. Emergency physicians were encouraged to consult the on-call stroke neurologist via telestroke on any patient presenting with signs and symptoms suggestive of stroke such as sudden difficulty with speech, strength, sensation, balance, or vision, and arriving within 6 hours of onset. Our primary objective was to determine the effectiveness of the intervention as indicated by increased tPA utilization after implementation. Our secondary objective was to assess for safety of the intervention by examining whether there were changes in rates of tPA-related bleeding complications.

Data Source and Populations

Structured data from electronic health and administrative records identified all patients presenting to 1 of 11 participating EDs in our health care system between July 1, 2013, and January 15, 2015, with a primary diagnosis of ischemic stroke using International Classification of Diseases, Ninth Revision (ICD-9) Codes 433.xx, 434.xx, and 436. Because 2 of the community-based sites had previously implemented telestroke through outside vendors, and 1 hospital has 24-hour inhospital neurologist availability because of a neurology residency, we excluded patients from those sites. Instead, we focused our analysis on the 11 community-based sites in which telestroke was a new intervention. These Medical Centers had a staggered implementation of the telestroke intervention. Medical Center 1 began implementation on August 15, 2013, and the other centers began on the following dates in 2014: Medical Center 2 on January 20, Medical Centers 3 and 4 on May 19, Medical Center 5 on June 11, Medical Center 6 on July 2, Medical Centers 7 and 8 on July 28, Medical Center 9 on August 25, Medical Center 10 on September 2, and Medical Center 11 on December 16.

Demographic and clinical details were extracted for each patient, as well as tPA utilization and an indicator of whether telestroke was used for each visit. We excluded patients younger than age 18 years, those with a previous stroke within 90 days, and those with missing or implausible brain imaging or tPA administration times. The data were combined with predefined rollout dates to create indicators of intervention status by Medical Center per rollout month. Each patient was categorized as preintervention or postintervention on the basis of whether telestroke had been implemented at the presenting hospital by the date of patient presentation. Human subjects approval was obtained through the KPSC institutional review board.

Outcome Measures

The primary outcome was tPA receipt, identified by pharmacy code. Our secondary safety outcome was intracranial or gastrointestinal bleeding, identified by ICD-9 codes (432.xx, 430, 431, and 578.xx). One of the authors (AS) reviewed all charts of patients with questions of the outcome variables.

Statistical Analysis

Patient characteristics were described using medians and quartiles or means with standard deviations for all continuous variables, and frequencies and percentages for all categorical variables. All analyses were 2-tailed and were performed at a significance level of 0.05. For continuous variables with missing values, we used mean imputation and constructed indicator variables for missingness. For categorical variables, an “unknown” category was created, along with the same missing indicators. This ensured that study group comparisons could be constructed for all observations.

The outcome of interest was defined as tPA receipt at a given encounter. It was operationalized both at the patient level to assess patient characteristics and at the medical-center level to assess variability in rates between centers and more appropriately account for effects of the study design. For the former, we used logistic regression to assess the intervention effects on tPA utilization at individual encounters. For the latter, we used negative binomial regression to assess whether the telestroke intervention effect varied by Medical Center. This approach also allowed us to include an offset term (log stroke volume) to scale each Medical Center’s monthly rate relative to its monthly stroke volume.

The model included indicators for Medical Centers to account for baseline variability between centers, indicators for exposure and length of exposure to the telestroke intervention, and Medical Center by intervention interactions to assess the heterogeneity in treatment effects. The model adjusted for patient-level demographic and clinical characteristics. We also assessed time-by-intervention interactions but found that the intervention effect did not appear to vary by length of exposure to the telestroke intervention. We also tested for interactions with patient race, ambulance arrival, and patient sex. Where necessary, forest plots were used to assess the interactions between the telestroke intervention and the relevant variables. All analyses were conducted using SAS 9.3 software (SAS Institute Inc, Cary, NC).


Of the 2657 patients included in our analysis, 1613 presented in the preintervention period (before implementation of telestroke), and 1044 presented in the postintervention period. The pre- and postintervention cohorts were similar in demographic characteristics and medical history (Table 1).

As detailed in Table 2, tPA utilization increased from 6.3% to 10.9% from the pre- to postintervention period, with no meaningful change in rates of bleeding complications. Telestroke was engaged in 24% of patient encounters in the postintervention period.

Safe and Effective Implementation of Telestroke  in a US Community Hospital Setting

Safe and Effective Implementation of Telestroke  in a US Community Hospital Setting

Primary Outcome

Patients treated in the postintervention period were more likely to receive tPA than those treated before the intervention (odds ratio = 2.0, 95% confidence interval = 1.17-3.4).

Before telestroke implementation, 8 of the 10 community Medical Centers were significantly less likely to administer tPA to patients with ischemic stroke compared with the largest-volume stroke center. After the telestroke implementation, however, 9 of the 10 community Medical Centers were at least as likely to administer tPA to ischemic stroke patients as that highest-volume stroke center (Figure 1). The effect of the intervention did not vary significantly by patient race, ambulance arrival, or arrival off-hours (5 pm-8 am Monday to Friday, or anytime Saturday or Sunday).

Secondary Outcomes

There were no meaningful differences in intracranial or gastrointestinal bleeding complications from the pre- to postintervention periods, and overall bleeding complications was slightly lower after the intervention (5.1% vs 4.9%; Table 2). There were also improvements in median time from door to imaging (preintervention = 56 minutes vs postintervention = 44 minutes) and door to needle (66 minutes vs 55 minutes).

We also assessed the same Medical Center-by-intervention interaction for the patient-level data. This additional analysis revealed a similar pattern as in Figure 1, suggesting that further adjusting for patient characteristics did not change our conclusions. Furthermore, we believe the Medical Center-level analysis provides the added benefit of scaling the monthly rates for each Medical Center by its monthly stroke volumes, and thus provides a clearer interpretation of the findings.

Safe and Effective Implementation of Telestroke  in a US Community Hospital Setting


In this stepped-wedge cluster randomized trial, we found that implementation of a telestroke intervention in our integrated health system improved rates of tPA administration for patients with ischemic stroke presenting to the community Medical Centers in the postintervention period. Rates of bleeding complications remained acceptably low and did not rise with the increased rate of tPA administration. Our results reinforce the utility of telestroke as previously reported. Many studies have demonstrated the utility of telestroke for assessing stroke severity9-12 and for increasing the use of tPA among eligible patients.13-17 Our findings add to this body of literature supporting the value of telestroke for improving tPA administration rates among patients with ischemic stroke presenting to community hospitals. We found that telestroke can be implemented safely and effectively in community hospitals, and that the beneficial effects (increased tPA utilization) occurred quickly after implementation without a significant lag period and without any corresponding change in complications.

These findings have important implications for future delivery of stroke care. Particularly in hospitals with limited local resources and/or limited access to neurologic expertise, telestroke is an important tool to aid in the evaluation and treatment of potential stroke. We specifically found that unwarranted hospital variability in stroke care could be eliminated through a standardized telestroke program. Additionally, telestroke may aid in triage and transfer decisions and in identifying patients potentially eligible for endovascular intervention or patients who might otherwise benefit from transfer to a stroke center. Future work may help to clarify the role for telestroke in such decisions.

Our study does have limitations. Our study design does not allow for a calculation of statistical power. We were unable to define the population of patients eligible for tPA; our finding of increased tPA utilization reflects an increased rate of tPA use among all patients with ischemic stroke. However, it is unlikely that our findings reflect a simple increase in the proportion of tPA-eligible patients because the study was conducted over a short period and without any corresponding public health messaging. Secondly, telestroke was utilized in 24% of cases after the intervention, and we do not know what distinguished these cases from those that did not engage telestroke. The seemingly low utilization rate may suggest that most patients with stroke arrived beyond the therapeutic time window. Additional patients may have been excluded if the ED physician noted obvious contraindications to thrombolytic therapy such as recent surgery or anticoagulant use, or if symptoms completely resolved before the telestroke call. Furthermore, we cannot confirm that the 24% of cases in which telestroke was utilized were the same cases in which the improved tPA rate was realized. Yet in the absence of other interventions or quality-improvement initiatives, it is reasonable to attribute the change in tPA utilization to the major systematic change that took place during this intervention period. Finally, we were unable to assess physician satisfaction with telestroke. Future work in our system should examine whether telestroke remains a frequently used tool, clarify the reasons for physicians’ activation or deferral of telestroke, and confirm physician comfort and satisfaction with the use of telestroke for patients with ischemic stroke.


In our regional integrated health system, we found that implementation of a telestroke intervention eliminated unwarranted hospital variation in care and led to increased rates of tPA utilization among patients with acute ischemic stroke, with consistently low rates of hemorrhagic complications. Telestroke was implemented safely and effectively in this US community hospital setting.

Disclosure Statement

The author(s) have no conflicts of interest to disclose.


Kathleen Louden, ELS, of Louden Health Communications provided editorial assistance.

How to Cite this Article

Sauser-Zachrison K, Shen E, Sangha N, et al. Safe and effective implementation of telestroke in a US community hospital setting. Perm J 2016 Fall;20(4):15-217. DOI:

1.    Qureshi AI, Suri MF, Nasar A, et al. Thrombolysis for ischemic stroke in the United States: data from National Hospital Discharge Survey 1999-2001. Neurosurgery 2005 Oct;57(4):647-54. DOI:
2.    Katzan IL, Furlan AJ, Lloyd LE, et al. Use of tissue-type plasminogen activator for acute ischemic stroke: the Cleveland area experience. JAMA 2000 Mar 1;283(9):1151-8. DOI:
3.    Katzan IL, Hammer MD, Hixson ED, Furlan AJ, Abou-Chebl A, Nadzam DM; Cleveland Clinic Health System Stroke Quality Improvement Team. Utilization of intravenous tissue plasminogen activator for acute ischemic stroke. Arch Neurol 2004 Mar;61(3):346-50. DOI:
4.    Sauser-Zachrison K, Shen E, Ajani Z, et al. Emergency care of patients with acute ischemic stroke in the Kaiser Permanente Southern California Integrated Health System. Perm J 2016 Spring;20(2):10-3. DOI:
5.    Schwamm LH, Holloway RG, Amarenco P, et al; American Heart Association Stroke Council; Interdisciplinary Council on Peripheral Vascular Disease. A review of the evidence for the use of telemedicine within stroke systems of care: a scientific statement from the American Heart Association/American Stroke Association. Stroke 2009 Jul;40(7):2616-34. DOI:
6.    Schwamm LH, Audebert HJ, Amarenco P, et al; American Heart Association Stroke Council; Council on Epidemiology and Prevention; Interdisciplinary Council on Peripheral Vascular Disease; Council on Cardiovascular Radiology and Intervention. Recommendations for the implementation of telemedicine within stroke systems of care: a policy statement from the American Heart Association. Stroke 2009 Jul;40(7):2635-60. DOI:
7.    Brown DL, Barsan WG, Lisabeth LD, Gallery ME, Morgenstern LB. Survey of emergency physicians about recombinant tissue plasminogen activator for acute ischemic stroke. Ann Emerg Med 2005 Jul;46(1):56-60. DOI:
8.    Higashida R, Alberts MJ, Alexander DN, et al; American Heart Association Advocacy Coordinating Committee. Interactions within stroke systems of care: a policy statement from the American Heart Association/American Stroke Association. Stroke 2013 Oct;44(10):2961-84. DOI:
9.    Shafqat S, Kvedar JC, Guanci MM, Chang Y, Schwamm LH. Role for telemedicine in acute stroke. Feasibility and reliability of remote administration of the NIH stroke scale. Stroke 1999 Oct;30(10):2141-5. DOI:
10.    Wang S, Lee SB, Pardue C, et al. Remote evaluation of acute ischemic stroke: reliability of National Institutes of Health Stroke Scale via telestroke. Stroke 2003 Oct;34(10):e188-91. DOI:
11.    Demaerschalk BM, Vegunta S, Vargas BB, Wu Q, Channer DD, Hentz JG. Reliability of real-time video smartphone for assessing National Institutes of Health Stroke Scale scores in acute stroke patients. Stroke 2012 Dec;43(12):3271-7. DOI:
12.    Anderson ER, Smith B, Ido M, Frankel M. Remote assessment of stroke using the iPhone 4. J Stroke Cerebrovasc Dis 2013 May;22(4):340-4. DOI:
13.    LaMonte MP, Bahouth MN, Hu P, et al. Telemedicine for acute stroke: triumphs and pitfalls. Stroke 2003 Mar;34(3):725-8. DOI:
14.    Choi JY, Porche NA, Albright KC, Khaja AM, Ho VS, Grotta JC. Using telemedicine to facilitate thrombolytic therapy for patients with acute stroke. Jt Comm J Qual Patient Saf 2006 Apr;32(4):199-205.
15.    Schwamm LH, Rosenthal ES, Hirshberg A, et al. Virtual TeleStroke support for the emergency department evaluation of acute stroke. Acad Emerg Med 2004 Nov;11(11):1193-7. DOI:
16.    Wang S, Gross H, Lee SB, et al. Remote evaluation of acute ischemic stroke in rural community hospitals in Georgia. Stroke 2004 Jul;35(7):1763-8. DOI:
17.    Meyer BC, Raman R, Hemmen T, et al. Efficacy of site-independent telemedicine in the STRokE DOC trial: a randomised, blinded, prospective study. Lancet Neurol 2008 Sep;7(9):787-95. DOI:


The Permanente Journal (ISSN 1552-5767) is published quarterly by The Permanente Press. Journal subscriptions are entered for the calendar year. Advance payment in US dollars is required.


25,000 print readers per quarter, 7,628 eTOC readers, and in 2016, 1.4 million page views on TPJ articles in PubMed from a broad international readership.


Articles, editorials, letters to the editor, and other material represent the opinion of the authors. Send your comments to

Copyright 2017 The Permanente Journal - Kaiser Permanente. All Rights Reserved.