Difference in Effectiveness of Medication Adherence Intervention by Health Literacy Level

Ashli A Owen-Smith, PhD, SM; David H Smith, PhD, RPh; Cynthia S Rand, PhD; Jeffrey O Tom, MD, MS;
Reesa Laws; Amy Waterbury, MPH; Andrew Williams, PhD; William M Vollmer, PhD

Perm J 2016 Summer;20(3):15-200

https://doi.org/10.7812/TPP/15-200

E-pub: 06/29/2016

ABSTRACT

Context: There is little research investigating whether health information technologies, such as interactive voice recognition, are effective ways to deliver information to individuals with lower health literacy.
Objective: Determine the extent to which the impact of an interactive voice recognition-based intervention to improve medication adherence appeared to vary by participants’ health literacy level.
Design: Promoting Adherence to Improve Effectiveness of Cardiovascular Disease Therapies (PATIENT) was a randomized clinical trial designed to test the impact, compared with usual care, of 2 technology-based interventions that leveraged interactive voice recognition to promote medication adherence. A 14% subset of participants was sent a survey that included questions on health literacy. This exploratory analysis was limited to the 833 individuals who responded to the survey and provided data on health literacy.
Main Outcome Measures: Adherence to statins and/or angiotensin-converting enzyme inhibitors and/or angiotensin II receptor blockers.
Results: Although intervention effects did not differ significantly by level of health literacy, the data were suggestive of differential intervention effects by health literacy level.
Conclusions: The differences in intervention effects for high vs low health literacy in this exploratory analysis are consistent with the hypothesis that individuals with lower health literacy may derive greater benefit from this type of intervention compared with individuals with higher health literacy. Additional studies are needed to further explore this finding.

INTRODUCTION

Treatment nonadherence with cardiovascular disease (CVD) therapy has been well documented¹ and is a major contributor to increased cardiovascular risk and morbidity.² At the population level, low adherence is often the broken link between effective new therapies and improved health outcomes.³ Nonadherence has also been identified as a key target for reducing unnecessary health care costs.^4,5

The most effective adherence interventions include both educational and behavioral strategies⁶; however, these strategies are costly and require both staff time and specialized counseling skills, which can limit the likelihood for dissemination. Furthermore, most interventions evaluated thus far have enrolled highly select and small patient populations, thus limiting generalizability. More recently, research has focused on using health information technologies (HIT) to develop low-cost interventions that can be delivered to large populations to promote adherence for patients with chronic illness.^7-9 For example, one recent study described an intervention among 5216 adults who were newly prescribed a statin but had failed to fill the prescription.¹⁰ The intervention group received automated telephone reminder calls followed by mailed letters. The intervention improved initial fill rates during the next 25 days by 16 percentage points. These and other studies suggest that HIT-based reminder interventions offer a promising, “light-touch” option for promoting adherence in large populations.^11-14

Although HIT-based interventions may be more easily disseminated, reach a greater number of people, and be lower cost, they may exacerbate certain health disparities, because more educated and technologically advanced individuals will benefit disproportionately from such advances.^15,16 Patients with low health literacy—individuals who face challenges with respect to their capacity to obtain, process, and understand basic health information and services needed to make appropriate health decisions¹⁷—are likely to be particularly vulnerable in this regard.¹⁸ Individuals with low health literacy, for example, are much less likely to use computers, mobile applications, and other consumer and patient medical devices.^19,20 Consequently, it has been argued that interactive voice recognition (IVR) is one type of HIT that may be particularly well suited for delivering interventions to low-literacy individuals because it 1) delivers information via speech instead of text and 2) uses the telephone so that computer access and computer literacy are not required.^19,21,22

An Institute of Medicine report²³ in 2004 called for studies that establish effective approaches to reduce the negative effects of limited health literacy. However, there is still little research to date investigating whether IVR systems are, in fact, effective ways to deliver health information to lower health literacy individuals with chronic disease.

The purpose of the present exploratory analysis was to explore whether an IVR-based intervention to improve medication adherence among individuals with CVD or diabetes mellitus would yield differences in outcomes according to participants’ health literacy level.

METHODS

Study Design

The Promoting Adherence to Improve Effectiveness of Cardiovascular Disease Therapies (PATIENT) study was a randomized pragmatic clinical trial in which 21,752 adults were randomly assigned to receive either usual care or 1 of 2 HIT-based interventions designed to increase adherence to statins, angiotensin-converting enzyme inhibitors (ACEIs), and angiotensin II receptor blockers (ARBs). Before randomization at baseline, a subgroup of potentially eligible individuals (n = 2965) were recruited to participate in an interviewer-administered survey via telephone in English, which was conducted centrally by a team of experienced interviewers. The baseline survey was administered from September through December 2011 and had a completion rate of 57% (n = 1678). Among those who completed the survey, 833 respondents ultimately were randomly assigned to participate in the intervention. Data for the present study were based on this subgroup of individuals.

Research Setting

Participants were members of 1 of 3 Regions of Kaiser Permanente (KP), a health maintenance organization providing comprehensive, prepaid health care to its members. The three Regions, Northwest (KPNW), Hawaii (KPHI), and Georgia (KPGA), collectively serve a population of about 944,000 individuals. The institutional review boards at all 3 study sites approved the study. An external data and safety monitoring board and local clinician advisory boards at each site approved the study protocol and monitored the study for safety and data quality.

The PATIENT Study

We have previously described the PATIENT study in detail.²⁴ Using each Region’s electronic medical records (EMRs), we identified participants aged 40 years and older with diabetes mellitus and/or CVD, with suboptimal (< 90%) adherence to a statin or ACEI/ARB during the previous 12 months, and who were due or overdue for a refill. Individuals with medical conditions that might contraindicate the use of these medications (eg, allergic to the medication, liver failure, cirrhosis, rhabdomyolysis, end-stage renal disease, chronic kidney disease) and those on KP’s “do not contact” list were excluded. In each Region, we randomly assigned a sample of eligible members to the 3 study arms (usual care and 2 intervention arms) in a 1:1:1 ratio at the study outset and repeated this process for newly eligible members for each of the following 5 months. Study enrollment began in December 2011 and continued through May 2012. Intervention and outcome assessment continued through November 2012.

In the first intervention arm, IVR, participants received automated phone calls when they were due or overdue for a refill of their ACE/ARB and/or statin. Patients were offered a transfer to KP’s automated pharmacy refill line. In the second intervention arm, enhanced IVR, participants received the same calls as in the IVR arm but also received a personalized reminder letter if they were 60 to 90 days overdue and a live outreach call if they were 90 days or more overdue, as well as EMR-based feedback to their primary care clinicians. Participants in the enhanced IVR arm received additional written and graphic materials, including a personalized health report with their most recent blood pressure and cholesterol levels, a pill organizer, and bimonthly mailings to answer common questions. The IVR call scripts, letters, and other mailings were written at a sixth-grade reading level.

Study Measurements

Electronic Medical Record Data

We used a modified version of the Proportion of Days Covered for our primary measure of medication adherence.²⁵ Because we were measuring long-term medications that the patients were known to be taking at the time of randomization, we modified the Proportion of Days Covered to include the whole follow-up period as the denominator timeframe rather than time from first dispensing.²⁶ We also accounted for medication on hand at randomization and ignored any medication remaining at the end of follow-up. We computed the modified Proportion of Days Covered separately for statins and ACEI/ARBs. To simplify enrollment logistics, we defined study eligibility at baseline using the simpler Medication Possession Ratio, which we computed by dividing total days’ dispensed supply by 365 and capping at 1.

We used the EMR to capture age, race, sex, physical and mental health comorbidities, smoking status, body mass index, number of medications dispensed, health care utilization, hospital and Emergency Department visits, and blood pressure and lipid levels. We defined baseline systolic and diastolic blood pressure levels as the mean of the 6 most recent measurements taken during the 12 months before randomization. Follow-up blood pressure was defined as the mean of the 6 most recent measurements taken before the end of the study period, which ranged from 6 to 12 months of follow-up depending on when randomization occurred. We defined blood pressure control as blood pressure below 140/90 mmHg and lipid control as a low-density-lipoprotein cholesterol level below 100 mg/dL.

Survey Data

Participants were asked three single-item health literacy questions (see Sidebar: Health Literacy Questions). The first question, used previously by Williams and colleagues,²⁷ aimed to assess participants’ use of a surrogate reader: “How often do you need to have someone help you when you read instructions, pamphlets, or other written materials from your doctor or pharmacy?” Participants responded using a five-item Likert scale ranging from “never” to “always.” We considered participants who indicated that they “always” or “often” needed help as having low health literacy for this question. The second question, used by Chew and colleagues,^28,29 aimed to assess participants’ confidence with medical forms: “How confident are you filling out medical forms by yourself?” Participants responded using a five-item Likert scale ranging from “not at all” to “extremely.” We considered participants who indicated that they were “not at all” or “a little bit” confident as having low health literacy for this question. The third question, also used by Williams and colleagues,²⁷ aimed to assess participants’ self-rated reading ability: “How would you rate your ability to read?” Participants responded using a six-item Likert scale ranging from “very poor” to “excellent.” We considered participants who indicated that their reading ability was “very poor” or “poor” as having low health literacy for this question. For the purposes of this study, we assigned individuals to the low health literacy group if their responses met those criteria on any of the three questions.

Participants were asked about their current health status and health-related quality of life using the Health Utilities Index. Both the Mark 2 and Mark 3 Health Utilities Index instruments were used to provide a comprehensive health status classification based on the domains of health and levels of functional ability/disability in each domain. These domains included vision, hearing, speech, ambulation, dexterity, cognition, pain, self-care, and emotion.³⁰

Participants were asked whether they were satisfied with the care they received from their clinicians and whether they could indicate that they were “very satisfied,” “satisfied,” “uncertain,” “unsatisfied,” or “very unsatisfied.” Individuals were categorized as satisfied with their health care if they endorsed that they were either “very satisfied” or “satisfied” in response to this question.

Finally, participants were asked about their highest level of schooling completed, total household income, and marital status.

Statistical Analysis

Among those who participated in the baseline survey (N = 1678), complete health literacy and intervention outcome data were available for only 833 of these individuals. The other 845 individuals who completed the survey were not randomly assigned to participate in the intervention. Therefore, our analyses are restricted to this subset of 833 participants. For bivariate analyses, we used t-tests for comparisons of means of continuous variables, Pearson c² tests for comparing unordered categorical data, and Mantel-Haenszel c² tests for comparing ordered categorical data. Separate analyses were conducted for users of statins and users of ACEI/ARBs. We assessed whether intervention effects differed by health literacy level in general linear models with main effects for treatment arm, health literacy, and their interaction. Main effect estimates were adjusted for site and sex. We assessed follow-up from randomization until the end of the study or loss of Health Plan coverage, whichever came first.

Because the study was not designed to examine whether the intervention effects differed by health literacy level, these post hoc analyses are inevitably exploratory in nature, and we made no adjustment for multiple comparisons or to conduct retrospective power calculations. Statistical software (SAS v9.2, SAS Institute, Cary, NC) was used for statistical analyses.

RESULTS

The study population was approximately 65 years of age on average, equally men and women, predominantly white (approximately 58%), had some college or a college degree (approximately 54%), were middle income, and were currently married or with a partner (approximately 63%). Approximately 18% of participants had low health literacy (n = 148). Participants who had low health literacy were more likely to be older, have a lower level of education, report a lower total household income, use health care services more frequently, report poorer health status, and have a depression diagnosis compared with participants who had higher health literacy (Table 1).

Although both the IVR and enhanced IVR interventions increased adherence to statins and ACEIs/ARBs compared with usual care in the full trial analysis, in this much smaller sample we did not observe statistically significant differences between either IVR or enhanced IVR and usual care in subgroups defined by health literacy status (Table 2). Of more immediate relevance to the focus of this exploratory analysis, however, the data were suggestive of differential intervention effects for low and high health literacy. Among participants with low health literacy, for example, the IVR and enhanced IVR interventions were associated with statin adherence that was 9% to 10.5% higher than for usual care. By contrast, among participants with high health literacy, statin adherence in the IVR and enhanced IVR groups was 2.6% to 3.2% lower than for usual care.

We observed a similar pattern for ACEI/ARB adherence. Participants with low health literacy in either IVR group (IVR or enhanced IVR) had ACEI/ARB adherence that was 7.5 percentage points to 14.6 percentage points higher than for usual care, whereas among participants with high health literacy the IVR and enhanced IVR interventions were associated with ACEI/ARB adherence that was 1.1 percentage points to 5.3 percentage points lower than for usual care. However, although consistent with an interaction effect, none of the tests of health literacy by treatment interactions was statistically significant.

DISCUSSION

Although not statistically significant, the differences in observed intervention effects for high vs low health literacy in the study sample are certainly consistent with the hypothesis that individuals with lower health literacy may derive greater benefit from this type of intervention compared with individuals with higher health literacy. In a review of promising HIT interventions for diabetes, Boren²¹ identified telephone interventions for education, counseling, and reminding as an appropriate method for individuals with limited health literacy. Our results provide some preliminary support for this notion.

Approximately 18% of the study population in the present study had low health literacy; this estimate is generally consistent with prior studies. Depending on the study population and health literacy measure employed, the prevalence of low health literacy ranges from 11% to 44%.^31-35 Also consistent with the prior literature, we found that individuals with lower health literacy are more likely to be of lower socioeconomic status compared with higher health literacy individuals. For example, other studies have similarly reported that years of school completed^31-34,36-39 and income^32-34,38,39 are significantly associated with health literacy level.

Individuals with low health literacy in the present study were more likely to have poorer health-related quality of life and a depression diagnosis compared with those with high health literacy. Prior studies have consistently reported that lower health literacy populations frequently experience poorer health status as indicated by 1) specific biochemical and biometric health outcomes such as higher blood pressure^37,40 and poor control of Type 2 diabetes,^32,41,42 2) disease prevalence and incidence such as higher rates of depression,^43-46 and 3) global health status.^{31,33,38,47-49} In contrast to previous studies, individuals with low health literacy in this study were not more likely to have Emergency Department visits or hospitalizations in the previous six months compared with individuals with higher health literacy.^50-53 They were, however, more likely to use other health services such as regular office visits compared with individuals with higher health literacy.

Interestingly, individuals with low health literacy did not differ from individuals with high health literacy with respect to baseline statin or ACEI/ARB adherence. Although one study found a positive association between poor health literacy and low adherence to cardiovascular medications,⁵⁴ a recent systematic review examining this phenomenon concluded that the current evidence does not show a consistent relationship between health literacy and medication adherence in adults with CVD or diabetes.⁵⁵

The present study has several limitations. First, the small intervention effect seen in the parent trial, combined with the much smaller sample size for this analysis, greatly limits our power to detect significant interactions. Second, although the survey completion rate was satisfactory (approximately 57%), individuals who decided to participate in the survey may differ from those who declined to participate. For example, previous studies suggest that certain subgroups may be less likely to participate in telephone surveys, including men, those with less education, and individuals in poorer health.^56-58 Third, because the survey was administered only in English, individuals for whom English was a second language and/or who were uncomfortable or unable to complete the survey in English were not included; therefore, our findings cannot be generalized to these populations. Fourth, although we used 3 well-validated, reliable, single-item measures for identifying poor health literacy,⁵⁹ our summed health literacy score based on these 3 items has not been compared against one of the gold standard instruments, such as the Rapid Estimate of Adult Literacy in Medicine⁶⁰ or the Test of Functional Health Literacy in Adults.⁶¹

However, Hardie and colleagues⁵¹ similarly provided a summed health literacy score based on participants’ responses to 3 single-item questions and reported that these questions correctly identified individuals with inadequate health literacy 90% to 95% of the time. Therefore, we feel confident that we have accurately categorized the individuals who have low health literacy in our population. Another benefit of using these 3 items includes a shorter time burden for patients, as they take only a few minutes to complete (in contrast to the Test of Functional Health Literacy in Adults, which can take up to 30 minutes). In addition, these questions pose less risk of embarrassment to patients in contrast to the Rapid Estimate of Adult Literacy in Medicine, which asks patients to read aloud medical terms such as herpes, testicle, and hemorrhoids.

CONCLUSIONS

Attractive features of health interventions include both effectiveness and cost savings. With use of HIT and automation of the delivery of such health education messaging, there are possible cost savings associated with reduced personnel time.⁶² Furthermore, our findings suggest that lower health literacy populations may be more responsive to this type of IVR-based intervention compared with higher health literacy populations, a finding that may lead to even more efficient patient outreach. By allowing the health system to better tailor intervention activities to specific patient characteristics, limited financial resources can be allocated where there is the potential for the greatest impact. Future studies are needed to explore the most effective and efficient methods for identifying and reaching individuals with lower health literacy.

Disclosure Statement

The author(s) have no conflicts of interest to disclose.

Acknowledgments

Kathleen Louden, ELS, of Louden Health Communications provided editorial assistance.

How to Cite this Article

Owen-Smith AA, Smith DH, Rand CS, et al. Difference in effectiveness of medication adherence intervention by health literacy level. Perm J 2016 Summer;20(3):15-200. DOI: https://doi.org/10.7812/TPP/15-200.

References

1.    Naderi SH, Bestwick JP, Wald DS. Adherence to drugs that prevent cardiovascular disease: meta-analysis on 376,162 patients. Am J Med Sep;125(9):882-7.e1. DOI: https://doi.org/10.1016/
j.amjmed.2011.12.013.
2.    Ho PM, Bryson CL, Rumsfeld JS. Medication adherence: its importance in cardiovascular outcomes. Circulation 2009 Jun 16;119(23):3028-35. DOI: https://doi.org/10.1161/CIRCULATIONAHA.108.768986.
3.    Thinking outside the pillbox: a system-wide approach to improving patient medication adherence for chronic disease. Cambridge, MA: New England Healthcare Institute; 2009 Aug 12. p 12-4.
4.    Sokol MC, McGuigan KA, Verbrugge RR, Epstein RS. Impact of medication adherence on hospitalization risk and healthcare cost. Med Care 2005 Jun;43(6):521-30. DOI: https://doi.org/10.1097/01.mlr.0000163641.86870.af.
    5.    Steiner JF. Rethinking adherence. Ann Intern Med 2012 Oct 16;157(8):580-5. DOI: https://doi.org/10.7326/0003-4819-157-8-201210160-00013.
    6.    Haynes RB, Ackloo E, Sahota N, McDonald HP, Yao X. Interventions for enhancing medication adherence. Cochrane Database Syst Rev 2008
Apr 16;(2):CD000011. DOI: https://doi.org/
10.1002/14651858.CD000011.pub3.
    7.    Misono AS, Cutrona SL, Choudhry NK, et al. Healthcare information technology interventions to improve cardiovascular and diabetes medication adherence. Am J Manag Care 2010 Dec;16(12 Suppl HIT):SP82-92.
    8.    Howren MB, Van Liew JR, Christensen AJ. Advances in patient adherence to medical treatment regimens: the emerging role of technology in adherence monitoring and management. Social and Personality Psychology Compass 2013 July;7(7):
427-43. DOI: https://doi.org/10.1111/spc3.12033.
    9.    Vollmer WM, Feldstein A, Smith DH, et al. Use of health information technology to improve medication adherence. Am J Manag Care 2011 Dec;17(12 Spec No.):SP79-87.
    10.    Derose SF, Green K, Marrett E, et al. Automated outreach to increase primary adherence to cholesterol-lowering medications. JAMA Intern Med 2013 Jan 14;173(1):38-43. DOI: https://doi.org/ 10.1001/2013.jamainternmed.717.
    11.    Christakis DA, Garrison MM, Lozano P, Meischke H, Zhou C, Zimmerman FJ. Improving parental adherence with asthma treatment guidelines: a randomized controlled trial of an interactive website. Acad Pediatr 2012 Jul-Aug;12(4):302-11. DOI: https://doi.org/10.1016/j.acap.2012.03.006.
    12.    McMahon GT, Fonda SJ, Gomes HE, Alexis G, Conlin PR. A randomized comparison of online- and telephone-based care management with internet training alone in adult patients with poorly controlled type 2 diabetes. Diabetes Technol Ther 2012 Nov;14(11):1060-7. DOI: https://doi.org/10.1089/dia.2012.0137.
    13.    Piette JD, Weinberger M, Kraemer FB, McPhee SJ. Impact of automated calls with nurse follow-up on diabetes treatment outcomes in a Department of Veterans Affairs health care system: a randomized controlled trial. Diabetes Care 2001 Feb;24(2):202-8. DOI: https://doi.org/10.2337/diacare.24.2.202.
    14.    Vervloet M, Linn AJ, van Weert JC, de Bakker DH, Bouvy ML, van Dijk L. The effectiveness of interventions using electronic reminders to improve adherence to chronic medication: a systematic review of the literature. J Am Med Inform Assoc 2012 Sep-Oct;19(5):696-704. DOI: https://doi.org/10.1136/amiajnl-2011-000748.
    15.    Bodie GD, Dutta MJ. Understanding health literacy for strategic health marketing: eHealth literacy, health disparities, and the digital divide. Health Mark Q 2008;25(1-2):175-203. DOI: https://doi.org/10.1080/07359680802126301.
    16.    Norman CD, Skinner HA. eHealth literacy: essential skills for consumer health in a networked world. J Med Internet Res 2006;8(2):e9. DOI: https://doi.org/10.2196/jmir.8.2.e9.
    17.    Healthy People 2010: Understanding and improving health. 2nd ed. Washington, DC: US Department of Health and Human Services; 2000.
    18.    Bickmore TW, Pfeifer LM, Byron D, et al. Usability of conversational agents by patients with inadequate health literacy: evidence from two clinical trials. J Health Commun 2010;15 Suppl 2:197-210. DOI: https://doi.org/10.1080/10810730.2010.499991.
    19.    Bickmore TW, Paasche-Orlow MK. The role of information technology in health literacy research.
J Health Commun 2012;17 Suppl 3:23-9.
    20.    Kutner M, Greenberg E, Jin Y, Paulsen C. The health literacy of America’s adults: results from the 2003 National Assessment of Adult Literacy. Washington, DC: US Department of Education; 2006 Sep.
    21.    Boren SA. A review of health literacy and diabetes: opportunities for technology. J Diabetes Sci Technol 2009 Jan;3(1):202-9.
    22.    Piette JD. Interactive voice response systems in
the diagnosis and management of chronic disease. Am J Manag Care 2000 Jul;6(7):817-27.
    23.    Health literacy: a prescription to end confusion [Internet]. Washington, DC: Institute of Medicine; 2004 Apr [cited 2014 Jul 30]. Available from: www.iom.edu/~/media/Files/Report%20Files/2004/Health-Literacy-A-Prescription-to-End-Confusion/healthliteracyfinal.pdf.
    24.    Vollmer WM, Owen-Smith A, Tom JO, et al. Improving adherence to cardiovascular disease medications with information technology. Am J Manag Care 2014 Nov;20(11 Spec no. 17):SP502-10.
    25.    Andrade SE, Kahler KH, Frech F, Chan KA. Methods for evaluation of medication adherence and persistence using automated databases. Pharmacoepidemiol Drug Saf 2006 Aug;15(8):565-74; discussion 575-7. DOI: https://doi.org/10.1002/pds.1230.
    26.    Vollmer WM, Xu M, Feldstein A, Smith D, Waterbury A, Rand C. Comparison of pharmacy-based measures of medication adherence. BMC Health Serv Res 2012 Jun 12;12:155. DOI:
https://doi.org/10.1186/1472-6963-12-155.
    27.    Williams MV, Parker RM, Baker DW, et al. Inadequate functional health literacy among patients at two public hospitals. JAMA 1995 Dec 6;274(21):1677-82. DOI: https://doi.org/10.1001/jama.1995.03530210031026.
    28.    Chew LD, Griffin JM, Partin MR, et al. Validation of screening questions for limited health literacy in a large VA outpatient population. J Gen Intern Med 2008 May;23(5):561-6. DOI: http:/dx.doi.org/10.1007/s11606-008-0520-5.
    29.    Chew LD, Bradley KA, Boyko EJ. Brief questions
to identify patients with inadequate health literacy. Fam Med 2004 Sep;36(8):588-94.
    30.    Horsman J, Furlong W, Feeny D, Torrance G. The Health Utilities Index (HUI): concepts, measurement properties and applications. Health Qual Life Outcomes 2003 Oct 16;1:54. DOI: https://doi.org/10.1186/1477-7525-1-54.
    31.    Gazmararian JA, Baker DW, Williams MV, et al. Health literacy among Medicare enrollees in a managed care organization. JAMA 1999 Feb 10;281(6):545-51. DOI: https://doi.org/10.1001/jama.281.6.545.
    32.    Kim S, Love F, Quistberg DA, Shea JA. Association of health literacy with self-management behavior in patients with diabetes. Diabetes Care 2004 Dec;27(12):2980-2. DOI: https://doi.org/10.2337/diacare.27.12.2980.
    33.    Sudore RL, Mehta KM, Simonsick EM, et al. Limited literacy in older people and disparities in health and healthcare access. J Am Geriatr Soc 2006 May;54(5):770-6. DOI: https://doi.org/10.1111/j.1532-5415.2006.00691.x.
    34.    von Wagner C, Knight K, Steptoe A, Wardle J. Functional health literacy and health-promoting behavior in a national sample of British adults. J Epidemiol Community Health 2007 Dec;61(12):1086-90. DOI: https://doi.org/10.1136/jech.2006.053967.
    35.    Adeseun GA, Bonney CC, Rosas SE. Health literacy associated with blood pressure but not other cardiovascular disease risk factors among dialysis patients. Am J Hypertens 2012 Mar;25(3):348-53. DOI: https://doi.org/10.1038/ajh.2011.252.
    36.    Mancuso JM. Impact of health literacy and patient trust on glycemic control in an urban USA population. Nurs Health Sci 2010 Mar;12(1):94-104. DOI: https://doi.org/10.1111/j.1442-2018.2009.00506.x.
    37.    Pandit AU, Tang JW, Bailey SC, et al. Education, literacy, and health: mediating effects on hypertension knowledge and control. Patient Educ Couns 2009 Jun;75(3):381-5. DOI: https://doi.org/10.1016/j.pec.2009.04.006.
    38.    Wolf MS, Gazmararian JA, Baker DW. Health literacy and functional health status among older adults. Arch Intern Med 2005 Sep 26;165(17):1946-52. DOI: https://doi.org/10.1001/archinte.165.17.1946.
    39.    Kim SH. Health literacy and functional health status in Korean older adults. J Clin Nurs 2009 Aug;18(16):2337-43. DOI: https://doi.org/10.1111/j.1365-2702.2008.02739.x.
    40.    Powers BJ, Olsen MK, Oddone EZ, Thorpe CT, Bosworth HB. Literacy and blood pressure—do healthcare systems influence this relationship? A cross-sectional study. BMC Health Serv Res 2008 Oct 23;8:219. DOI: https://doi.org/10.1186/1472-6963-8-219.
    41.    Williams MV, Baker DW, Parker RM, Nurss JR. Relationship of functional health literacy to patients’ knowledge of their chronic disease. A study of patients with hypertension and diabetes. Arch Intern Med 1998 Jan 26;158(2):166-72. DOI: https://doi.org/10.1001/archinte.158.2.166.
    42.    Schillinger D, Grumbach K, Piette J, et al. Association of health literacy with diabetes outcomes. JAMA 2002 Jul 24-31;288(4):475-82. DOI: https://doi.org/10.1001/jama.288.4.475.
    43.    Gazmararian J, Baker D, Parker R, Blazer DG. A multivariate analysis of factors associated with depression: evaluating the role of health literacy as a potential contributor. Arch Intern Med 2000 Nov 27;160(21):3307-14. DOI: https://doi.org/10.1001/archinte.160.21.3307.
    44.    Gordon MM, Hampson R, Capell HA, Madhok R. Illiteracy in rheumatoid arthritis patients as determined by the Rapid Estimate of Adult Literacy in Medicine (REALM) score. Rheumatology (Oxford) 2002 Jul;41(7):750-4. DOI: https://doi.org/10.1093/rheumatology/41.7.750.
    45.    TenHave TR, Van Horn B, Kumanyika S, Askov E, Matthews Y, Adams-Campbell LL. Literacy assessment in a cardiovascular nutrition education setting. Patient Educ Couns 1997 Jun;31(2):139-50. DOI: https://doi.org/10.1016/s0738-3991(97)01003-3.
    46.    Zaslow MJ, Hair EC, Dion MR, Ahluwalia SK, Sargent J. Maternal depressive symptoms and low literacy as potential barriers to employment in a sample of families receiving welfare: are there two-generational implications? Women Health 2001;32(3):211-51. DOI: https://doi.org/10.1300/j013v32n03_03.
    47.    Berkman ND, Sheridan SL, Donahue KE, et al. Health literacy interventions and outcomes: an updated systematic review. Evid Rep Technol Assess (Full Rep) 2011 Mar;(199):1-941.
    48.    Baker DW, Parker RM, Williams MV, Clark WS, Nurss J. The relationship of patient reading ability to self-reported health and use of health services. Am J Public Health 1997 Jun;87(6):1027-30. DOI: https://doi.org/10.2105/ajph.87.6.1027.
    49.    Weiss BD, Blanchard JS, McGee DL, et al. Illiteracy among Medicaid recipients and its relationship to health care costs. J Health Care Poor Underserved 1994;5(2):99-111. DOI: https://doi.org/10.1353/hpu.2010.0272.
    50.    Marrie RA, Salter A, Tyry T, Fox RJ, Cutter GR. Health literacy association with health behaviors and health care utilization in multiple sclerosis: a cross-sectional study. Interact J Med Res 2014 Feb 10;3(1):e3. DOI: https://doi.org/10.2196/ijmr.2993.
    51.    Hardie NA, Kyanko K, Busch S, Losasso AT, Levin RA. Health literacy and health care spending and utilization in a consumer-driven health plan. J Health Commun 2011;16 Suppl 3:308-21. DOI: https://doi.org/10.1080/10810730.2011.604703.
    52.    Mitchell SE, Sadikova E, Jack BW, Paasche-Orlow MK. Health literacy and 30-day postdischarge hospital utilization. J Health Commun 2012;17 Suppl 3:325-38. DOI: https://doi.org/10.1080/10810730.
2012.715233.
    53.    Omachi TA, Sarkar U, Yelin EH, Blanc PD, Katz PP. Lower health literacy is associated with poorer health status and outcomes in chronic obstructive pulmonary disease. J Gen Intern Med 2013 Jan;28(1):74-81. DOI: https://doi.org/10.1007/s11606-012-2177-3.
    54.    Kripalani S, Gatti ME, Jacobson TA. Association of age, health literacy, and medication management strategies with cardiovascular medication adherence. Patient Educ Couns 2010 Nov;81(2):177-81. DOI: https://doi.org/10.1016/j.pec.2010.04.030.
    55.    Loke YK, Hinz I, Wang X, Salter C. Systematic review of consistency between adherence to cardiovascular or diabetes medication and health literacy in older adults. Ann Pharmacother 2012 Jun;46(6):863-72. DOI: https://doi.org/10.1345/aph.1q718.
    56.    Hoeymans N, Feskens EJ, Van Den Bos GA, Kromhout D. Non-response bias in a study of cardiovascular diseases, functional status and self-rated health among elderly men. Age Ageing 1998 Jan;27(1):35-40. DOI: https://doi.org/10.1093/ageing/27.1.35.
    57.    Korkeila K, Suominen S, Ahvenainen J. Non-response and related factors in a nation-wide health survey. Eur J Epidemiol 2001;17(11):991-9.
    58.    Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J. Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol 2003 Feb;13(2):105-10. DOI: https://doi.org/10.1016/s1047-2797(02)00257-0.
    59.    Powers BJ, Trinh JV, Bosworth HB. Can this patient read and understand written health information? JAMA 2010 Jul 7;304(1):76-84. DOI: https://doi.org/10.1001/jama.2010.896.
    60.    Davis TC, Long SW, Jackson RH, et al. Rapid estimate of adult literacy in medicine: a shortened screening instrument. Fam Med 1993 Jun;25(6):391-5.
    61.    Parker RM, Baker DW, Williams MV, Nurss JR. The test of functional health literacy in adults: a new instrument for measuring patients’ literacy skills. J Gen Intern Med 1995 Oct;10(10):537-41. DOI: https://doi.org/10.1007/bf02640361.
    62.    Noell J, Glasgow RE. Interactive technology applications for behavioral counseling: issues and opportunities for health care settings. Am J Prev Med 1999 Nov;17(4):269-74. DOI: https://doi.org/10.1016/S0749-3797(99)00093-8.