Important Considerations for Design and Implementation of Decision Aids for Shared Medical Decision MakingSean Koon, MD, MS Perm J 2020;24:19.064 [Full Citation] https://doi.org/10.7812/TPP/19.064E-pub: 12/30/2019ABSTRACTIntroduction: Decision aids are software or paper-based tools that enable patients and health care practitioners to work together to make optimal treatment decisions. Although there are decades of favorable research for the use of decision aids, there is wide variation in their development and implementation. INTRODUCTIONDecision aids are software or paper-based tools that enable patients and health care practitioners to work together to make optimal treatment decisions by educating patients about the risk and benefit of different options and aligning those options with their personal values. Although informational handouts or patient instructions are helpful, decision aids take a more targeted approach by “making explicit the decision that needs to be made, providing information about treatment options and outcomes, and helping the patient clarify personal values.”1 Certainly, shared decision making can be done without decision aids, however these tools may help to standardize and facilitate that process.2 In a Cochrane Review3 of 105 studies involving 31,043 participants, the authors conclude: Compared to usual care … people exposed to decision aids feel more knowledgeable, better informed, and clearer about their values, and they probably have a more active role in decision making and more accurate risk perceptions. There is growing evidence that decision aids may improve values-congruent choices. Although there are basic standards for what constitutes high-quality decision aids,4-6 there is neither consensus around best practices nor any holistic and practical commentary regarding the development, implementation, and evaluation of decision aids. Therefore, the aims of this article were to complete a narrative review of the use of decision aids in shared decision making and to summarize the key considerations for developing, implementing, and assessing decision aids as tools to support effective shared decision making. Such a summary could serve as a reference for any health care professional or team who wishes to design, implement, and assess decision aids. The preponderance of research has lent itself to many systematic reviews and meta-analyses that serve as the basis for this narrative synthesis. With the aim of supporting the creation and effective use of decision aids, the following questions were considered: 1. Which overall approach should be used when designing a decision aid? 2. Which specific decision-support features are most effective? 3. Which factors should be considered in implementation? 4. How should the effectiveness of a decision aid be assessed? METHODSA literature search, screening, and appraisal process was implemented using the National Library of Medicine’s PubMed database with Medical Subject Headings (MeSH) terms. A literature search was performed in PubMed and constrained to the MeSH term Decision Support Techniques. (This was the only term that included patient involvement in decision making.) Searches were performed within “Decision Support Techniques” using the terms: Shared decision, decision aid, and decision aids. Duplicates were removed, resulting in 1031 total articles. Because the goal of this study was to obtain generally applicable insights with a broad, established evidence base, the search was further constrained to review articles only. This returned 188 articles across all terms. Citations were reviewed, and articles not pertaining to design, implementation, and assessment of decision aids were removed, with 12 articles remaining. This search approach did not retrieve any systematic review that addressed the question of assessment of decision aids. Because of this, the prior search was repeated without constraint to review articles and with the addition of appraisal and evaluation search terms. Thus, the search used the MeSH term Decision Support Techniques with the following terms: Shared decision, decision aid, decision aids, appraisal, and evaluation. With this second search, 354 citations were found, resulting in 1 pertinent review article not found previously (which had perhaps been erroneously classified as a research support article instead of a review). RESULTSThe literature searches revealed a total of 13 pertinent review articles (Figure 1). These articles were organized and synthesized into the following narrative review describing basic insights and considerations for all stages of the decision aid lifecycle (Table 1). Design ProcessGiven that decision aids require engagement from both patients and health care practitioners, creating a design process that explores the users’ needs (user-centered design) and workflows could potentially increase usage. Matlock and Spatz7 form a theoretical framework for the design of decision aids that embraces a user-centered design perspective. They suggest 1) understanding the decision, including risks and benefits and an idea of “what’s important” for practitioners; 2) creating a first draft; 3) iteratively modifying or adjusting the tool with potential end users; and 4) testing the tool in a real setting. A similar approach is described by Coulter et al.8 A study in progress by Witteman et al9 will evaluate what aspects of user-centered design are currently used in developing decision aids and to establish a “measure of the user-centeredness of development processes and identify practices that are likely to be optimal.” To support the overall quality of decision aid design, the International Patient Decision Aids Standards (IPDAS)4-6 were developed from an expert consensus approach and provide a detailed checklist addressing aspects of the content, development, and effectiveness of decision aids. The items on this checklist are key considerations and should be addressed in the design of new decision aids. Design FeaturesMany of the findings in this review pertain to the use of specific features in decision aids. They are organized here in the emergent categories of educational material, representing risk, values clarification, and use of narrative. Educational Material The foundation of decision aids is the education of patients about treatment options. Having accurate, up-to-date information is essential to the basic quality of a decision aid,10 which now may be facilitated by both electronic libraries and computer-based decision aids. A study of computer-based decision aids by Syrowatka et al11 suggests that designers avoid tailoring information to specific patients, but rather give users control over how much and what type of information they view and “allow patients to select the order, level of detail and type of information presented.” Providing patients with a “notebook” for them to record their learnings or questions was helpful as well. When representing information, Abhyankar et al12 found that a side-by-side display tends to give patients a greater sense of having a balanced approach to decision making, possibly by enabling patients to see decision trade-offs.11 Representing Risk An essential aspect of education involves communicating risk. A group of 14 researchers developed an expert consensus document addressing the need to effectively represent treatment risks.13 They suggest using a consistent format throughout documents (ie, using percentages or using simple frequency formats such as 3/100). Also, “1 in x” formats (ie, where the denominator is the variable) should generally be avoided. They suggest that the risk of a single event can be adequately described with either percentages or simple frequency formats (eg, 3/100) but that comparing the risk of 2 or more independent events (ie, “chance of improvement with drug X compared with placebo”) is better represented with percentages. The magnitude of numbers should be considered as a source of format bias (ie, comparing 0.001 and 0.0003). The use of visual formats may reduce format bias, but it is also important to generally “take into account the numeracy and graph literacy of the audience.”13 It is also important to make time frames explicit, such as “10% risk per year” vs “10% lifetime risk.” Caution with tailoring risk assessments to individual patients may also be prudent. A study by Scherer et al14 found that 20% of the patients did not believe their personalized risk numbers for a variety of reasons. The researchers concluded that “the benefits of tailored risk statistics may be attenuated by a tendency for people to be skeptical that these risk estimates apply to them personally.” Values Clarification The goal of decision aids is to help patients to make treatment choices that fit their own values.3,6 The most common approach is the implicit approach, which involves listing the features and outcomes of each treatment option for the patient to reflect on, including possible physical, emotional, and social consequences.6 Explicit approaches require the patient to explicitly declare their values by having them write them out or by having them numerically rate the importance of each potential outcome, for example, “impact on bowel function.” Fagerlin et al15 explored the impact of explicit values clarification methods and found mixed results in general and no consensus on the best approach. Syrowatka et al11 also found mixed results. At a minimum, the simple implicit approach of listing features and outcomes should be used, and representing these treatment differences in terms of trade-offs may be the preferred approach to doing that.11 Use of Narrative Many decision aids use a video or written vignette that describes another patient’s thoughts about treatment options. In their review, Bekker et al16 suggest that the effectiveness of the use of patient narratives is unclear. The facts and issues that the narrator may focus on may not represent those that are important to the patient. The patient may also have a reaction to the narrator, which can bias their decision. It is also difficult to compare narratives for different treatment options, and the persuasiveness of a narrative can undermine the statistical data about risks and benefits.16 The benefit of using stories or video may vary depending on health literacy.15 Implementation Elwyn et al,17 in their review, reveal major barriers to implementation because of “indifference on the part of health care professionals” and fear that the decision aids would disrupt workflows or not have appropriate content. Similarly, in a systematic review, Légaré et al18 found that the most common barriers to use of decision aids had to do with clinician engagement. Primary concerns were that the decision aids did not fit the characteristics of the patients and that the decision aid would increase visit length. Interestingly, in their review, decision aids had a variable effect on consultation length, from shorter to longer durations, so perhaps confronting the perception of time consumption would be important to physician engagement. Also noted was that decision aids were more likely to be used if the clinicians were motivated and if they perceived that shared decision making would have a positive impact on the clinical process or patient outcomes. In terms of encouraging the use of decision aids, Légaré et al18 found that interventions targeting both patients and clinicians were most effective. Appraisal The IPDAS checklist describes key considerations in the design of decision aids,4 but there is no specific instrument that is recognized as superior for measuring the quality of decision aids. Kryworuchko et al19 studied 8 different instruments comprising more than 35 outcome measures. With strong consideration of the IPDAS design model in their appraisal process, the authors found that 2 instruments met at least 6 of 8 of their appraisal criteria. These were the Control Preference Scale, which measures the ability of a patient to participate in a decision to the degree s/he desires and the Decisional Conflict Scale, which assesses the patient’s degree of feeling supported, informed, certain about his/her decision, clear about values, and the effectiveness of the decision process in creating a satisfying decision. DISCUSSIONThe aim of this article was to explore the current research on decision aids and to offer a concise summary that would serve as a reference for any health care practitioner or team who wished to design and implement these useful tools. As such, this review identified several key considerations for the design, implementation, and evaluation of decision aids. Although these considerations may be helpful for the design of high-quality decision aids, such improvements are of little benefit if the decision aids are not used by health care practitioners and patients. Health care professionals have expressed concerns that decision aids will disrupt workflows, create unnecessarily long visits, and not contain appropriate content.17,18 With this in mind, perhaps engagement is the most useful lens through which to view the findings of this review. Engagement could begin at the design level by involving physicians in a user-centered, iterative design approach.9 Input from physicians may ensure appropriate and up-to-date content10 and ensure that the quality of the tool is suitable by the IPDAS.4-6 Early physician involvement may also alleviate issues around “inappropriate content” or “disrupted workflows.”17,18 Removing decision aid features that are time consuming but that offer unclear benefits may be useful to increase engagement. For example, complex “explicit” values clarification approaches could be time consuming and may not add greatly to decision efficacy or satisfaction.15 Similarly, narrative features might require the patient to view multiple videos or read narratives that could be disruptive to workflow and timeliness and may not provide a clear benefit to decision making.16 Ideally, a decision aid should increase the effectiveness of the patient visits while decreasing the clinicians’ effort. For example, patients could use the decision aid at home, working at their own pace, which would allow them to “select the order, level of detail and type of information presented.”11 Educational material should include simple and appropriate descriptions of risk13 that allow patients to compare options in terms of trade-offs.11 Patients could conceivably come to a visit with a foundational understanding of the risks, discuss notes they have taken,11 and ask informed questions that are pertinent to their own situation. By engaging physicians in implementation, concerns about time loss, content, or workflow disruption could be addressed and alleviated.17,18 Discussion about expected benefits in clinical processes or patient outcomes as well as the expectation that the cost of time may be negligible or even favorable18 might all serve to improve the engagement and use of the tool in clinical settings. Iterative improvement may be needed to develop a decision aid that is increasingly useful and engaging for patients and health care professionals.9 The Control Preference and the Decisional Conflict scales may be useful to assess and improve the usefulness of the tool from the patient perspective.19 This study has some limitations. In a topic area that contains nearly 70,000 citations, it was difficult to ensure that important articles were not omitted in the search strategy. In part, the focus here on review articles, of which there are many, was an attempt to surface the key findings in the literature. A more thoroughgoing approach would be a systematic review of the whole corpus of literature. Given that the aim of this article was to summarize research across the entire lifecycle of decision aids (design, implementation, assessment), a systematic review would be quite ambitious and beyond the scope of this review. A search strategy targeting review articles tends to emphasize aspects of decision aids that have been well studied, such as “values clarification” or “use of narrative.” Although such a summary may be most useful for creators of decision aids, it does little to describe the gaps in literature where future research may have merit. Of note, shared decision making certainly occurs between patients and practitioners without the use of decision aids, but this article does not investigate what occurs in those interactions, nor do the findings here necessarily apply to shared decision making that occurs without the use of a decision aid. Although the effectiveness of explicit values clarification approaches has been described here as inconclusive, it should be noted that there are a wide variety of these approaches, some of which may be effective but require more research.15 Similarly, the use of narrative may also deserve further exploration. For example, the emergence of online patient communities such as PatientsLikeMe,20 Inspire,21 and HealthBoards22 allows patients to explore a great variety of patient narratives to find scenarios that more closely fit their own. Perhaps a more intriguing potential for both values clarification and narrative lies in the aggregated insights from these online patient communities. With the key components of both highly detailed discussions and very large quantities of them, there is the potential for the use of sentiment analysis techniques23 to gain population-level insights into what is important for patients facing different treatment decisions. Such findings could not only inform the creation of decision aids but also make it possible for patient communities’ Web sites to leverage their own data and offer powerful decision-support tools directly to patients that facilitate decision making across the broad diversity of patient values and health conditions. Although such efforts may be pertinent to this review, they are outside its scope. CONCLUSIONThe literature reports several considerations in the development, implementation, and assessment of shared decision-making tools. Designers of decision aids should focus on engagement from the start by involving health care practitioners and patients to ensure that the decision aids are pertinent to the situation and not perceived as time consuming. The IPDAS checklist helps to ensure quality in design. Patients should be able to select information in a manner that suits them and view it in a way that allows them to evaluate trade-offs. In the reporting of statistical risks, format bias can take many forms and should be avoided through careful and consistent choice of format and by adding visual representations. Decision aids should be tested in real settings with iterative improvements. For appraisal of the implemented decision aids, consider using the Control Preference Scale and the Decisional Conflict Scale. Further research is recommended regarding optimal engagement of users with decision aids as well as exploration of the distinct opportunities that computerized decision aids and online patient communities may present. Disclosure StatementThe author(s) have no conflicts of interest to disclose. AcknowledgmentsKathleen Louden, ELS, of Louden Health Communications performed a primary copy edit. How to Cite this ArticleKoon S. Important considerations for design and implementation of decision aids for shared medical decision making. Perm J 2020;24:19.064. DOI: https://doi.org/10.7812/TPP/19.064 Author Affiliations1 Department of Addiction Medicine, Fontana Medical Center, CA Corresponding AuthorSean Koon, MD, MS (sean.e.koon@kp.org) References1. Herrin J, Harris KG, Kenward K, Hines S, Joshi MS, Frosch DL. Patient and family engagement: A survey of US hospital practices. BMJ Qual Saf 2016 Mar;25(3):182-9. DOI: https://doi.org/10.1136/bmjqs-2015-004006 PMID:26082560
|
ETOC
Click here to join the eTOC list or text ETOC to 22828. You will receive an email notice with the Table of Contents of The Permanente Journal.
CIRCULATION
2 million page views of TPJ articles in PubMed from a broad international readership.
Indexing
Indexed in MEDLINE, PubMed Central, EMBASE, EBSCO Academic Search Complete, and CrossRef.