| |
| Qual Saf Health Care. 2006 April; 15(2): 136–141. doi: 10.1136/qshc.2005.015602. | PMCID: PMC2464838 |
Patient assessments of a hypothetical medical error: effects of health outcome, disclosure, and staff responsiveness A Cleopas, A Villaveces, A Charvet, P A Bovier, V Kolly, and T V Perneger A Cleopas, A Villaveces, V Kolly, T V Perneger, Quality of Care Service, University Hospitals of Geneva, Geneva, Switzerland P A Bovier, Department of Community Medicine, University Hospitals of Geneva, Geneva, Switzerland T V Perneger, Institute of Social and Preventive Medicine, Faculty of Medicine, University of Geneva, Switzerland Accepted January 24, 2006. |
Abstract Objective To assess whether patients' perceptions of a hypothetical medical error are influenced by staff responsiveness, disclosure of error, and health consequences of the error. Design Hypothetical scenario describing a medication error submitted by mail. Three factors were manipulated at random: rapid v slow staff responsiveness to error; disclosure v non‐disclosure of the error; and occurrence of serious v minor health consequences. Participants Patients discharged from hospital. Measures Assessment of care described in the scenario as bad or very bad, rating of care as unsafe, and intent to not recommend the hospital. Results Of 1274 participants who evaluated the scenario, 71.4% rated health care as bad or very bad, 60.2% rated healthcare conditions as unsafe, and 25.5% stated that they would not recommend the hospital. Rating health care as bad or very bad was associated with slow reaction to error (odds ratio (OR) 2.8, 95% CI 2.1 to 3.6), non‐disclosure of error (OR 2.0, 95% CI 1.5 to 2.6), and serious health consequences (OR 3.4, 95% CI 2.6 to 4.5). Similar associations were observed for rating healthcare conditions as unsafe and the intent to not recommend the hospital. Younger patients were more sensitive to non‐disclosure than older patients. Conclusions Former patients view medical errors less favorably when hospital staff react slowly, when the error is not disclosed to the patient, and when the patient suffers serious health consequences. Keywords: patient perceptions, medical error, patient safety |
The prevention and effective management of medical errors have become a priority for most healthcare systems. 1, 2, 3, 4, 5, 6 An appropriate response to medical errors must take into account patients' expectations. For instance, hospitals should respect most patients' wish that errors be openly disclosed. 7, 8, 9, 10, 11, 12Several studies have explored people's opinions through experimentally manipulated hypothetical scenarios that describe a medical mishap. These studies have established that perceptions of the public are more negative when an error has severe health consequences, 13, 14, 15 and when the error is not disclosed to the patient. 14, 15, 16Both adverse health outcome and non‐disclosure of the error concern the patient directly, so the importance of these variables for people's perceptions is not surprising. However, we do not know whether patients are sensitive to the responsiveness of healthcare staff once an error has occurred, in particular the prompt recognition and management of the error. This is an important issue since error management is under the control of the healthcare provider and can be improved. In this study we used a hypothetical scenario of a medical error to test the effects of health consequences, disclosure of the error, and staff responsiveness to the error on the assessment of the incident by recently hospitalised patients. |
Methods Study design and sample A cross sectional patient survey was conducted at Geneva University Hospitals, a public hospital system in Geneva, Switzerland. Participants were all adult Swiss residents discharged from the hospital between 15 September and 15 October 2002, identified through the administrative database. The survey package was sent to 2275 individuals 4–8 weeks after discharge. It included a cover letter, the self‐administered questionnaire, and a business reply envelope. Non‐respondents were sent a reminder postcard and two survey packages at 2–4 week intervals. During data collection we excluded patients who had moved away, died, were too sick to fill in the questionnaire, or did not speak French. Questionnaire The core of the questionnaire was the Picker patient experience survey 17 which includes an item for the respondent's overall opinion of the care received at the hospital. We added items to explore the patient's feeling of security during the hospital stay (one item) and the occurrence of various undesirable events 18 including two related to the use of medicines (allergic reaction to drug or wrong drug administered). Patients were also asked to record demographic parameters (age, sex, nationality, level of education) and their current health (two items from the SF‐36 questionnaire: general health, and feeling downhearted and blue during the last 4 weeks). 19The questionnaire also explored patients' opinions about identification wrist bands 20 and included a scenario about a hypothetical medical error. There were 83 items in total. Medical error scenario The survey included a hypothetical scenario describing a medication overdose (table 1 ). This type of incident was chosen because drug administration errors are a leading cause of adverse events in inpatients. 21, 22 Three experimental factors were studied: ![Table thumbnail Table thumbnail](corehtml/pmc/pmcgifs/table-icon.gif) | Table 1 Scenario |
- staff responsiveness to error (ineffective and slow v effective and fast);
- disclosure of the error (non‐disclosure v full disclosure and apology); and
- consequences for the patient (serious v minor).
Eight versions of the scenario were produced using a factorial design. Each participant received one randomly selected version of the scenario. Respondents were asked the following questions: - How would you rate the health care received by Mr C? (Very bad/Bad/Fair/Good/Very good).
- Do you think that Mr C was treated in safe conditions? (Yes, completely/Yes, to some extent/No).
- Imagine you were in this patient's place. Would you recommend this hospital to people close to you? (Yes, definitely/Yes, probably/No).
Initial versions of these questions and of the scenarios were pre‐tested with 42 volunteer inpatients in order to ensure that they were easily understood. Analysis of data Dependent variables were the proportions of respondents who rated the care received by the patient in the scenario as Bad or Very bad (versus Fair, Good, or Very good), who thought that the patient had not been treated in safe conditions (No or Yes, to some extent versus Yes, completely), and who would not recommend the hospital where the error occurred (No or Yes, probably versus Yes, definitely). We examined associations between each of the three experimental factors and the three dependent variables using cross‐tabulations and χ2 tests. Logistic regression was used to model the mutually adjusted effects of the experimental factors on each outcome variable. For dichotomous outcome y1 and experimental factors x1, x2 and x3, the equation was: The results were expressed as odds ratios (OR ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) e b). We then tested first order interactions between experimental factors for each outcome variable. In this analysis we examined whether the effect on one experimental factor was the same across levels of another experimental factor. The logistic regression equation for testing an interaction between x1 and x2 was: The coefficient b4 corresponds to the interaction between the two experimental factors. Finally, we repeated the analysis of main effects across strata of previously defined respondent characteristics (table 2 ). Here too we tested whether the effect of an experimental factor was stable across respondent characteristics by means of interaction terms. For instance, to see if the effect of experimental factor x1 was related to age (grouped in three age groups coded as age3 ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 0, 1, 2), we tested the following model: ![Table thumbnail Table thumbnail](corehtml/pmc/pmcgifs/table-icon.gif) | Table 2 Personal and hospital stay characteristics of 1274 former patients of Geneva University Hospitals |
The regression coefficient b5 corresponds to a linear trend across age groups for the effect of experimental factor x1 on outcome y1. The significance level was p<0.05 for all analyses. |
Results Sample characteristics Of the 2275 patients to whom the questionnaire was sent, 262 were classified as ineligible because they had died, had an invalid address, did not understand French, or were too sick to answer. Of 2013 eligible patients, 1411 (70.1%) returned the completed survey. Among the 1411 respondents, 1274 (90.2%, and 63.3% of initial sample) answered at least one of the questions about the scenario. The 137 non‐respondents were older than the 1274 respondents (mean age 66 v 54 years, p<0.001) and had longer hospital stays (mean 18 v 11 days, p<0.001). Respondents had been discharged from the departments of medicine (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 274), surgery (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 393), neurosciences (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 200), gynaecology‐obstetrics (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 255), geriatrics (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 75), and psychiatry (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 71); six patients had missing information on this variable) and most were discharged to their home (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 1203, 94.4%). Other characteristics are shown in table 2 . There were no differences between the eight groups of patients allocated to the different versions of the scenario in terms of sex, age, nationality, level of education, hospital department, or hospital length of stay (data not shown, available upon request). Perceptions of the hypothetical medical error Overall, 71.4% (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 880 of 1232 patients) of the respondents considered that the care received by the hypothetical patient was bad or very bad, 60.2% (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 749 of 1244) considered that the patient was treated in unsafe conditions, and 25.5% (n ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 315 of 1235) would not recommend the hospital based on the scenario. The assessments of care varied considerably according to the version of the scenario (table 3 ). Only 34.0% of respondents assigned to the best case scenario considered that Mr C received bad or very bad care compared with 89.5% of those assigned to the worst case scenario. ![Table thumbnail Table thumbnail](corehtml/pmc/pmcgifs/table-icon.gif) | Table 3 Proportion of respondents who gave negative assessments of the hypothetical scenario across the eight versions of the scenario |
The effects of the three experimental factors (staff responsiveness to error, disclosure of error and consequences) on the assessments of the scenario were cumulative (fig 1 ). The more non‐desirable experimental factors were present, the more likely was a negative assessment of the scenario. Linear trends were statistically significant (p<0.001) for all three assessments. ![figure qc15602.f1 figure qc15602.f1](picrender.fcgi?artid=2464838&blobname=qc15602.f1.gif) | Figure 1 Negative assessments of care described in a hypothetical scenario of a medical error. According to the number of undesirable factors included in the scenario (slow responsiveness to error, non‐disclosure of error, serious consequences). (more ...) |
Each non‐desirable experimental factor doubled or tripled the odds that the respondents would consider the care received by the hypothetical patient as bad or very bad, that the patient was treated in unsafe conditions, and that they would not recommend the hospital if such an incident happened to them (table 4 ). ![Table thumbnail Table thumbnail](corehtml/pmc/pmcgifs/table-icon.gif) | Table 4 Associations between experimental factors and former patients' assessments of hypothetical scenario |
Interactions We tested all interaction terms between the experimental factors (staff responsiveness, disclosure, and health consequences) in relation to the three outcome variables. Of the nine interaction terms tested, two were statistically significant. The odds ratio for rating care as bad or very bad if staff were unresponsive was 3.8 (95% CI 2.7 to 5.4) when health consequences were minor compared with 1.7 (95% CI 1.1 to 2.6) when health consequences were serious (p for difference ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 0.004). Likewise, the odds ratio for describing care as unsafe if staff were unresponsive was 3.2 (95% CI 2.3 to 4.5) when health consequences were minor but 1.9 (95% CI 1.4 to 2.7) when health consequences were serious (p for difference ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 0.04). Subgroup analysis The effects of the experimental factors were similar among most subgroups of respondents. Odds ratios for rating the care received by the hypothetical patient as bad or very bad are shown in table 5 . Results for the two other outcome variables were similar (not shown, available upon request). There were eight significant differences among 90 interaction tests. Only one difference was present consistently for all of the three outcome variables—the effect of non‐disclosure of the error was stronger among younger respondents than among older respondents. The odds ratio for rating care as bad or very bad associated with non‐disclosure was 3.7 for respondents aged 18–44 years, 2.1 for those aged 45–64 years, and 1.3 for those aged 65 years and older (table 5 , p value for linear trend ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 0.004). The odds ratios of perceiving care as unsafe associated with non‐disclosure were 2.8 (95% CI 1.8 to 4.4), 2.1 (95% CI 1.3 to 3.3), and 1.2 (95% CI 0.8 to 1.9) respectively in these age groups (p value for linear trend ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 0.008). Similarly, the odds ratios of not recommending the hospital associated with non‐disclosure were 2.7 (95% CI 1.8 to 4.1), 2.5 (95% CI 1.5 to 4.3), and 1.1 (95% CI 0.7 to 1.9) in the younger, middle aged, and oldest patients (p value for linear trend ![](corehtml/pmc/pmcents/thinsp.gif) = ![](corehtml/pmc/pmcents/thinsp.gif) 0.02). The other five significant differences between subgroups were inconsistent across outcome variables (data not shown, available on request). ![Table thumbnail Table thumbnail](corehtml/pmc/pmcgifs/table-icon.gif) | Table 5 Effects of experimental factors among subgroups on respondents' perception of care as bad or very bad |
|
Discussion Using an experimentally manipulated hypothetical scenario of a medication error, we found that inadequate staff responsiveness in the face of the error, non‐disclosure of the error to the patient, and serious health consequences for the patient have a negative influence on respondents' evaluation of the incident. Accumulation of these factors increased respondents' tendency to evaluate negatively the care received, to rate healthcare conditions as unsafe, and to not recommend the hospital to others. Stratified analyses showed that the reactions to the medical error were similar across subgroups of respondents, with the exception of the effect of non‐disclosure of the error which was stronger for younger than for older respondents. Disclosure of errors Like others, we found that patients perceive negatively the non‐disclosure of errors. 7, 8, 9, 10, 11, 12, 14, 15, 16 That patients should wish healthcare providers to admit to errors and apologise for them reflects basic human decency. However, in the real world and unlike in our scenario, a patient to whom the error was not disclosed may never know that it occurred and may therefore keep a favourable opinion of the healthcare provider. While open disclosure of errors to patients is the currently recommended standard, 23, 24 only limited empirical evidence exists about the impact of such a policy on malpractice litigation and relationships between doctors and patients. One study has suggested that a policy of open disclosure does not increase malpractice claims, 25 and another revealed that lack of openness may be in itself a motivation for lawsuits. 26 A survey of hospital managers in the United States shows that disclosure of errors to patients is increasing, but also that fear of malpractice remains the main barrier to disclosure. 27 Errors that lead to the most serious injuries are most likely to be disclosed to patients. 28In our scenario we grouped the disclosure of the error with a commitment for improvement on the part of the hospital. We cannot therefore disentangle the impact of these two messages on patient perceptions. Future studies should model and analyse these components separately. Health outcome We also replicated previous findings that health outcomes influence people's perceptions. Pairs of scenarios describing the same error were rated differently, depending on the seriousness of the health outcome. While this result has been reported by others, 13, 14, 15, 16 it is debatable whether it reflects fair judgement on the part of the patients. After all, the healthcare provider behaved identically in both situations. This observation can be considered as an example of hindsight bias due to the human tendency to overestimate causality: 1, 29 if the outcome is bad, the error must be bad too. Previous research indicates that doctors 30 and court experts 31 are also prone to this bias. Handling of errors A novel finding was that slow and ineffective handling of the error by healthcare staff resulted in a more negative perception by patients. This was true whether the error was disclosed or not, and whether health consequences were minor or severe. Patients' assessments are therefore sensitive to the process of error management and not only to the consequences of the incident for themselves. This suggests that hospitals may improve or maintain trust by informing the public about their policies and procedures for dealing with errors—both the immediate reactions to an error that aim to minimise patient harm and the organisational learning processes that aim to make the system of care safer. The latter recommendation is somewhat speculative as our scenario tested only the immediate reaction to error. Subgroups and interactions Generally, the experimental factors we tested had similar effects on the judgements of various subgroups of patients. In particular, these effects were not stronger among patients who reported a personal experience of a problem related to the administration of a drug, which was the mishap described in the scenario. This suggests that the set of values used for judgements of medical errors is shared by most patients and is not very sensitive to recent personal experience. There was one exception: the effect of non‐disclosure of the error was stronger among younger people than among older respondents for all three outcome variables. Older patients may be used to a more secretive and paternalistic practice of medicine, and may be less disturbed by non‐disclosure than younger generations. Other research suggests that younger patients want more involvement in medical decisions. 32While all three experimental factors had strong independent and cumulative effects on patient evaluations of care, we found a statistical interaction between staff responsiveness and health consequences: the negative impact of slow responsiveness was more pronounced when health consequences were described as minor than when they were serious. This suggests that a “ceiling effect” may affect respondents' unfavourable assessments of care—the first undesirable event affects patient perceptions the most negatively, the second a little less, etc. It should be noted that the interpretation of statistical interactions depends on the type of risk model applied to the data. 33 We used a multiplicative model which assumes that, when two risk factors are present, their odds ratios will multiply each other. This model assumption may or may not be reasonable when applied to real life data. Methodological issues The main limitation of the study is that respondents did not react to a real life situation but rated a hypothetical scenario. Whether they would have responded similarly if the medical error had happened to them personally is uncertain. While vignettes have been used successfully in health and social research, they may yield unreliable results when they neglect important social or environmental cues that occur in real life, or when they describe experiences that are unfamiliar. 34 But even if scenarios do not reflect exactly the real world, they help clarify the judgement principles employed in the real world. 31 Furthermore, the psychological distance vignettes afford between the situation being described and the rater may be an advantage when threatening or emotionally stressful situations are explored. 10, 34 In such cases, direct questioning of protagonists may be either difficult or unethical. 10 Medical errors may fall in this category. We surveyed recently hospitalised patients while previous studies have surveyed the general public, 13 health insurance plan members, 14 outpatients, 16 or an internet panel. 15 Recently hospitalised people can probably easily imagine being in the situation portrayed in the scenario, and results obtained through hypothetical vignettes are more credible if the vignette describes a familiar situation. 34Another limitation is that we tested only one type of medical error. It is possible that patients would react differently to other types of error. However, studies that used hypothetical scenarios based on different types of medical errors did not show meaningful differences. 14, 15The response rate of the survey was acceptable, and an analysis of a similar patient survey at our hospital has shown that selection bias was modest, at least with regard to the Picker patient opinion survey. 35 We therefore believe that the results reported here are internally valid. However, as with any local study, our results may not be applicable to other contexts. In conclusion, all three experimental variables—handling of the error by hospital staff, disclosure of the error to the patient, and severity of health consequences—influenced patients' perceptions of the healthcare incident. |
|
References 1. Leape L L Error in medicine. JAMA 1994. 272:1851–1857. [PubMed]2. Cole T Medical errors vs medical injuries: physicians seek to prevent both. JAMA 2000. 284:2175–2177. [PubMed]3. Wolff A M Bourke J Reducing medical errors: a practical guide. Med J Aust 2000. 173:247–251. [PubMed]4. Bates D W Gawande A A Error in medicine: what have we learned? Ann Intern Med 2000. 132:763–767. [PubMed]5. Robinson A R Hohmann K B Rifkin J I et al Physician and public opinions on quality of health care and the problem of medical errors. Arch Intern Med 2002. 162:2186–2190. [PubMed]6. Blendon R J Schoen C Donelan K et al Physicians' views on quality of care: a five‐country comparison. Health Aff (Millwood) 2001. 20:233–243. [PubMed]7. Vincent C Young M Phillips A Why do people sue doctors? A study of patients and relatives taking legal action. Lancet 1994. 343:1609–1613. [PubMed]8. Hingorani M Wong T Vafidis G Patients' and doctors' attitudes to amount of information given after unintended injury during treatment: cross sectional, questionnaire survey. BMJ 1999. 318:640–641. [PubMed]9. Gallagher T H Waterman A D Ebers A G et al Patients' and physicians' attitudes regarding the disclosure of medical errors. JAMA 2003. 289:1001–1007. [PubMed]10. Mazor K M Simon S R Gurwitz J H Communicating with patients about medical errors: a review of the literature. Arch Intern Med 2004. 164:1690–1697. [PubMed]11. Wu A W Handling hospital errors: is disclosure the best defense? Ann Intern Med 1999. 131:970–972. [PubMed]12. Cantor M D Telling patients the truth: a systems approach to disclosing adverse events. Qual Saf Health Care 2002. 11:7–8. [PubMed]13. Blendon R J DesRoches C M Brodie M et al Views of practicing physicians and the public on medical errors. N Engl J Med 2002. 347:1933–1940. [PubMed]14. Mazor K M Simon S R Yood R A et al Health plan members' views about disclosure of medical errors. Ann Intern Med 2004. 140:409–418. [PubMed]15. Schwappach D L Koeck C M What makes an error unacceptable? A factorial survey on the disclosure of medical errors. Int J Qual Health Care 2004. 16:317–326. [PubMed]16. Witman A B Park D M Hardin S B How do patients want physicians to handle mistakes? A survey of internal medicine patients in an academic setting. Arch Intern Med 1996. 156:2565–2569. [PubMed]17. Jenkinson C Coulter A Bruster S The Picker Patient Experience Questionnaire: development and validation using data from in‐patient surveys in five countries. Int J Qual Health Care 2002. 14:353–358. [PubMed]18. Agoritsas T Bovier P Perneger T V Patient reports of undesirable events during hospitalization. J Gen Intern Med 2005. 20:922–928. [PubMed]19. Jenkinson C Stewart‐Brown S Petersen S et al Assessment of the SF‐36 version 2 in the United Kingdom. J Epidemiol Community Health 1999. 53:46–50. [PubMed]20. Cleopas A Kolly V Bovier P A et al Acceptability of identification bracelets for hospital inpatients. Qual Saf Health Care 2004. 13:344–348. [PubMed]21. Bates D W Cullen D J Laird N et al Incidence of adverse drug events and potential adverse drug events. JAMA 1995. 274:29–34. [PubMed]22. Runciman W B Roughhead E E Semple S J et al Adverse drug events and medication errors in Australia. Int J Qual Health Care 2003. 15:(Suppl 1)i49–i59. [PubMed]23. Liang B A A system of medical error disclosure. Qual Saf Health Care 2002. 11:64–68. [PubMed]24. Gallagher T H Levinson W Disclosing harmful medical errors ro patients. A time for professional action. Arch Intern Med 2005. 165:1819–1824. [PubMed]25. Kraman S S Hamm G Risk management: extreme honesty may be the best policy. Ann Intern Med 1999. 131:963–967. [PubMed]26. Vincent C Young M Phillips A Why do people sue doctors? A study of patients and relatives taking legal action. Lancet 1994. 343:1609–1613. [PubMed]27. Lamb R M Studdert D M Bohmer R M Jet al Hospital disclosure practices: results of a national survey. Health Aff 2003. 22:73–83. 28. Weissman J S Annas C L Epstein A M et al Error reporting and disclosure systems. Views from hospital leaders. JAMA 2005. 293:1359–1366. [PubMed]29. Tversky A Kahneman D Causal schemas in judgments under uncertainty. In: Kahneman D, Slovic P, Tversky A, eds. Judgment under uncertainty: heuristics and biases. Cambridge and New York: Cambridge University Press, 1982. 117–128. 30. Caplan R A Posner K L Cheney F W Effect of outcome on physician judgments of appropriateness of care. JAMA 1991. 265:1957–1960. [PubMed]31. Hugh T B Tracy G D Hindsight bias in medicolegal expert reports. Med J Aust 2002. 176:277–278. [PubMed]32. Benbassat J Pilpel D Tidhar, M Patient's preferences for participation in clinical decision making: a review of published surveys. Behav Med 1998. 24:81–88. [PubMed]33. Perneger T V Sex, smoking and cancer: a reappraisal. J Natl Cancer Inst 2001. 93:1600–1602. [PubMed]34. Hughes R Considering the vignette technique and its application to a study of drug injecting and HIV risk and safer behavior. Sociol Health Illn 1998. 20:381–400. 35. Perneger T V Chamot A Bovier P A Non‐response bias in a survey of patient perceptions of hospital care. Med Care 2005. 43:374–380. [PubMed] |
| |