"Lost in Translation: The Readability Discrepancy of Online Patient Educational Materials for PCL Surgery"

Document Type : RESEARCH PAPER

Authors

1 Saint Louis University School of Medicine, Saint Louis, MO, USA

2 Burnett School of Medicine at Texas Christian University, Fort Worth, TX, USA

3 Department of Orthopedic Surgery, Saint Louis University Hospital, MO, USA

10.22038/abjs.2024.75361.3492

Abstract

Objectives: While the internet provides accessible medical information, often times it does not cater to 
the average patient’s ability to understand medical text at a 6th and 8th grade reading level, per 
American Medical Association (AMA)/National Institute of Health (NIH) recommendations. This study 
looks to analyze current online materials relating to posterior cruciate ligament (PCL) surgery and their 
readability, understandability, and actionability.
Methods: The top 100 Google searchs for “PCL surgery” were compiled. Research papers, procedural protocols, 
advertisements, and videos were excluded from the data collection. The readability was examined using 7 
algorithms: the Flesch Reading Ease Score, Gunning Fog, Flesch-Kincaid Grade Level, Coleman-Liau Index, SMOG 
index, Automated Readability Index and the Linsear Write Formula. Two evaluators assessed Understandability and 
Actionability of the results with the Patient Educational Materials Assessment Tool (PEMAT). Outcome measures 
included Reading Grade Level, Reader’s age minimum and maximum, Understandability, and Actionability.
Results: Of the 100 results, 16 were excluded based on the exclusion criteria. There was a statistically significant 
difference between the readability of the results from all algorithms and the current recommendation by AMA and 
NIH. Subgroup analysis demonstrated that there was no difference in readability as it pertained to which page they 
appeared on Google search. There was also no difference in readability between individual websites versus 
organizational websites (hospital and non-hospital educational websites). Three articles were at the 8th grade 
recommended reading level, and all three were from healthcare institutes.
Conclusion: There is a discrepancy in readability between the recommendation of AMA/NIH and online educational 
materials regarding PCL surgeries, regardless of where they appear on Google and across different forums. The 
understandability and actionability were equally poor. Future research can focus on the readability and validity of 
video and social media as they are becoming increasingly popular sources of medical information.
 Level of evidence: IV 

Keywords

Main Subjects

References

  1. Logan CA, Beaulieu-Jones BR, Sanchez G, et al. Posterior Cruciate Ligament Injuries of the Knee at the National Football League Combine: An Imaging and Epidemiology Study. Arthroscopy. 2018; 34(3):681-686. doi:10.1016/j.arthro.2017.08.304.
  2. Majewski M, Susanne H, Klaus S. Epidemiology of athletic knee injuries: A 10-year study. Knee. 2006; 13(3):184-188. doi:10.1016/j.knee.2006.01.005.
  3. Owesen C, Sandven-Thrane S, Lind M, Forssblad M, Granan LP, Årøen A. Epidemiology of surgically treated posterior cruciate ligament injuries in Scandinavia. Knee Surg Sports Traumatol Arthrosc. 2017; 25(8):2384-2391. doi:10.1007/s00167-015-3786-2.
  4. Seurer AC, Vogt HB. Low health literacy: a barrier to effective patient care. S D Med. 2013; 66(2):51, 53-57.
  5. Swenson DM, Collins CL, Best TM, Flanigan DC, Fields SK, Comstock RD. Epidemiology of knee injuries among U.S. high school athletes, 2005/2006-2010/2011. Med Sci Sports Exerc. 2013; 45(3):462-469. doi:10.1249/MSS.0b013e318277acca.
  6. Montgomery SR, Johnson JS, McAllister DR, Petrigliano FA. Surgical management of PCL injuries: indications, techniques, and outcomes. Curr Rev Musculoskelet Med. 2013; 6(2):115-123. doi:10.1007/s12178-013-9162-2.
  7. Broom A. Virtually He@lthy: The Impact of Internet Use on Disease Experience and the Doctor-Patient Relationship. Qual Health Res. 2005; 15(3):325-345. doi:10.1177/1049732304272916.
  8. Fox NJ, Ward KJ, O’Rourke AJ. The ‘expert patient’: empowerment or medical dominance? The case of weight loss, pharmaceutical drugs and the Internet. Soc Sci Med. 2005; 60(6):1299-1309. doi:10.1016/j.socscimed.2004.07.005.
  9. Marton C, Wei Choo C. A review of theoretical models of health information seeking on the web. Journal of Documentation. 2012; 68(3):330-352. doi:10.1108/00220411211225575.
  10. Oh HJ, Lee B. The Effect of Computer-Mediated Social Support in Online Communities on Patient Empowerment and Doctor–Patient Communication. Health Communication. 2012;27(1):30-41. doi:10.1080/10410236.2011.567449.
  11. Diaz JA, Griffith RA, Ng JJ, Reinert SE, Friedmann PD, Moulton AW. Patients’ use of the Internet for medical information. J Gen Intern Med. 2002;17(3):180-185. doi:10.1046/j.1525-1497.2002.10603.x.
  12. Gualtieri LN. The doctor as the second opinion and the internet as the first. InCHI'09 Extended Abstracts on Human Factors in Computing Systems 2009 (pp. 2489-2498). doi:10.1145/1520340.1520352.
  13. Kivits J. Informed Patients and the Internet: A Mediated Context for Consultations with Health Professionals. J Health Psychol. 2006;11(2):269-282. doi:10.1177/1359105306061186.
  14. Weiss BD. “Health Literacy: A Manual for Clinicians,” American Medical Association, American Medical Foundation, Chicago, 2003.
  15. Wynia MK, Osborn CY. Health Literacy and Communication Quality in Health Care Organizations. J Health Commun. 2010;15(Suppl 2):102-115. doi:10.1080/10810730.2010.499981.
  16. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155(2):97-107. doi:10.7326/0003-4819-155-2-201107190-00005.
  17. Nielsen-Bohlman L, Panzer AM, Kindig DA,eds. Health Literacy: A Prescription to End Confusion. 1st ed. Institute of Medicine (US) Committee on Health Literacy. National Academies Press (US); 2004.
  18. Kim H, Xie B. Health literacy in the eHealth era: A systematic review of the literature. Patient Educ Couns. 2017;100(6):1073-1082. doi:10.1016/j.pec.2017.01.015.
  19. Dewalt DA, Berkman ND, Sheridan S, Lohr KN, Pignone MP. Literacy and health outcomes: a systematic review of the literature. J Gen Intern Med. 2004;19(12):1228-1239. doi:10.1111/j.1525-1497.2004.40153.x.
  20. Kilfoyle KA, Vitko M, O’Conor R, Bailey SC. Health Literacy and Women’s Reproductive Health: A Systematic Review. J Womens Health (Larchmt). 2016;25(12):1237-1255. doi:10.1089/jwh.2016.5810.
  21. Miller TA. Health literacy and adherence to medical treatment in chronic and acute illness: A meta-analysis. Patient Educ Couns. 2016;99(7):1079-1086. doi:10.1016/j.pec.2016.01.020.
  22. Morrison AK, Glick A, Yin HS. Health Literacy: Implications for Child Health. Pediatr Rev. 2019;40(6):263-277. doi:10.1542/pir.2018-0027.
  23. Rosenbaum AJ, Pauze D, Pauze D, et al. Health Literacy in Patients Seeking Orthopaedic Care: Results of the Literacy in Musculoskeletal Problems (LIMP) Project. Iowa Orthop J. 2015;35:187-192.
  24. Dubay WH. The principles of readability. Impact Information. Costa Mesa, CA. 2004.
  25. Assess, Select, and Create Easy-to-Understand Materials: Tool #11. Health Literacy Universal Precautions Toolkit. Available at: https://www.ahrq.gov/health-literacy/improve/precautions/tool11.html. August 30, 2023.
  26. Doinn TÓ, Broderick JM, Abdelhalim MM, Quinlan JF. Readability of Patient Educational Materials in Hip and Knee Arthroplasty:

 

Has a Decade Made a Difference? J Arthroplasty. 2020;35(11):3076-3083. doi:10.1016/j.arth.2020.05.076.

  1. Gao B, Shamrock AG, Gulbrandsen T, Femino JE, Netto CD, Duchman KR. Achilles Tendon Repair: Can Patients Read, Understand, and Act on Online Educational Resources? Foot Ankle Orthop. 2020;5(4):2473011420S00224. doi:10.1177/2473011420S00224.
  2. Gao B, Shamrock AG, Gulbrandsen TR, et al. Can Patients Read, Understand, and Act on Online Resources for Anterior Cruciate Ligament Surgery? Orthop J Sports Med. 2022;10(7):23259671221089977. doi:10.1177/23259671221089977.
  3. Mehta MP, Swindell HW, Westermann RW, Rosneck JT, Lynch TS. Assessing the Readability of Online Information About Hip Arthroscopy. Arthroscopy. 2018;34(7):2142-2149. doi:10.1016/j.arthro.2018.02.039.
  4. Bianchi T. Global search engine desktop market share 2023. Statista. Available at: https://www.statista.com/statistics/216573/worldwide-market-share-of-search-engines/. Accessed June 3, 2023.
  5. Iden K. How Far Down the Search Results Page Will Most People Go? https://www.theleverageway.com/blog/how-far-down-the-search-engine-results-page-will-most-people-go/.Accessed June 3, 2023.
  6. Meyer C. The Top 5 Results in Google Get Almost 70% of All Clicks. Advance Metrics. Available at: https://www.advance-metrics.com/en/blog/the-top-5-results-in-google-get-almost-70-of-all-clicks/.Accessed June 3, 2023.
  7. Robbins Ron. What is the Average Google Click Through Rate by Position - Clicta Digital. clicta digital. Available at: https://clictadigital.com/what-is-the-average-google-click-through-rate-by-position/.Accessed June 3, 2023.
  8. Williams AM, Muir KW, Rosdahl JA. Readability of patient education materials in ophthalmology: a single-institution study and systematic review. BMC Ophthalmology. 2016;16(1):133. doi:10.1186/s12886-016-0315-0.
  9. Josey M, Gaid D, Bishop LD, Blackwood M, Najafizada M, Donnan JR. The Quality, Readability, and Accuracy of the Information on Google About Cannabis and Driving: Quantitative Content Analysis. JMIR Infodemiology. 2023;3:e43001. doi:10.2196/43001.
  10. Mbanda N, Dada S, Bastable K, Ingalill GB, Ralf W S. A scoping review of the use of visual aids in health education materials for persons with low-literacy levels. Patient Educ Couns. 2021;104(5):998-1017. doi:10.1016/j.pec.2020.11.034.
  11. Rooney MK, Santiago G, Perni S, et al. Readability of Patient Education Materials From High-Impact Medical Journals: A 20-Year Analysis. J Patient Exp. 2021;8:2374373521998847. doi:10.1177/2374373521998847.
  12. Dixon S. Biggest social media platforms 2023. Statista. Available at: https://www.statista.com/statistics/272014/global-social-networks-ranked-by-number-of-users/.Accessed June 3, 2023.
The Archives of Bone and Joint Surgery
Volume 12, Issue 4
April 2024
Pages 264-274

Files

History

  • Receive Date: 12 October 2023
  • Revise Date: 22 December 2023
  • Accept Date: 13 January 2024

Share

How to cite

Statistics