Study design, materials and methods
Two independent reviewers who are both medical practitioners, searched ‘erectile dysfunction’ on YouTube in April 2021 and evaluated the first 50 videos listed, reflecting the content patients are most likely to view. No search restrictions were applied, including language. Information related to views, video producer, quality of content, understandability and actionability for viewers was assessed. The videos were assessed using the validated Patient Education Materials Assessment Tool (PEMAT)(2) and the DISCERN criteria(3). PEMAT is a tool which assesses the understandability and actionability of audio-visual content. It consists of assessment of thirteen areas of understandability and four areas of actionability. For each area, assessors grade the content on whether or not it reflects the criteria as either ‘Agree’, ‘Disagree’ or ‘Not Applicable’. ‘Agree’ is chosen if the content assessed occurs in 80-100% of the material presented. The total score is then calculated (‘Agree’ = 1 point, ‘Disagree’ = 0 points) and a percentage score for understandability and actionability generated. The DISCERN criteria assesses the quality of consumer health information, focusing on the sourcing, bias and reliability of information provided. The content is assessed across 16 areas, rated overall from a score of 1 (serious or extensive shortcomings) to 5 (minimal bias). Before assessing content, both reviewers had to familiarise themselves with both the PEMAT and DISCERN tools. Any conflicts in the grading of material were discussed between reviewers and a decision made. Statistical analysis was performed using R software version 3.6.3 to undertake univariate analysis with PEMAT and DISCERN scores. A p value of < 0.05 was deemed significant.
Interpretation of results
YouTube is a readily available, free medium for patients to search health conditions such as erectile dysfunction. This is particularly significant as patients may consult YouTube prior to a health practitioner. The limitation is that there is no governance in the quality of the content provided. Whilst the majority of video content was presented in a manner which was readily understandable, there were significant deficiencies overall in the citation of sources of information provided, discussion of treatment options including benefits and risks and a logical action plan for patients seeking treatment. Further there was evidence that this health condition remains stigmatised, with a lack of patient’s personal insights into the condition provided. Most notably the quality of content provided was not associated with viewer engagement.