Abstract
Introduction
The use of web-based information as a source of medical information related to oral health and dental procedures increased nowadays. 1 Additionally, dental patients search for relevant dental information online even before taking a consultation with the dentist. 1 Patients who require third molar extraction are more likely to consider collecting adequate information about the procedure.2,3 Web-based information about third molar extraction surgery varies in quality and accuracy, potentially misleading patients. 4 Therefore, it is crucial to have access to high-quality, evidence-based online medical information in order to better understand patients’ expectations for surgery and their decision-making process.
Although a study was conducted on the quality and readability of internet-related information about third molars, the reviewed websites were limited to those in the English language only.5,6 Furthermore, other recent studies have evaluated the web-based health information to evaluate Arabic information's readability and quality on various dental procedures such as dental implants, periodontal diseases and denture hygiene however there is still need for Arabic web-based health information sites.7–11
The third molar, frequently referred to as the wisdom tooth, is the last permanent tooth to erupt in the dental arch distal to the second molar. It is one of the most commonly impacted teeth, with a prevalence of 58.3% in Saudi Arabia, and no significant gender predilection.12–16 Extraction of third molar is indicated for several causes such as pain, pericoronitis, infection or swelling, associated pathology however Impacted third molar extraction could be associated with post-operative complications as any other surgical procedures such as excessive hemorrhage, delayed healing, infection, trismus, damaging the near anatomical structures as teeth, nerves, oroantral communication, maxillary tuberosity fracture or even mandibular fracture.17–19 One of the most common post-operative complications in lower wisdoms is alveolar osteitis with frequency reaches 26%.18–21
Currently, patients of the Generation Z, and Millennials generations depend on internet sources for every daily information they need.22,23 And so, the information should be introduced to them in very accurate and readable rapid ways. However surgical extraction Arabic information about impacted wisdom removal on the internet is unregulated and can lead to patients being misinformed or having unrealistic expectations and so there is doubt about the quality and readability of this information. Therefore, the current study aimed to assess the level of quality and readability of Arabic-language web content related to the surgical extraction of the impacted third molars.
Materials and method
Study design
In this infodemiologic, web-based analysis study, we use Arabic keywords to search for relevant websites on popular search engines, including Yahoo (http://www.yahoo.com), Google (http://www.google.com), and Bing (http://www.bing.com). To maintain the objectivity of the results, searches were conducted in incognito mode, and browser cookies and history were cleared before each search session. The search items “extraction of third molar” were translated into Arabic for the searches.
Inclusion and exclusion criteria
In order to be as comprehensive and thorough as possible, we included the top 150 websites from each search engine in our survey. Advanced search options were not used; instead, the default search parameters were maintained. Excluded websites included those that did not provide Arabic content, had only brief coverage of “extraction of third molar (EOTM),” consisted of pure audio or visual material, were scientific papers, contained banner ads, were discussion forums or sponsored links, had restricted access, or lacked any information about EOTM. The remaining websites were included and classified based on their affiliations (non-profit organization, commercial, or university/medical Centers), their specialization (whether partially or entirely related to EOTM), the type of content they provided (medical facts, question sections, clinical trials, answers, and human stories, and how the content was presented (through images, audio, or videos) (Table 1).
Affiliation and content type and presentation of the included websites (n = 146).
Quality assessment
The quality of the websites was evaluated using the Journal of American Medical Association (JAMA) guidelines for website analysis, 24 and the DISCERN assessment tool. 25
The DISCERN questionnaire provided a trustworthy way to assess the level of written data about potential treatments for a given medical condition. There are a total of 16 questions in the survey, which are separated into three categories. The first segment, which consists of questions 1 through 8, focuses on evaluating the publication's credibility in order to decide if it can be trusted as a reliable information source about a specific management. The second section discusses treatment options, range from 9 to 15. The final question (question 16) represents the total quality score. Each question is rated on a five-point Likert scale, with 1 indicating low quality and 5 indicating high quality. An experienced oral surgeon reviewed the websites to ensure consistency in the DISCERN ratings. Scores range from 16 to 80, with 80 being the highest. Results were categorized into low (16–32), moderate (33–64), and high (>65) scores.
The JAMA benchmarks consist of four criteria: authorship (clearly identifying the authors of the website along with their affiliations), disclosure (ownership and disclosure of any conflicts of interest), attribution (sources of the medical content, including references), and currency (clearly indicating the date of publication or update).
Readability assessment
Readability was evaluated using the Flesch-Reading Ease (FRE) scale, the Flesch-Kincaid Grade Level (FKGL) scale, and the Simplified Measure of Gobbledygook (SMOG). These are the tests that are relevant for Arabic notwithstanding the existence of additional readability tests. FKGL ranged from 0 to 18, where 18 representing the most challenging text to read. The more points a text receives on SMOG, the greater difficulty in understanding. The FRE score ranges from 0 to 100, with higher scores indicating simpler language. For all readability assessments, the automated formulas were accessed via the website www.readabilityformulas.com. Based on several studies conducted in Arabic, the acceptable levels were set at an FRE score of 80 or above and FKGL and SMOG scores below 7.7–10
Data analysis
The statistical analysis was performed using IBM SPSS, version 25. The results were presented in tables, including the median value with interquartile range (IQR), as well as the maximum and minimum values for quantitative variables, since the data were not normally distributed according to the Kolmogorov-Smirnov test. For qualitative variables, frequencies and percentages were calculated. The Chi-square test was used to compare qualitative variables, while the Kruskal-Wallis test was employed to compare the medians of quantitative data. A p-value of less than 0.05 was considered statistically significant for all comparison tests.
Results
Search strategy and website inclusion
A total of 450 websites related to the extraction of wisdom teeth were initially identified. After screening, 85 websites were excluded due to advertisements, 33 were not related to the topic, 19 required indirect access, 31 were purely videos, and 63 were from social media platforms. This left 219 websites for further analysis, including duplicates. Upon removing 73 duplicate websites, 146 unique websites were included in the final analysis (Fig.1).

Diagram showing the search strategy flow.
Website categorization and quality assessment
The assessment of 146 websites related to wisdom teeth extraction using the DISCERN criteria revealed significant variation in the quality of online Arabic information provided. The median scores for reliability-related questions ranged from 1.5 to 4.5, indicating a broad spectrum in the explicitness and relevance of information. The highest median score was observed for Q3 (Relevance) with a median of 4.5 (IQR = 0.5), while the lowest median score was for Q7 (Additional sources) at 1.5 (IQR = 1.5).
In the domain of treatment options, the scores varied widely as well, with median scores ranging from 1 to 3. The highest median score in this category was for Q11 (Risk of treatment) with a median of 3 (IQR = 2), and the lowest median scores were observed for Q14 (All alternatives described) and Q15 (Shared decision), both with a median of 1 (IQR = 0.5).
The overall quality rating (Q16) had a median score of 2.5 (IQR = 0.5), indicating moderate quality across the evaluated websites (Table 2).
DISCERN evaluation for the included websites (n = 146).
Quality and readability by affiliation
The analysis of websites based on various affiliations: (Non-profit, Commercial and University/Medical Centers) revealed significant variability in the achievement of JAMA items and readability. Regarding the number of fulfilled JAMA items per website, there were significant differences among the groups (P-value = 0.000). Specifically, 2 commercial, 3 non-profit, and 19 university/medical center websites did not achieve any JAMA items. Conversely, only non-profit websites achieved all four JAMA items, with 8 websites in this category.
For individual JAMA criteria, significant differences were also noted (P-value = 0.000* for each criterion). Authorship was reported by 22 commercial, 53 non-profit, and 9 university/medical center websites. Attribution was noted in 7 commercial, 38 non-profit, and 5 university/medical center websites. Currency was the most frequently reported item, present in 26 commercial, 56 non-profit, and 29 university/medical center websites. Disclosure was the least reported, with only 1 commercial and 18 non-profit websites including it.
The DISCERN quality ratings showed no significant difference across the affiliations (P-value = 0.450), with most websites falling into the medium quality category (27 commercial, 58 non-profit, and 48 university/medical center). Thirteen websites were rated as low quality, and no websites achieved a high-quality rating.
Regarding readability, significant differences were observed in the FRES scores (P-value = 0.043*), with 26 commercial, 62 non-profit, and 50 university/medical center websites deemed readable. Eight websites were classified as difficult to read based on FRES. The FKGL scores did not show significant differences across affiliations (P-value = 0.201), with 13 commercial, 40 non-profit, and 33 university/medical center websites classified as readable, while 60 websites were deemed difficult (Table 3). Overall, the analysis highlighted significant variances in the quality and readability of online Arabic information provided by websites from various affiliations, with non-profit websites generally achieving higher scores in JAMA criteria and readability measures.
Quality and readability of the included websites based on their affiliation, reported as frequency and percentage (n = 146).
* Significant at level 0.05 or less
The analysis of DISCERN and readability metrics across websites from different affiliations—Commercial, Non-profit, and University/Medical Center—revealed significant differences in several categories. For the overall DISCERN score, non-profit websites had the highest median score of 42.0 (IQR = 7.1), compared to 37.5 (IQR = 8.0) for commercial and 37.0 (IQR = 7.0) for university websites, with a significant P-value of 0.000*. In terms of reliability, non-profit websites also scored the highest with a median of 23.25 (IQR = 5.6), followed by commercial at 20.5 (IQR = 5.8) and university at 19.5 (IQR = 3.5), again showing a significant difference (P-value = 0.000*). For treatment information, non-profit websites had a median score of 16.0 (IQR = 5.1), higher than university websites at 15.5 (IQR = 4.0) and commercial websites at 14.5 (IQR = 2.3), with a P-value of 0.039**.
In terms of readability, the FRES scores showed non-profit websites as the most readable with a median of 98.04 (IQR = 0.97), followed closely by university websites at 97.80 (IQR = 2.17) and commercial websites at 97.80 (IQR = 4.6), with a significant P-value of 0.041**. The FKGL scores indicated no significant difference (P-value = 0.187) among the websites, with commercial websites having a median of 7.95 (IQR = 6.74), non-profit at 5.16 (IQR = 4.51), and university at 5.45 (IQR = 6.04). The SMOG scores also showed no significant difference (P-value = 0.821), with medians of 2.58 (IQR = 2.18) for commercial, 2.36 (IQR = 2.00) for non-profit, and 2.89 (IQR = 2.18) for university websites (Table 4).
Comparison between median with interquartile range (
* Significant at the level of 0.05 or less
Regarding content length, measured by the number of words, non-profit websites had a median of 721.75 (IQR = 491.0), university websites had 769.5 (IQR = 441.5), and commercial websites had 586.5 (IQR = 537.5), with a P-value of 0.069, indicating no significant difference. However, the number of sentences showed a significant difference (P-value = 0.005**), with university websites having the highest median at 35.0 (IQR = 27.5), followed by non-profit at 30.25 (IQR = 24.5) and commercial at 23.5 (IQR = 20.8). These results highlight significant differences in the quality and readability of information across different website affiliations.
Discussion
The present study aimed to evaluate Arabic information content about impacted third molar surgical extraction. The website categorization and quality assessment of the present study highlight that while some websites offer relevant and balanced information, there are notable gaps in providing defined sources and comprehensive treatment options, including the discussion of conservative alternatives and shared decision-making. The highest median score for relevance (Q3) reflects the websites’ ability to address the topic, whereas the lowest scores in providing additional sources and describing all treatment alternatives indicate areas needing improvement. Overall, the investigation revealed significant variations in the content quality and readability provided by websites belonging to various affiliations, with non-profit websites generally achieving higher scores in JAMA criteria and readability measures.
Arabic is the Holy language of Quran and Islam and is an official language in 25 countries: Saudi Arabia, Egypt, Qatar, Tunisia, Sudan, Bahrain, Comoros, Algeria, Eritrea, Chad, Iraq, Djibouti, Kuwait, Libya, Jordan, Mauritania, Oman, Lebanon, Palestine, Somalia, Syria, Tanzania, United Arab Emirates, Morocco and Yemen and recognized as a national minority language in another six states: Iran, Turkey, Cyprus, Senegal, Niger and Mali. 26 In addition Arabic is a macrolanguage with more than 30 different varieties and Arabic migrants’ speakers scattered across the globe and so they are estimated that there are about 1.7 billion Arabic Muslims and non-Muslims speakers in the whole world, making it the fifth spoken language in the world.27,28 Researchers on Arabic websites highlight a critical need for improvement in the quality of oral and dental health online information to support informed decision-making among Arabic-speaking patients, emphasizing the importance of creating more reliable and comprehensive resources. Nowadays the online information about surgical extraction of impacted wisdom teeth is very important of for patients specially patients without prior extraction experience who are worry about wisdom teeth surgery because of significant fear and increased pre-operative anxiety levels about pain, pre-surgery medications, anesthesia techniques, time off work, ability to eat, and loss of self-esteem.29,30
Recent research has assessed the readability and quality of Arabic-language oral health information found on the internet including assessments of websites on various dental health problems as apicoectomy, 11 root canal treatment 31 dental caries 32 and periodontal disease 8 and these studies consistently reported insufficient evidence-based information across various dental topics in Arabic language and despite most sites having readable content their quality was generally moderate to low.
Similar concerns were raised about English-language information on wisdom tooth extraction and is not unique to Arabic content. M. O'Donnell et al., 2001 found the quality of English materials and patient information about third molar extraction did not reflect current research evidence. 29 However, Ciara et al. (2022) state that the Arabic-language internet resources regarding third molar pain and extraction are of a fair quality, and clinicians should use quality assessment tools when developing online content. 4 On the other hand earlier in 2015 Hanna found the quality of online information about third molar extraction is below the required level, with less than 25% of websites having high scientific information quality which indicates more need to create more reliable websites explaining surgical wisdom extraction. 5
In the present study we used the most common quality assessment tools included DISCERN, and JAMA benchmarks, with readability measured using metrics of FRES and SMOG as used by other researchers. 33 While readability was generally good, the overall quality of information was found to be low to moderate, highlighting a significant gap in reliable online resources for Arabic-speaking patients.31,32 These findings underscore the need for improved quality and accuracy in web-based dental health information to support informed decision-making among patients and improve their surgical experiences.
Additionally, the present study focused on three different most popular websites which gave reliability to the study outcomes other than studies which used only one websites, 11 but there is till now 2024 moderate accuracy of the most readable websites and low readability of academic university web sites. The present study outcomes could be explained by the fact that University websites face unique challenges compared to nonprofit sites. Academic websites differ significantly from commercial sites in their objectives and target audience, focusing on educational development. Universities have been criticized for not understanding patient needs and having poor website architecture. However, implementing certain web-based technologies, such as online donation capabilities and secure login access, has been associated with higher reported revenue for nonprofits organizations which primarily use their websites for information distribution and two-way communication. 34
Conclusion
The study results indicating a broad spectrum in the explicitness and relevance of information with moderate quality across the evaluated websites. The analysis highlighted significant differences in the quality and readability of information provided by websites from different affiliations, with non-profit websites generally achieving higher scores in JAMA criteria and readability measures.
Study limitations
The present study has several limitations that should be acknowledged. Firstly, the evaluation was based on static content at a specific point in time, and websites are subject to frequent updates, which could lead to changes in their quality and readability. Another limitation is the subjective nature of some quality assessment tools, such as DISCERN and JAMA benchmarks, which, while standardized, still require evaluator judgment. Furthermore, this study did not assess multimedia elements, such as videos or interactive features, which are increasingly important in patient education.
Recommendations
- Future studies comparing multiple languages web-based information of surgical extraction of impacted wisdoms is recommended in future studies.
- University websites should be improved and socialized more than nonprofit organizations since academic websites would contain more trustworthy, cited, updated material.
Supplemental Material
sj-xlsx-1-dhj-10.1177_20552076251321053 - Supplemental material for A qualitative analysis of Arabic language websites about extraction of third molars
Supplemental material, sj-xlsx-1-dhj-10.1177_20552076251321053 for A qualitative analysis of Arabic language websites about extraction of third molars by Muath Saad Alassaf, Mohannad Mohammed Abu Aof, Osama Ayidh Alharbi, Abdulrahman Turkustani, Moataz Ibrahim Karbouji, Nebras Althagafi, Ahmed Mohammed Almghamsi, Ghayda Yousof Zolaly and Shadia Elsayed in DIGITAL HEALTH
Footnotes
Availability of data and materials
Consent statement
Contributorship
Declaration of conflicting interests
Ethical approval
Funding
Supplemental material
Guarantor
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
