Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Comparative efficacy of various oral hygiene care methods in preventing ventilator-associated pneumonia in critically ill patients: A systematic review and network meta-analysis

  • Sachika Yamakita,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Acute and Critical Care Nursing, Graduate School of Nursing, Master’s Program, Sapporo City University, Sapporo, Hokkaido, Japan

  • Takeshi Unoki ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    iwhyh1029@gmail.com

    Affiliation Department of Acute and Critical Care Nursing, School of Nursing, Sapporo City University, Sapporo, Hokkaido, Japan

  • Sachi Niiyama,

    Roles Conceptualization, Data curation, Investigation, Writing – review & editing

    Affiliations Department of Acute and Critical Care Nursing, Graduate School of Nursing, Master’s Program, Sapporo City University, Sapporo, Hokkaido, Japan, Advanced Critical Care and Emergency Center, Sapporo Medical University Hospital, Sapporo, Hokkaido, Japan

  • Eri Natsuhori,

    Roles Conceptualization, Data curation, Investigation, Writing – review & editing

    Affiliations Department of Acute and Critical Care Nursing, Graduate School of Nursing, Master’s Program, Sapporo City University, Sapporo, Hokkaido, Japan, Intensive Care Unit, Sapporo Kojinkai Memorial Hospital, Sapporo, Hokkaido, Japan

  • Junpei Haruna,

    Roles Conceptualization, Data curation, Investigation, Writing – review & editing

    Affiliation Intensive Care Unit, Sapporo Medical University Hospital, Sapporo, Hokkaido, Japan

  • Tomoki Kuribara

    Roles Conceptualization, Data curation, Investigation, Writing – review & editing

    Affiliation Department of Acute and Critical Care Nursing, School of Nursing, Sapporo City University, Sapporo, Hokkaido, Japan

Abstract

Oral hygiene care is important for ventilator-associated pneumonia prevention. However, the optimal oral hygiene care approach remains unclear. A network meta-analysis was conducted to compare the efficacy of various oral hygiene care methods for ventilator-associated pneumonia prevention in critically ill patients, and the methods were ranked. A literature search of three representative databases was conducted. We only analyzed parallel randomized controlled trials conducted to analyze the use antiseptics or toothbrushes in oral hygiene care for adult patients undergoing invasive mechanical ventilation in the intensive care unit. The outcome measure was the incidence of ventilator-associated pneumonia. Bias risk was assessed using the Cochrane Risk of Bias 2 tool, and the confidence in the evidence was evaluated using the CINeMA approach. Statistical analyses were performed using R 4.2.0., GeMTC package, and JAGS 4.3.1. The review protocol was registered in PROSPERO (registration number: CRD42022333270). Thirteen randomized controlled trials were included in the qualitative synthesis and twelve randomized controlled trials (2395 participants) were included in the network meta-analysis. Over 50% of the included studies were conducted in medical-surgical intensive care units. Ten treatments were analyzed and 12 pairwise comparisons were conducted in the 12 included studies. Analysis using surface under the cumulative ranking curves revealed that brushing combined with chlorhexidine 0.12% was most likely the optimal intervention for preventing ventilator-associated pneumonia (88.4%), followed by the use of chlorhexidine 0.12% alone (76.1%), and brushing alone (73.2%). Oral hygiene care methods that included brushing had high rankings. In conclusion, brushing combined with chlorhexidine 0.12% may be an effective intervention for preventing ventilator-associated pneumonia in critically ill patients. Furthermore, brushing may be the optimal oral hygiene care method for preventing ventilator-associated pneumonia in the intensive care unit. Further research is needed to verify these findings as the CINeMA confidence rate was low for each comparison.

Introduction

Oral hygiene care is an important strategy for preventing ventilator-associated pneumonia (VAP). VAP is one of the most common hospital infections in mechanically ventilated patients in the intensive care unit (ICU) and is associated with unfavorable outcomes [15]. Tools, such as toothbrushes and swabs, and solutions such as chlorhexidine (CHX), water, and povidone-iodine, are used for providing oral hygiene care in clinical practice [69]. These may be used alone or in combination.

Toothbrushing is recognized as an important component of oral hygiene care in critically ill patients allowing physical removal of dental plaque that is a potential nidus of infection [10]. A network meta-analysis (NMA) comparing 16 oral hygiene interventions has demonstrated that toothbrushing alone is the most effective approach [11]. However, important limitations of the NMA are the inclusion of studies with a duration of intervention that was shorter than the use of mechanical ventilation and of studies including interventions directed to the pharynx rather than the oral cavity [8,1214]. Furthermore, toothbrushes are a low-cost intervention with high feasibility for implementation. In surveys investigating oral care methods used in ICUs, toothbrushes are frequently utilized [15,16]. Thus, toothbrushes are considered a relatively easy-to-apply and effective method for preventing VAP in clinical settings.

Therefore, we hypothesized that oral hygiene care involving toothbrushing would be the most effective method for preventing VAP and conducted an NMA to compare the efficacy of various oral hygiene care methods, including the use of antiseptics and toothbrushing, on the incidence of VAP in adult patients undergoing invasive mechanical ventilation. In addition, we ranked these methods by effectiveness for practical consideration.

Methods

Protocol and registration

The protocol for this study was registered in the International Prospective Register of Systematic Reviews (PROSPERO) in May 2022 (CRD42022333270). This study was conducted and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) extension statement for Network Meta-Analyses [17].

Eligibility criteria

Population.

Participants were adult patients who were admitted to the ICU and underwent invasive mechanical ventilation.

Intervention.

Oral hygiene care using antiseptics and/or tooth brushing was provided continuously throughout the duration of mechanical ventilation. Studies were excluded if any of the following criteria applied: (1) oral hygiene care included the use of antibiotics; (2) patients underwent an intervention that directly involved the larynx and/or pharynx; (3) oral hygiene care was provided temporarily and/or not continuously (e.g., only once after tracheal intubation, for three days only regardless of whether ventilation was required for longer); (4) the intervention involved the use of complex care bundles in which the differences between the intervention and control groups included factors other than tooth brushing, rinsing the mouth, or applying gel (e.g., differences in body position, modification of tube cuff pressure).

Regarding eligible treatments included in the treatment network, CHX was stratified according to its concentration. Manual and electronic brushing were considered the same treatment. Different frequencies of the same intervention were considered the same node. Different types of antiseptics were considered the same treatment because stratification of antiseptics according to type led to several categories of treatments, which may affect the network geometry.

Comparison and control.

Comparisons were usual care (e.g., using only normal saline), placebo, and oral hygiene intervention care if the studies met the inclusion criteria. In this NMA, the control was described as placebo or usual care, with no tooth brushing or use of antiseptics (e.g., using only normal saline).

Outcome and study design.

The outcome was the incidence of VAP. The definition of VAP was based on the definition used in each study. Only parallel randomized controlled trials were included. Articles without full text, letters without reported data, and reviews were excluded.

Search strategy and study selection

A previously described comprehensive search strategy was employed for the identification of eligible articles published in the following databases: Cochrane Central Register of Controlled Trials (CENTRAL) via Ovid, MEDLINE via PubMed, and CINAHL via EBSCO. The search strategy is presented in the S1 Text. The International Clinical Trials Registry Platform was also searched for the identification of registered ongoing trials. The databases were searched from inception to March 24, 2024. Manual searches were also conducted to identify additional relevant studies. We manually checked all the references lists of the relevant systematic reviews to identify any additional studies. Selection of articles was not limited to a specific language.

Two of the five reviewers (SY, EN, SN, JH, and TU) independently screened the titles and abstracts of the articles extracted using the search strategy and identified potentially relevant studies. Thereafter, two of the reviewers independently assessed the eligibility of the screened articles by reviewing their full texts. Disagreements were resolved through discussion and arbitration by another author (TU) when necessary. Finally, the eligible studies were included in the qualitative synthesis and NMA.

Data collection

Two authors (SY and SN) independently extracted data from each included study using a specially designed data extraction form. Disagreements were resolved through reconfirmation and discussion.

The extracted data included the characteristics of the study (i.e., title, author, year of publication, location of the trial, and type of ICU), participant details (i.e., age, sample size, sex, and severity of illness score), data on oral hygiene care (i.e., type of antiseptics, concentration of solutions, use of toothbrushing), and reported outcomes (i.e., incidence of VAP).

Risks of bias within studies

The risk of bias in each study was independently assessed at the outcome level by two authors (SY and TU) using the Cochrane Risk of Bias tool 2.0 [18], which comprises the following five domains: (1) bias arising from the randomization process; (2) bias due to deviations from intended interventions; (3) bias due to missing outcome data; (4) bias in the measurement of the outcome; (5) and bias in the selection of the reported result. Risks of bias were assessed as “low,” “high,” or “some concerns,” and the overall risk of bias was judged based on the results for the domains. Conflicts were resolved through discussions and consensus.

Statistical analysis

We conducted the NMA using the Bayesian approach. NMA can obtain direct and indirect evidence of a correlation between treatment effects observed in various comparisons conducted in multiple trials [19,20]. For the analysis of multi-arm trials with more than two intervention arms, each study was included as a two-arm comparison series in the dataset. Thus, we obtained the treatment effects for each intervention in relation to every comparator in the multi-arm. We adjusted the data using the "powerAdjust" argument, an option available in the GeMTC package, setting the weight for multi-arm trials at 0.7 for correlations between arms within the same study [2123]. The analysis was performed using the Markov-Chain Monte-Carlo (MCMC) method. The NMA was performed using a random effects model. To ensure convergence of the Markov chains, we discarded the first 5,000 iterations as the burn-in period and ran four chains in parallel. The convergence was assessed using two diagnostics, the visual checking of trace plots and the potential scale reduction factor (PSRF) of Gelman-Rubin. Statistical analyses were performed using R 4.2.0 (R Foundation for Statistical Computing, Vienna, Austria)., GeMTC package, and JAGS 4.3.1 (Source Forge, California, United States of America).

Dichotomous variables are presented as risk ratios with 95% confidence intervals (CI) or credential intervals (Crl). Continuous variables are presented as mean and standard deviation or median and interquartile range. The results of comparison of the treatments were summarized in a forest plot by setting oral care without either an antiseptic or toothbrushing as a reference treatment and calculating the risk ratio. The ranking of the treatments was analyzed using the surface under the cumulative ranking curve (SUCRA). The SUCRA is represented as a percentage and indicates the relative probability that one treatment is the best option [24,25]. For discrete variables, we conducted imputation of missing values as worst–worst scenario.

In the network plot, each intervention analyzed in the studies was classified as a treatment and indicated using nodes. Comparisons between treatments are indicated using links connecting the nodes. The size of the node was weighted based on the number of studies that involved the analysis of the relevant interventions. The thickness of the link indicates the number of studies that involved the analysis of the two interventions at either end of the link.

Overall consistency in the network was evaluated using I2 statistics, with values >40% were considered indicative of substantial heterogeneity [26]. The consistency of treatment effect estimates between direct and indirect comparisons was evaluated using the node-splitting method. The results of the node-splitting analysis were presented in a forest plot and used for calculating p-values; therefore, we confirmed the overlapping of 95% CIs through visual assessment [19]. P < 0.05 was considered statistically significant.

Assessment of the quality of the evidence using Confidence in Network meta-analysis (CINeMA)

Confidence in the evidence was evaluated using the CINeMA approach [27,28]. CINeMA is broadly based on the GRADE framework and covers 6 domains: (i) within-study bias (referring to the impact of risk of bias in the included studies), (ii) reporting bias (referring to publication and other reporting biases), (iii) indirectness, (iv) imprecision, (v) heterogeneity, and (vi) incoherence. Each of these domains can assessed according to three levels of concern (no concerns, some concerns, or major concerns) and the reviewer’s input is required at the study level for within-study bias and indirectness. Judgments across domains are summarized to obtain 4 levels of confidence for each relative treatment effect, corresponding to the usual GRADE assessments of very low, low, moderate, or high. Two authors (SY and TU) independently made judgments about the quality of the evidence. Conflicts were resolved through discussions and consensus. These assessments were conducted using the CINeMA web application [29].

Additional analyses

Publication bias was determined by visually assessing a funnel plot. In addition, we conducted a sensitivity analysis of VAP by excluding studies in which assessors were not blinded because blinding of the VAP assessor was associated with the results.

Results

Study selection

We initially identified 6334 articles in the databases, 34 records in the registry, and three articles in the manual search of previous systematic reviews (Fig 1). After excluding duplicate articles, we screened the titles/abstracts of the remaining 4477 articles and 34 records. After the screening, 4269 irrelevant articles were excluded, and four articles were not retrieved. The full texts of the remaining 238 articles were reviewed, and 225 studies were excluded for various reasons, such as differences in study design, inclusion of non-intubated patients, duration of intervention shorter than the duration of mechanical ventilation, use of complex care bundles, and study report was the abstract of other literature. Finally, 13 studies were included in the qualitative synthesis and 12 studies were included in the network meta-analysis.

Characteristics of the included studies

The characteristics of the studies included in the qualitative synthesis are summarized in Table 1. The included studies were published between 2000 and 2024. More than half of the studies were conducted in medical-surgical intensive care units [3035] and two were multicenter studies [36,37]. Of the 13 studies included, 10 were two-arm studies [30,31,33,34,3641] and three were three-arm studies [32,35,42]. We integrated the interventions in one of the three-arm studies because the only difference between the interventions was frequency [42]. The combined sample size of the 12 included studies in the network meta-analysis was 2395 participants.

thumbnail
Table 1. Characteristics of the studies included in the qualitative synthesis.

https://doi.org/10.1371/journal.pone.0313057.t001

Summary of network geometry

Fig 2 shows the network plot of the comparisons of the outcomes of the different treatments. Ten treatments were analyzed and 12 pairwise comparisons were conducted in the 12 included studies. There were no missing values in the extracted data. In the network plot, each treatment is indicated as blue dots (nodes), and the size of the dots indicates the total number of participants who underwent the intervention. Comparisons between treatments are indicated as black lines (links), and the thickness of the lines indicates the number of studies in which two treatments were analyzed. Controls are described as placebo or usual care, which was defined as not using brushing and/or antiseptics.

The largest node was “brushing only” and “brushing combined with CHX 0.12%,” which was analyzed in four studies, followed by “brushing combined with CHX 0.2%,” “CHX 0.12% only,” and “control group,” which were analyzed in three studies. Of the twelve links, the most common direct comparison was “brushing combined with CHX 0.12%” and “CHX 0.12% only,” which was compared in three studies.

In the networks for comparisons of multiple treatment, the links between nodes indicate evidence of direct comparisons between interventions. The thickness of the links indicates the number of studies in which the two treatments were analyzed, and the size of the nodes indicates the total number of participants who underwent the intervention. Controls (Ctr) received placebo or usual care, which was defined as not using brushing and/or antiseptics.

Br, brushing only; BrBicarbonate, brushing combined with bicarbonate; BrCHX012, brushing combined with chlorhexidine 0.12%; BrCHX02, brushing combined with chlorhexidine 0.2%; BrCHX2, brushing combined with chlorhexidine 2%; BrListerine, brushing combined with Listerine; CHX012, chlorhexidine 0.12% only; CHX02, chlorhexidine 0.2% only; CHX2, chlorhexidine 2% only; Ctr, control group.

The sources of data for each intervention: Br [32,33,35,42], BrBicarbonate [32,35], BrCHX012 [31,34,40,42], BrCHX02 [32,38,39], BrCHX2 [33,39], BrListerine [35], CHX012 [31,34,40], CHX02 [30,36,38], CHX2 [37], Ctr [30,36,37].

Risks of bias within studies

The results of the risk of bias assessment of the included studies are shown in Fig 3 [green (+): low risk, red (x): high risk, and yellow (-): some concerns]. Of the 12 included studies, six were deemed to have a low risk of bias [31,34,36,39,40,42], five had some bias concerns [30,32,33,35,37], and one had a high risk of bias [38]. Some of the studies had ‘some concerns’ in the overall risk of bias because we could not assess the “bias in the selection of the reported result” domain owing to the lack of a study protocol. Moreover, we noted that one study [32] had possible deviations because of its trial context; however, there was no evidence that these deviations affected the reported outcome. Another study was deemed to have a high risk of bias in the “bias in the measurement of the outcome” domain because nurses may have been involved in the diagnosis of VAP; however, the nurses were not blinded to the intervention groups [38].

Exploration for inconsistency

Direct and indirect comparisons of the consistency of the treatment effect estimates using the node-splitting method did not reveal any significant inconsistency (all p > 0.05, S1 Fig). The heterogeneity of the overall network was calculated using the I2 statistic and no significant heterogeneity was observed (I2 = 7%). The network meta-analyses were performed using a random effects model. The PSRF value was 1 and it stabilized after 100,000 iterations, confirming that the convergence effect was good.

Synthesis of results and confidence in NMA

Fig 4 shows the risk ratio for each intervention compared with the control. Compared to the control intervention, brushing with CHX 0.12% (RR = 0.05; 95% Crl, 0.00–0.93; certainty of evidence: low) significantly reduced the incidence of VAP.

thumbnail
Fig 4. Forest plot of efficacy the treatments in preventing VAP compared with the control.

Br, brushing only; BrBicarbonate, brushing combined with bicarbonate; BrCHX012, brushing combined with chlorhexidine 0.12%; BrCHX02, brushing combined with chlorhexidine 0.2%; BrCHX2, brushing combined with chlorhexidine 2%; BrListerine, brushing combined with Listerine; CHX012, chlorhexidine 0.12% only; CHX02, chlorhexidine 0.2% only; CHX2, chlorhexidine 2% only; Ctr, control group.

https://doi.org/10.1371/journal.pone.0313057.g004

The results obtained from the SUCRA analysis are presented in Fig 5 and Table 2. The SUCRA revealed that brushing combined with CHX 0.12% was most likely to be ranked as the optimal intervention (88.4%), followed by CHX 0.12% only and brushing only (76.1% and 73.2%, respectively). The lowest ranking group was the control group, which used neither antiseptics nor toothbrushing. Methods that involved brushing occupied the first and the third to seventh ranks, whereas CHX 0.12% only was ranked second. However, the confidence rating with CINeMA was low or very low in each comparison. The main reasons for downgrading were related to within-study bias, with many studies rated as having ’Some concerns’ due to the absence of protocols. Additionally, concerns regarding imprecision were noted due to the small number of included studies. The results of the CINeMA assessment are provided in the Supporting Information (S2 Fig and S3 Table).

thumbnail
Fig 5. The surface under the cumulative ranking curve (SUCRA) of the efficacy of oral hygiene care interventions in reducing the incidence of VAP.

The SUCRA value is the probability that each intervention is the best in the network. Larger values represent probabilities of higher ranking. Br, brushing only; BrBicarbonate, brushing combined with bicarbonate; BrCHX012, brushing combined with chlorhexidine 0.12%; BrCHX02, brushing combined with chlorhexidine 0.2%; BrCHX2, brushing combined with chlorhexidine 2%; BrListerine, brushing combined with Listerine; CHX012, chlorhexidine 0.12% only; CHX02, chlorhexidine 0.2% only; CHX2, chlorhexidine 2% only; Ctr, control group. The sources of data for each intervention: Br [32,33,35,42], BrBicarbonate [32,35], BrCHX012 [31,34,40,42], BrCHX02 [32,38,39], BrCHX2 [33,39], BrListerine [35], CHX012 [31,34,40], CHX02 [30,36,38], CHX2 [37], Ctr [30,36,37].

https://doi.org/10.1371/journal.pone.0313057.g005

thumbnail
Table 2. Ranking order of the treatments based on the SUCRA analysis.

https://doi.org/10.1371/journal.pone.0313057.t002

Results of additional analyses

The funnel plot is shown in the S3 Fig. The likelihood of publication bias was considered to be low because no obvious asymmetry was observed on visual assessment.

The VAP assessor in one of the 12 included studies was not blinded [38]; therefore, we attempted a sensitivity analysis. However, the direct comparisons were insufficient for connecting the networks if the applicable study was excluded; thus, the sensitivity analysis could not be conducted. Fig 6 shows the network plot for a scenario in which the network was not connected.

thumbnail
Fig 6. Comparison of the network plot before and after excluding the applicable literature to conduct the sensitivity analysis.

Compared with the network plot created in this study (A), the network plot used for the sensitivity analysis had a gap that was not connected to the network (B). Br, B = brushing only; BrBicarbonate, brushing combined with bicarbonate; BrCHX012, brushing combined with chlorhexidine 0.12%; BrCHX02, brushing combined with chlorhexidine 0.2%; BrCHX2, brushing combined with chlorhexidine 2%; BrListerine, brushing combined with Listerine; CHX012, chlorhexidine 0.12% only; CHX02, chlorhexidine 0.2% only; CHX2, chlorhexidine 2% only; Ctr, control group. The sources of data for each intervention: Br [32,33,35,42], BrBicarbonate [32,35], BrCHX012 [31,34,40,42], BrCHX02 [32,38,39], BrCHX2 [33,39], BrListerine [35], CHX012 [31,34,40], CHX02 [30,36,38], CHX2 [37], Ctr [30,36,37].

https://doi.org/10.1371/journal.pone.0313057.g006

Discussion

In this study, we hypothesized that oral hygiene care with toothbrushing would be the most effective method for preventing VAP in ICU patients, so we conducted an NMA to compare and rank the efficacies of various oral hygiene care methods for the prevention of VAP. The results showed that brushing combined with CHX 0.12% was most likely to be selected as the optimal oral hygiene care intervention for preventing VAP in ICU patients, followed by CHX 0.12% only and brushing only. In addition, the results indicated that the probability rankings for CHX 0.12% only and brushing only were similar; however, oral hygiene care methods that included brushing ranked higher overall.

The ranking of oral hygiene care methods for preventing VAP in the present study differs from that reported in previous studies. Sankaran et al. compared 16 oral hygiene care methods analyzed in 25 studies and found that the three best interventions were brushing only, brushing with povidone-iodine, and use of furacillin [11]. Yang et al. classified the efficacies of different concentrations of CHX (0.12%, 0.2%, and 2%) for oral hygiene reported in 19 studies, and compared four methods used in the placebo groups. The authors reported that CHX 2% and CHX 0.12% may be optimal oral hygiene care methods for preventing VAP, with CHX 2% ranking higher than CHX 0.12% [43]. The differences in rankings between the present study and previous studies may be attributed to two main reasons. First, there were differences in the inclusion criteria between our study and previous studies. Although Sankaran et al. conducted an NMA, the authors included studies in which the duration of intervention was shorter than that of mechanical ventilation and studies that with interventions directed to the pharynx rather than the oral cavity [8,1214]. Although studies with these characteristics were excluded from the present study because they did not meet the inclusion criteria, some of the studies also included the evaluation of interventions such as use of povidone-iodine only, brushing with povidone-iodine, and furacillin; therefore, these methods of oral hygiene care were not included in the present study. Yang et al. conducted an NMA of studies on the use of different CHX concentrations for oral hygiene care; however, the authors did not consider whether brushing was included in the intervention [43]. In the present study, we classified not only differences in CHX concentration but also whether use of CHX was combined with brushing; therefore, the ranking of the methods differed from the previously reported ranking. Second, the present study included the most recent research in the field. Sankaran et al. analyzed the literature included in a Cochrane review published in 2016 [11,44], which was subsequently updated in 2020 [9]. In the present study, we included three articles published in 2017, including reports of studies in which the efficacy of different CHX concentrations and use of CHX with or without brushing were compared [3840]. Therefore, the more recent studies included in the present NMA may have directly and indirectly added evidence that affected the rankings.

The use of a toothbrush for oral hygiene care may be effective in preventing VAP. In the present study, oral hygiene care methods that include brushing tended to rank high among the ten oral hygiene care methods analyzed. The results of meta-analysis conducted by Cochrane Review suggested the efficacy of brushing for preventing VAP [9]. Additionally, an RCT that included 3,260 participants indicated that the efficacy of brushing alone was not significantly different from that of brushing with 0.12% CHX in preventing infection-related ventilator-associated complications, including VAP [45]. In other words, the significance of using CHX 0.12% for oral hygiene care was analyzed in the study, and the efficacy of brushing was demonstrated. However, a step-wedge cluster design was applied in this RCT; thus, we could not include it in the present study. It should be noted that this may have influenced the rankings in the present study by elevating the efficacy of brushing in our results. However, no other study was excluded from this review based on its design alone.

Oral hygiene care using CHX is currently not actively recommended. Some studies have reported that use of CHX for oral hygiene care is associated with adverse outcomes, such as mortality. For example, a meta-analysis on the efficacy of oral hygiene care without CHX in non-cardiac surgery patients showed that the use of CHX increased mortality; however, the result was not significant [46]. Price et al. analyzed the safety of CHX and compared the following four groups in their NMA: selective digestive decontamination group, selective oropharyngeal decontamination group, oropharyngeal chlorhexidine (CHX group), and standard care or placebo (control group) [47]. Pairwise meta-analysis showed that the CHX group had a significantly increased risk of mortality compared with the control group. In addition, NMA of the risk of mortality showed that the CHX group ranked lower than the control group [47]. In light of these findings, use of CHX for oral hygiene care is not actively recommended in recent guidelines and consensus papers [10,48]. Therefore, use of CHX for oral hygiene care may be essentially ranked lower than that in our results and may not be recommended in clinical practice.

This study has some limitations. First, despite the evaluation of heterogeneity and consistency in this study, some factors may have affected the results of the NMA. For example, the frequency of oral hygiene care per day varied between studies; however, we did not categorize the differences in frequency. Nevertheless, we believe that our inclusion criteria, such as the definition of intervention duration and the exclusion of complex interventions, could minimize potential heterogeneity. Moreover, the frequencies of the interventions in the included studies were similar (approximately 2–3 times per day). Second, the number of studies that were directly compared may be insufficient. Although sensitivity analysis should be conducted if the VAP assessor in a study was not blinded, we could not conduct sensitivity analyses because the network plot was not connected when the applicable study was excluded. In addition, of the 12 direct comparisons conducted, the most common comparison was three cases. Third, most of the included studies had ‘some concerns’ regarding the risk of bias, mainly because they did not have a study protocol. Moreover, of the 12 studies, one had a high overall risk of bias because the VAP assessor was not blinded. Finally, the confidence ratings using CINeMA were categorized as low or very low for each comparison. While these ratings were primarily due to issues with protocol reporting and the limited number of studies, we consider these issues could be addressed with future research. However, the remaining concern about imprecision is a limitation of the present study.

Clinical implications

We suggest that the use of a toothbrush for oral hygiene care be included in the recommended clinical practice for preventing VAP. Oral hygiene care using a toothbrush consistently ranked highly for effectiveness in our analyses. Moreover, while a toothbrush is a low-cost option with high feasibility for implementation, concerns have been raised regarding potential adverse outcomes associated with the use of CHX. Overall, these data indicate that toothbrush-based oral hygiene care is a promising approach to preventing VAP in ICU patients.

Research implications

Further research on oral hygiene care methods involving brushing is needed. For example, exploring the optimal brushing frequency and timing to prevent VAP is a critical area for future investigation. Future research should also determine the appropriate softness of toothbrush bristles and the ideal toothbrush size for the effective and safe removal of dental plaque. Identifying the optimal techniques to eliminate contaminants after brushing, such as wiping and rinsing, is also a priority. Moreover, several studies were excluded from this analysis due to the intervention duration being shorter than the period of mechanical ventilation. Future studies should consider extending the focus beyond early-onset VAP to cases occurring throughout the entire duration of mechanical ventilation, which may yield insights into favorable patient outcomes over the long term. Finally, there is limited research on oral cavity conditions, including dental caries, tooth loss, and dry mouth. These factors may be relevant to the interpretation of the data on VAP and should be incorporated into future research designs.

Conclusions

The present NMA indicated that brushing combined with chlorhexidine 0.12% may be an effective intervention for the prevention of VAP in ICU patients. In addition, the results of this study show that oral hygiene care that includes brushing may be recommended as the optimal method for preventing VAP in clinical settings. However, as the number of studies included in this NMA is small, further research is needed to obtain more accurate results regarding the optimal oral hygiene care methods for preventing VAP in ICU patients.

Supporting information

S1 Fig. Forest plot for direct and indirect comparisons of treatment effects using the node-splitting method.

https://doi.org/10.1371/journal.pone.0313057.s002

(DOCX)

S1 Table. All studies identified in the literature search.

https://doi.org/10.1371/journal.pone.0313057.s006

(XLSX)

S2 Table. Evaluation of each domain and parameter in the Risk of Bias (RoB) assessment.

https://doi.org/10.1371/journal.pone.0313057.s007

(XLSX)

S3 Table. Assessment of quality of evidence using CINeMA.

https://doi.org/10.1371/journal.pone.0313057.s008

(DOCX)

References

  1. 1. Kollef MH. The prevention of ventilator-associated pneumonia. N Engl J Med. 1999;340: 627–634. pmid:10029648
  2. 2. Chastre J, Fagon JY. Ventilator-associated pneumonia. Am J Respir Crit Care Med. 2002;165: 867–903. pmid:11934711
  3. 3. Papazian L, Klompas M, Luyt CE. Ventilator-associated pneumonia in adults: a narrative review. Intensive Care Med. 2020;46: 888–906. pmid:32157357
  4. 4. Rello J, Ollendorf DA, Oster G, Vera-Llonch M, Bellm L, Redman R, et al. Epidemiology and outcomes of ventilator-associated pneumonia in a large US database. Chest. 2002;122: 2115–2121. pmid:12475855
  5. 5. Melsen WG, Rovers MM, Groenwold RHH, Bergmans DCJJ, Camus C, Bauer TT, et al. Attributable mortality of ventilator-associated pneumonia: a meta-analysis of individual patient data from randomised prevention studies. Lancet Infect Dis. 2013;13: 665–671. pmid:23622939
  6. 6. Binkley C, Furr LA, Carrico R, McCurren C. Survey of oral care practices in US intensive care units. Am J Infect Control. 2004;32: 161–169. pmid:15153928
  7. 7. Feider LL, Mitchell P, Bridges E. Oral care practices for orally intubated critically ill adults. Am J Crit Care. 2010;19: 175–183. pmid:20194614
  8. 8. Seguin P, Laviolle B, Dahyot-Fizelier C, Dumont R, Veber B, Gergaud S, et al. Effect of oropharyngeal povidone-iodine preventive oral care on ventilator-associated pneumonia in severely brain-injured or cerebral hemorrhage patients: a multicenter, randomized controlled trial. Crit Care Med. 2014;42: 1–8. pmid:24105456
  9. 9. Zhao T, Wu X, Zhang Q, Li C, Worthington HV, Hua F. Oral hygiene care for critically ill patients to prevent ventilator‐associated pneumonia. Cochrane Database Syst Rev. 2020 [Cited 18 Aug 2023];12: CD008367. pmid:33368159
  10. 10. Collins T, Plowright C, Gibson V, Stayt L, Clarke S, Caisley J, et al. British Association of Critical Care Nurses: evidence-based consensus paper for oral care within adult critical care units. Nurs Crit Care. 2021;26: 224–233. pmid:33124119
  11. 11. Sankaran SP, Sonis S. Network meta-analysis from a pairwise meta-analysis design: to assess the comparative effectiveness of oral care interventions in preventing ventilator-associated pneumonia in critically ill patients. Clin Oral Investig. 2021;25: 2439–2447. pmid:33537946
  12. 12. Feng S, Sun X, Chen Y. Application of different mouthwashes in oral nursing for patients with orotracheal intubation. China Med Pharm. 2012.
  13. 13. Grap MJ, Munro CL, Hamilton VA, Elswick RK Jr, Sessler CN, Ward KR. Early, single chlorhexidine application reduces ventilator-associated pneumonia in trauma patients. Heart Lung. 2011;40: e115–e122. pmid:21411151
  14. 14. Yao LY, Chang CK, Maa SH, Wang C, Chen CC-H. Brushing teeth with purified water to reduce ventilator-associated pneumonia. J Nurs Res. 2011;19: 289–297. pmid:22089654
  15. 15. Kelly N, Blackwood B, Credland N, Stayt L, Causey C, Winning L, et al. Oral health care in adult intensive care units: A national point prevalence study. Nurs Crit Care. 2023;28(5), 773–780. pmid:37125669
  16. 16. Kuribara T, Unoki T, Yamakita S, Hashimoto N, Yoshino Y, Sakuramoto H. et al. Nation-wide survey of oral care practice in Japanese intensive care units: A descriptive study. PloS One. 2024;19(3), e0301258. pmid:38551939
  17. 17. Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162: 777–784. pmid:26030634
  18. 18. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366: http://paperpile.com/b/FDy0Rv/gnMcl4898. pmid:31462531
  19. 19. Shim SR, Kim SJ, Lee J, Rücker G. Network meta-analysis: application and practice using R software. Epidemiol Health. 2019;41: e2019013. pmid:30999733
  20. 20. Chaimani A, Caldwell DM, Li T, Higgins JPT, Salanti G. Chapter 11. Undertaking network meta-analyses. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al., editors. Available from: https://training.cochrane.org/handbook/current/chapter-11. Cochrane Handbook for Systematic Reviews of Interventions version 64. Cochrane; 2023.; Available.
  21. 21. Rücker G, Schwarzer G. Reduce dimension or reduce weights? Comparing two approaches to multi-arm studies in network meta-analysis. Stat Med. 2014;33(25), 4353–4369. pmid:24942211
  22. 22. Hu D, O’Connor AM, Wang C, Sargeant JM, Winder CB. How to Conduct a Bayesian Network Meta-Analysis. Frontiers in Veterinary Science, 2020; 7, 271. pmid:32509807
  23. 23. van Valkenhoef G, Kuiper J. gemtc: Network Meta-Analysis Using Bayesian Methods (Version 1.0–2) [R package]. CRAN. 2024. https://CRAN.R-project.org/package=gemtc
  24. 24. Chaimani A, Higgins JPT, Mavridis D, Spyridonos P, Salanti G. Graphical tools for network meta-analysis in Stata. PLOS ONE. 2013;8: e76654. pmid:24098547
  25. 25. Shim S, Yoon BH, Shin IS, Bae JM. Network meta-analysis: application and practice using Stata. Epidemiol Health. 2017;39: e2017047. pmid:29092392
  26. 26. Dg DJHJ, editor. Chapter 10. Analysing data and undertaking meta-analyses. Chapter 10: Analysing data and undertaking meta-analyses. Available from: www.training.cochrane.org/handbook.: Cochrane Handbook for Systematic Reviews of Interventions. version 6.4; 2023, Higgins p JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA. [Cited 2023 December 22]. Available from: https://training.cochrane.org/handbook/current/chapter-10.
  27. 27. Nikolakopoulou A, Higgins JPT, Papakonstantinou T, Chaimani A, Del Giovane C, Egger M et al. CINeMA: An approach for assessing confidence in the results of a network meta-analysis. PLoS Medicine, 2020;17(4), e1003082. pmid:32243458
  28. 28. Papakonstantinou T, Nikolakopoulou A, Higgins JPT, Egger M, Salanti G. CINeMA: Software for semiautomated assessment of the confidence in the results of network meta-analysis. Campbell Syst Rev. 2020;16(1), e1080. pmid:37131978
  29. 29. CINeMA: Confidence in Network Meta-Analysis. Bern: Institute of Social and Preventive Medicine; [cited 2024 Aug 20]. Available from: https://cinema.ispm.unibe.ch/
  30. 30. Fourrier F, Cau-Pottier E, Boutigny H, Roussel-Delvallez M, Jourdain M, Chopin C. Effects of dental plaque antiseptic decontamination on bacterial colonization and nosocomial infections in critically ill patients. Intensive Care Med. 2000;26: 1239–1247. pmid:11089748
  31. 31. Pobo A, Lisboa T, Rodriguez A, Sole R, Magret M, Trefler S, et al. A randomized trial of dental brushing for preventing ventilator-associated pneumonia. Chest. 2009;136: 433–439. pmid:19482956
  32. 32. Berry AM, Davidson PM, Masters J, Rolls K, Ollerton R. Effects of three approaches to standardized oral hygiene to reduce bacterial colonization and ventilator associated pneumonia in mechanically ventilated patients: a randomised control trial. Int J Nurs Stud. 2011;48: 681–688. pmid:21185559
  33. 33. Meinberg MCde A, Cheade M de FM, Miranda ALD, Fachini MM, Lobo SM. The use of 2% chlorhexidine gel and toothbrushing for oral hygiene of patients receiving mechanical ventilation: effects on ventilator-associated pneumonia. Rev Bras Ter Intensiva. 2012;24: 369–374. pmid:23917935
  34. 34. Lorente L, Lecuona M, Jiménez A, Palmero S, Pastor E, Lafuente N, et al. Ventilator-associated pneumonia with or without toothbrushing: a randomized controlled trial. Eur J Clin Microbiol Infect Dis. 2012;31: 2621–2629. pmid:22422274
  35. 35. Berry AM. A comparison of Listerine® and sodium bicarbonate oral cleansing solutions on dental plaque colonisation and incidence of ventilator associated pneumonia in mechanically ventilated patients: a randomised control trial. Intensive Crit Care Nurs. 2013;29: 275–281. pmid:23692975
  36. 36. Fourrier F, Dubois D, Pronnier P, Herbecq P, Leroy O, Desmettre T, et al. Effect of gingival and dental plaque antiseptic decontamination on nosocomial infections acquired in the intensive care unit: a double-blind placebo-controlled multicenter study. Crit Care Med. 2005;33: 1728–1735. pmid:16096449
  37. 37. Koeman M, van der Ven AJAM, Hak E, Joore HCA, Kaasjager K, de Smet AGA, et al. Oral decontamination with chlorhexidine reduces the incidence of ventilator-associated pneumonia. Am J Respir Crit Care Med. 2006;173: 1348–1355. pmid:16603609
  38. 38. Chacko R, Rajan A, Lionel P, Thilagavathi M, Yadav B, Premkumar J. Oral decontamination techniques and ventilator-associated pneumonia. Br J Nurs. 2017;26: 594–599. pmid:28594615
  39. 39. Zand F, Zahed L, Mansouri P, Dehghanrad F, Bahrani M, Ghorbani M. The effects of oral rinse with 0.2% and 2% chlorhexidine on oropharyngeal colonization and ventilator associated pneumonia in adults’ intensive care units. J Crit Care. 2017;40: 318–322. pmid:28320561
  40. 40. de Lacerda Vidal CF, Vidal AKde L, Monteiro JGde M Jr, Cavalcanti A, Henriques APC, Oliveira M, et al. Impact of oral hygiene involving toothbrushing versus chlorhexidine in the prevention of ventilator-associated pneumonia: a randomized study. BMC Infect Dis. 2017;17: 112. pmid:28143414
  41. 41. Santos Zambrano TB, Guillén Vivas XS, Santos CB, de Fátima Mestre V, Maddela NR, Galarza Santana LE, Couto de Almeida RS. Evaluation of brushing efficiency in reducing oral microbiota in mechanically ventilated patients admitted to an intensive care unit. Infect Prev Pract. 2024 Feb 3;6(1):100346. pmid:38380354
  42. 42. Scannapieco FA, Yu J, Raghavendran K, Vacanti A, Owens SI, Wood K, et al. A randomized trial of chlorhexidine gluconate on oral bacterial pathogens in mechanically ventilated patients. Crit Care. 2009;13: R117. pmid:19765321
  43. 43. Yang L, Zhang Q, Zhai H. Comparative efficacy of different concentrations of chlorhexidine for prevention of ventilator‐associated pneumonia in intensive care units: A systematic review and network meta‐analysis. Nurs Crit Care. 2024;29: 246–254.
  44. 44. Hua F, Xie H, Worthington HV, Furness S, Zhang Q, Li C. Oral hygiene care for critically ill patients to prevent ventilator-associated pneumonia. Cochrane Database Syst Rev. 2016;10: CD008367. pmid:27778318
  45. 45. Dale CM, Rose L, Carbone S, Pinto R, Smith OM, Burry L, et al. Effect of oral chlorhexidine de-adoption and implementation of an oral care bundle on mortality for mechanically ventilated patients in the intensive care unit (CHORAL): a multi-center stepped wedge cluster-randomized controlled trial. Intensive Care Med. 2021;47: 1295–1302. pmid:34609548
  46. 46. Klompas M, Speck K, Howell MD, Greene LR, Berenholtz SM. Reappraisal of routine oral care with chlorhexidine gluconate for patients receiving mechanical ventilation: systematic review and meta-analysis. JAMA Intern Med. 2014;174: 751–761. pmid:24663255
  47. 47. Price R, MacLennan G, Glen J, SuDDICU Collaboration. Selective digestive or oropharyngeal decontamination and topical oropharyngeal chlorhexidine for prevention of death in general intensive care: systematic review and network meta-analysis. BMJ. 2014;348: g2197. pmid:24687313
  48. 48. Torres A, Niederman MS, Chastre J, Ewig S, Fernandez-Vandellos P, Hanberger H, et al. International ERS/ESICM/ESCMID/ALAT guidelines for the management of hospital-acquired pneumonia and ventilator-associated pneumonia: guidelines for the management of hospital-acquired pneumonia (HAP)/ventilator-associated pneumonia (VAP) of the European Respiratory Society (ERS), European Society of Intensive Care Medicine (ESICM), European Society of Clinical Microbiology and Infectious Diseases (ESCMID) and Asociación Latinoamericana del Tórax (ALAT). Eur Respir J. European Society of Intensive Care Medicine. European Society of Clinical Microbiology and Infectious Diseases (European Society of Clinical Microbiology and Infectious Diseases) and Asociación Latinoamericana del Tórax. 2017;50. https://doi.org/10.1183/13993003.00582–2017