Risk prediction model for difficulty in weaning from mechanical ventilation in critically ill patients: results from a multicentre retrospective study

  1. 6Department of Respiratory, Haihe Hospital, Tianjin University, Tianjin, China
  2. 7TianJin First Center Hospital, Tianjin, China
  1. Correspondence to Dr Lei Xu; nokia007008{at}163.com; Dr Wenxiong Li; lwx7115{at}sina.com; Dr Quansheng Du; dqs888{at}126.com

We aimed to establish a diagnostic system using retrospective data to predict difficult wean from mechanical ventilation.

A multicentre retrospective study

Five tertiary hospitals from China.

Critically ill patients received mechanical ventilation between January 2018 and December 2022.

The primary endpoint was success weaning from mechanical ventilation (>48 hours), reintubation or death, whichever occurred first.

Among 1365 initially screened patients, 703 patients (median age: 69 years; 63.02% male) were included. From 42 factors, 22 (p≤0.10) were identified for multivariate analysis. Subsequently, the lung injury score, brain natriuretic peptide level at 24 hours, 24 hour fluid balance, use of dexmedetomidine, spontaneous breathing trial (continuous positive airway pressure vs other) and endotracheal tube reinsertion were included in the predictive model. The area under the curve value was 0.8888 (95% CI: 0.8382, 0.9394). The sensitivity, specificity, positive predictive value, negative predictive value, accuracy, likelihood ratio (LR)+ and LR− were 0.7559, 0.875, 0.9746, 0.3608, 0.7721, 6.0743 and 0.279, respectively. We established a nomogram model based on the optimal model.

A model with six factors was established to predict difficult wean from mechanical ventilation in critically ill patients. However, the model should be verified in future well-designed studies before being extended to other populations.

ChiCTR1900021432. Registered on February 21, 2019; Post-results.

Data are available upon reasonable request.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Mechanical ventilation, aided by a ventilator, helps maintain airway patency, improves ventilation and oxygenation, prevents hypoxia and carbon dioxide (CO2) buildup and helps the body overcome respiratory failure caused by underlying diseases.1 However, timely liberation from the ventilator is the ultimate goal and a key challenge in clinical practice during mechanical ventilation.

Traditionally, a lack of systematic understanding of weaning from mechanical ventilation has led to reliance on subjective clinical judgement or experience, often resulting in delayed extubation, potential complications, high hospitalisation costs and potential threats to post-discharge quality of life of patients.2 3 Recently proposed objective criteria-based wean from mechanical ventilation plans aim to reduce mechanical ventilation duration, lower complications such as ventilator-associated pneumonia and decrease hospitalisation costs to some extent.4 However, these plans lack standardisation, especially for early diagnosis in challenging cases, which may lead to extubation failure or unnecessarily prolonged mechanical ventilation, thereby affecting patient outcomes.4 5 Further research on patients receiving mechanical ventilation is essential to establish a standardised wean from the mechanical ventilation system.

The mechanical ventilation process generally involves six stages: treating respiratory failure and gradually reducing ventilator support, conducting initial assessment for extubation, monitoring physiological indicators such as MIP and rapid shallow breathing index (RSBI), conducting a spontaneous breathing trial (SBT), performing actual extubation and performing reintubation if needed. Prolonged weaning from mechanical ventilation constitutes 40–50% of the total mechanical ventilation time, thereby increasing patient mortality.5 Some deaths result from complications of mechanical ventilation, especially VAP and airway damage.6 7 Patients with prolonged ventilation consume 37% of healthcare resources.8 Unplanned extubation occurs in 0.5–35.8% of cases, with 83% of such cases being self-extubation. Moreover, approximately 50% of these patients do not require reintubation, indicating that many patients spend unnecessary time on mechanical ventilation.8 In case of no delay, the mortality rate is 12%, whereas it increases to 27% in case of delays.9 Therefore, daily systematic assessment of extubation potential reduces ventilation duration and mortality, making it an independent predictor of difficult weaning from mechanical ventilation and survival.

Extubation failure, defined as SBT failure or the need for reintubation within 48 hours post-extubation, has various indicators, such as rapid breathing and tachycardia.10 The prevalence of extubation failure has been reported to be 61%, 41% and 38% in patients with chronic obstructive pulmonary disease, neurological disorders and hypoxemia, respectively.11 Evidence suggests that various factors are related to extubation failure, including respiratory load, cardiac load, neuromuscular capacity, psychosocial factors and metabolic and endocrine factors.12 Considering the factors affecting extubation across all body systems, it is important to develop a diagnostic system for the early prediction of difficult wean from mechanical ventilation. Thus, we used retrospective data to establish a diagnostic system based on multiple factors to predict difficult wean from mechanical ventilation, thereby reducing failure rates and improving patient outcomes.

This multicentre retrospective study was conducted by a collaborative group in China to identify factors affecting wean from mechanical ventilation and establish an early diagnostic prediction system for difficult to wean from mechanical ventilation. The collaborative group included five hospitals in China: Tianjin Third Central Hospital, Beijing Chao-Yang Hospital, Capital Medical University, Hebei General Hospital, TianJin First Center Hospital and Haihe Hospital, Tianjin University.

Patients who received mechanical ventilation in intensive care units (ICUs) at the abovementioned hospitals between 1 January 2018 and 31 December 2022 were included in this study. We included ICU patients who (1) received mechanical ventilation, (2) were aged ≥18 years and (3) underwent at least one SBT. Patients with tracheostomy and those who did not undergo SBT were excluded from this study. The decision to conduct an SBT was made by the ICU physicians based on standard clinical protocols. According to the American Thoracic Society of Intensive Care Medicine, the daily screening for SBT eligibility occurs once patients meet minimal clinical thresholds. The SBT was performed using continuous positive airway pressure (CPAP) and others (including T-tube and PSV), and its success was determined based on clinical signs such as respiratory rate (RR), tidal volume, gas exchange and patient tolerance. In accordance with the Declaration of Helsinki, this study protocol was approved by the Ethics Committees of TianJin Third Central Hospital (IRB Number: IRB2018-031-02). Because this study was retrospective, informed consent was waived.

The primary endpoint was defined as the occurrence of any of the following events: success weaning from mechanical ventilation lasting more than 48 hours, reintubation within 48 hours post-extubation or death after mechanical ventilation, whichever occurred first. According to the difficulty and duration of weaning from mechanical ventilation, the participants were categorised into three groups: simple, difficult and prolonged wean from mechanical ventilation in our clinical practice.10 12 13 Simple wean from mechanical ventilation involved successful completion of the first SBT and subsequent successful extubation. Difficult weaning from mechanical ventilation required at least three SBTs or successful extubation within 7 days from the first SBT. Prolonged weaning from mechanical ventilation required at least three SBTs or successful extubation >7 days after the first SBT. Extubation failure was defined as SBT failure or the need for reintubation within 48 hours post-extubation. SBT failure was defined using objective indicators, such as rapid breathing, tachycardia, hypertension, hypotension, hypoxaemia, acidosis and arrhythmia, and subjective indicators, such as anxiety, distress, depression, profuse sweating and use of accessory respiratory muscles. The difficult extubation, prolonged extubation, reintubation within 48 hours of weaning and death within 48 hours of weaning are all classified as the difficult weaning group.

Using electronic medical records of hospitals, we obtained patient demographic data (age and sex), human behavioural information (smoking and alcohol status) and clinical information from baseline to ICU admission, 24 hours before weaning from mechanical ventilation and 72 hours before weaning from mechanical ventilation (including baseline characteristics such as clinical diagnosis, Charlson comorbidity index, Sequential Organ Failure Assessment (SOFA) score, Glasgow coma scale (GCS) score, Simplified Acute Physiology Score II (SAPS II) score and acute phychologic assessment and health evaluation II (APACHE II) score; status at ICU admission such as D-dimer, alanine transaminase (ALT), aspartate aminotransferase (AST), globulin, lactate dehydrogenase (LDH), ejection fraction (EF%), brain natriuretic peptide (BNP); status at 24 hours before extubation such as ALT, AST, albumin (ALB), prealbumin, blood urea nitrogen (BUN), urine volume, PHA (Arterial blood gas PH), bicarbonate (HCO3), BE (Base excess), lung injury score, RR, mechanical ventilation days, invasive mechanical ventilation days, EF%, BNP, 24 hours fluid balance, use of midazolam, and use of dexmedetomidine; Status at 72 hours before extubation such as procalcitonin (PCT), GCS score, invasive mechanical ventilation days, ICU days, SBT, endotracheal tube reinsertion, and tracheostomy).

We evaluated 10 factors at baseline, 7 factors at ICU admission, 18 factors within 24 hours before weaning from mechanical ventilation and 7 factors within 72 hours before weaning from mechanical ventilation using univariate and multivariate logistic regression models. We first selected significant factors using a univariate logistic regression model and then used stepwise multivariate logistic regression to determine the three best models. We compared the receiver operating characteristic (ROC) curve and area under the ROC curve (AUC) values of the predictive models and calculated the sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV) and likelihood ratios (LRs) for each model under the best cut-off point indicated by the Youden index. Using the best model, we established a nomogram model to predict difficult weaning from mechanical ventilation among patients admitted to ICU. The complete case analysis was used to deal with the missing data.

All statistical analyses were performed using SAS software (version 9.4, SAS Institute, Inc, Cary, NC, USA), with a statistically significant level (two-sided) of 0.05.

None.

Among 1365 initially screened patients, 703 patients aged 56–79 (median: 69) years with 63.02% males (n=443) were included in this study (table 1). Of these patients, 584 with a median age of 67 (range: 55–77) years were successfully weaned, and 119 with a median age of 74 (range: 64–82) years experienced difficult weaning from mechanical ventilation. Those with difficult weaning were more likely to be older; have respiratory, neurological or kidney diseases; have higher Charlson comorbidity index, SOFA, SAPS II and APACHE II scores; and have lower GCS scores (all P values <0.05).

Table 1

Baseline characteristics of patients

At the time of ICU admission, patients in the difficult group exhibited more severe organ dysfunction, higher BNP levels and lower EF% than those in the success group (table 2). The D-dimer, AST, globulin, LDH and BNP levels were significantly higher in the difficult group than in the success group (all P values <0.05). The EF% was significantly lower in the difficult group than in the success group (p<0.001). Within 24 hours before weaning, the levels of ALB, prealbumin, BUN, HCO3, BE and BNP as well as lung injury score, RR, mechanical ventilation time, invasive mechanical ventilation time, EF% and fluid balance all showed statistically significant differences between the difficult and success groups (all P values <0.05). The difficult group had more severe organ dysfunction, poorer nutritional status, higher 24 hours fluid balance and longer mechanical ventilation and invasive mechanical ventilation times. Within 72 hours before weaning, significant differences in PCT, GCS score, SBT mode and reintubation rate were observed between the difficult and success groups (all P values <0.05). Patients who were difficult to wean from mechanical ventilation showed higher infection indicators, lower GCS scores, lower usage of CPAP mode during SBT and higher reintubation rates.

Table 2

The characteristics of patients in different stages in hospital

The univariate analysis screened all 42 factors at baseline, ICU admission, 24 hours before weaning and 72 hours before weaning; 22 factors were selected (p≤0.10) for further multivariate analysis (table 3). After stepwise selection, the EF% at ICU admission; lung injury score, BNP at 24 hours, 24 hours fluid balance and dexmedetomidine use within 24 hours before weaning; and SBT and endotracheal tube reinsertion within 72 hours before weaning were selected as independent risk factors for difficult weaning from mechanical ventilation in patients admitted to the ICU (all P values <0.05).

Table 3

Risk factors of difficult weaning of the mechanical ventilation in patients in ICU

Based on the results of variable selection and clinical experience, we established four predictive models (figure 1). Model one comprised EF% at ICU admission, lung injury score, BNP-24 h, 24 hours fluid balance, use of dexmedetomidine, SBT (CPAP vs other), and endotracheal tube reinsertion. Model two included EF% at ICU admission, lung injury score, BNP-24 h, 24 hours fluid balance, SBT (CPAP vs other), and endotracheal tube reinsertion. Model three consisted of lung injury score, BNP-24 h, 24 hours fluid balance, use of dexmedetomidine, SBT (CPAP vs other), and endotracheal tube reinsertion. Model four comprised lung injury score, BNP-24 h, 24 hours fluid balance, SBT (CPAP vs other), and endotracheal tube reinsertion. The corresponding AUCs of the four models were 0.8905 (95% CI: 0.8398, 0.9411), 0.8722 (0.8123, 0.9322), 0.8888 (0.8382, 0.9394), and 0.8735 (0.8143, 0.9327). Compared with model one (full model), only model two was not significantly different (p=0.6822), exhibiting both fewer variables and good predictive value. The highest sensitivity, specificity, PPV, NPV, accuracy, LR+, and LR− were 0.7559 (0.7031, 0.8087), 0.875 (0.7725, 0.9775), 0.9746 (0.9527, 0.9966), 0.3608 (0.2653, 0.4564), 0.7721 (0.7242, 0.8201), 6.0743 (1.0711, 11.0234), and 0.279 (0.2103, 0.3476), respectively (table 4). Finally, we established a nomogram model based on model 3 (figure 2).

Table 4

Estimated parameters and 95% CI for the final model

Figure 1

Figure 1

Receiver operating characteristic curves of four predictive models for difficult weaning from mechanical ventilation. Model 1: EF% at ICU admission, lung injury score, BNP-24 h, 24 hours fluid balance, use of dexmedetomidine, SBT (CPAP vs other) and endotracheal tube reinsertion. Model 2: EF% at ICU admission, lung injury score, BNP-24 h, 24 hours fluid balance, SBT (CPAP vs other) and endotracheal tube reinsertion. Model 3: Lung injury score, BNP-24 h, 24 hours fluid balance, use of dexmedetomidine, SBT (CPAP vs other), and endotracheal tube reinsertion. Model 4: Lung injury score, BNP-24 h, 24 hours fluid balance, SBT (CPAP vs other), and endotracheal tube reinsertion. The final model was model 3.

In this retrospective study, we analysed 42 factors at different time points (baseline, ICU admission, 24 hours and 72 hours before weaning) and established a six-factor predictive model for difficult to wean from mechanical ventilation in ICU patients. Our model, which included EF% at ICU admission, lung injury score, BNP-24 h, 24 hours fluid balance, SBT (CPAP vs other) mode and endotracheal tube reinsertion, demonstrated an AUC of 0.8722, with a sensitivity of 0.7559 and specificity of 0.875, suggesting good predictive performance.

Previous studies have attempted similar predictive models. A study based on body mass index at admission, occlusion pressure at 0.1 s (P0.1) and heart-rate analysis parameters (LF/HF; both measured before SBT), and heart rate during SBT (global performance 62%–83%) reported an AUC of 0.74.13 Machine learning models have also been used to predict ventilation duration, with key predictors including vasopressor use, pH, and SOFA score.14 Other studies have highlighted the significance of ABG variables, such as PaCO2 and PaO2, in predicting prolonged mechanical ventilation.15 Our model expands on prior work by incorporating a broader range of clinical parameters spanning the ICU course.

Lung injury is a critical factor influencing extubation outcomes in ICU patients. While previous studies have identified P/F ratio and alveolar-arterial oxygen difference as predictors of extubation failure,16 17 our model suggests that a higher lung injury score is a protective factor, potentially indicating closer monitoring and intervention in these patients.

BNP-24 h has been widely recognised as a predictor of extubation failure, particularly in patients with cardiovascular dysfunction.18 19 BNP and N-terminal prohormone BNP (NT-proBNP) levels reflect ventricular stress and correlate with weaning failure due to cardiac dysfunction. Studies have shown that BNP levels increase during heart failure and decrease with diuresis, making it a valuable biomarker for predicting extubation outcomes.20–22 Notably, changes in BNP levels before and after SBT can indicate cardiac stress responses, further influencing weaning outcomes.

Fluid balance is another significant factor in predicting weaning outcomes. Specifically, a more positive 24 hours fluid balance before weaning has been linked to extubation failure.23 However, cumulative fluid balance since admission may have an even higher impact on predicting wean outcomes.24 Moreover, studies suggest that achieving a negative fluid balance (NFB) is beneficial for weaning success, though excessive fluid removal does not necessarily improve wean outcomes.25 Another study revealed that patients with a cumulative NFB are more likely to be successfully weaned than those with positive cumulative balance.26 These findings underscore the importance of carefully managing fluid status before weaning.

SBT parameters also play a crucial role in wean success. High RSBI, positive fluid balance and pneumonia-related mechanical ventilation have been linked to extubation failure following a successful SBT.27 The duration and mode of SBT are significant considerations, with studies showing that shorter, less demanding trials (eg, 30 min of pressure support ventilation) may improve weaning success compared with more prolonged T-piece trials.28 Current predictive models for extubation failure within the first 24 hours post-extubation have an accuracy of approximately 70%, emphasising the complexity of predicting weaning outcomes.29

Endotracheal tube reinsertion is a crucial indicator of extubation failure, occurring in up to 20% of ICU patients after failed extubation attempts.30 Factors such as cuff leak tests have been explored as predictors of extubation failure, but current assessment methods remain imprecise.31 Strategies such as using a supraglottic device or tube exchanger may mitigate the risks associated with failed extubations, emphasising the need for improved predictive tools in ICU settings.31

Although EF% is not widely reported as a direct predictor for extubation failure in ICU patients, various studies have identified predictors such as prolonged mechanical ventilation, advanced age and secretion burden as key contributors to weaning difficulties.32 33 EF% should be considered alongside other clinical variables when assessing weaning readiness.

This study systematically evaluated 10 baseline factors, seven ICU admission factors, 18 factors within 24 hours before weaning and seven within 72 hours before weaning, leading to the development of a six-factor nomogram model for predicting extubation failure from mechanical ventilation in ICU patients. However, several limitations must be acknowledged. The retrospective nature of the study may introduce potential biases and limit the ability to establish causality between the identified factors and wean outcomes. The study’s findings are based on data from a single country, which might limit the applicability of the results to different populations and healthcare systems globally. Validation of the predictive model in prospective studies and diverse patient populations is necessary to confirm its utility and accuracy in broader clinical practice.

We established a model comprising six factors (AUC of 0.8722) to predict difficult weaning from mechanical ventilation in ICU patients. The highest sensitivity and specificity were 0.7559 and 0.875, respectively. However, well-designed studies are warranted to determine whether the model can be extended to other populations.

Data are available upon reasonable request.

Not applicable.

Read the full text or download the PDF: