TY - JOUR
T1 - Applying artificial neural network for early detection of sepsis with intentionally preserved highly missing real-world data for simulating clinical situation
AU - Kuo, Yao Yi
AU - Huang, Shu Tien
AU - Chiu, Hung Wen
N1 - Funding Information:
This research was supported by Ministry of Science and Technology, Taiwan, R.O.C. under Grant Nos. MOST 109-2221-E-038-011 and MOST 110-2221-E-038-006.
Publisher Copyright:
© 2021, The Author(s).
PY - 2021/12
Y1 - 2021/12
N2 - Purpose: Some predictive systems using machine learning models have been developed to predict sepsis; however, they were mostly built with a low percent of missing values, which does not correspond with the actual clinical situation. In this study, we developed a machine learning model with a high rate of missing and erroneous data to enable prediction under missing, noisy, and erroneous inputs, as in the actual clinical situation. Materials and methods: The proposed artificial neural network model was implemented using the MATLAB ANN toolbox, based on stochastic gradient descent. The dataset was collected over the past decade with approval from the appropriate institutional review boards, and the sepsis status was identified and labeled using Sepsis-3 clinical criteria. The imputation method was built by last observation carried forward and mean value, aimed to simulate clinical situation. Results: The mean area under the receiver operating characteristic (ROC) curve (AUC) of classifying sepsis and nonsepsis patients was 0.82 and 0.786 at 0 h and 40 h prior to onset, respectively. The highest model performance was found for one-hourly data, demonstrating that our ANN model can perform adequately with limited hourly data provided. Conclusions: Our model has the moderate ability to predict sepsis up to 40 h in advance under simulated clinical situation with real-world data.
AB - Purpose: Some predictive systems using machine learning models have been developed to predict sepsis; however, they were mostly built with a low percent of missing values, which does not correspond with the actual clinical situation. In this study, we developed a machine learning model with a high rate of missing and erroneous data to enable prediction under missing, noisy, and erroneous inputs, as in the actual clinical situation. Materials and methods: The proposed artificial neural network model was implemented using the MATLAB ANN toolbox, based on stochastic gradient descent. The dataset was collected over the past decade with approval from the appropriate institutional review boards, and the sepsis status was identified and labeled using Sepsis-3 clinical criteria. The imputation method was built by last observation carried forward and mean value, aimed to simulate clinical situation. Results: The mean area under the receiver operating characteristic (ROC) curve (AUC) of classifying sepsis and nonsepsis patients was 0.82 and 0.786 at 0 h and 40 h prior to onset, respectively. The highest model performance was found for one-hourly data, demonstrating that our ANN model can perform adequately with limited hourly data provided. Conclusions: Our model has the moderate ability to predict sepsis up to 40 h in advance under simulated clinical situation with real-world data.
KW - Artificial intelligence
KW - Artificial neural network
KW - Machine learning
KW - Prediction
KW - Sepsis
UR - http://www.scopus.com/inward/record.url?scp=85117688552&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85117688552&partnerID=8YFLogxK
U2 - 10.1186/s12911-021-01653-0
DO - 10.1186/s12911-021-01653-0
M3 - Article
C2 - 34686163
AN - SCOPUS:85117688552
SN - 1472-6947
VL - 21
JO - BMC Medical Informatics and Decision Making
JF - BMC Medical Informatics and Decision Making
IS - 1
M1 - 290
ER -