Deep-learning-based smartphone application for self-diagnosis of scleral jaundice in patients with hepatobiliary and pancreatic diseases

Abstract

Outpatient detection of total bilirubin levels should be performed regularly to monitor the recurrence of jaundice in hepatobiliary and pancreatic disease patients. However, frequent hospital visits for blood testing are burdensome for patients with poor medical conditions. This study validates a novel deep-learning-based smartphone application for the self-diagnosis of scleral jaundice in such patients. The system predicts total serum bilirubin levels using the deep-learning-based regression analysis of scleral photos taken by the smartphone’s built-in camera. Enrolled patients were randomly assigned to either the training cohort (n = 90, 1034 photos) or the valida-tion cohort (n = 40, 426 photos). The intraclass correlation coefficient value for predicted serum total bilirubin (PSB) derived from the images repeatedly taken at the same time for the same patient showed good reliability (0.86). A strong correlation between measured serum total bilirubin (MSB) and PSB was observed in the subgroup with MSB levels ≥1.5 mg/dL (Spearman rho = 0.70, p < 0.001). The receiver operating characteristic curve for PSB showed that the area under the curve was 0.93, demonstrating good test performance as a predictor of hyperbilirubinemia (p < 0.001). Using a cut-off PSB ≥1.5, the prediction sensitivity of hyperbilirubinemia was 80.0%, with a specificity of 92.6%. Hence, the tool is effective for patient monitoring.