A Machine Learning Algorithm to Estimate the Probability of a True Scaphoid Fracture After Wrist Trauma

• DOI: 10.1016/j.jhsa.2022.02.023
• Publication Date: 2022-06-03T21:07:35Z
• Authors: Anne Eva J. Bulstra; Geert A. Buijze; Anne Eva J. Bulstra; Abigail Cohen; Joost W. Colaris; Charles M. Court-...; Job N. Doornberg; Andrew D. Duckworth; J. Carel Goslings; Alasdair Gray; Laurent A.M. Hend...; Ruurd L. Jaarsma; Wouter H. Mallee; Marjolein A.M. Mu...; Margaret M. McQueen; Matthew Moran; Miryam C. Obdeijn; Gino M.M.J. Kerkh...; David Ring; Niels W.L. Schep; Monique M.J. Wale...
• Keywords: Scaphoid Bone; Hand Injuries; Pain; Wrist; Wrist Injuries; Magnetic Resonance Imaging; 3. Good health; Machine Learning; Fractures, Bone; 03 medical and health sciences; 0302 clinical medicine; Humans; Prospective Studies; Tomography, X-Ray Computed; Algorithms; Probability

To identify predictors of a true scaphoid fracture among patients with radial wrist pain following acute trauma, train 5 machine learning (ML) algorithms in predicting scaphoid fracture probability, and design a decision rule to initiate advanced imaging in high-risk patients.Two prospective cohorts including 422 patients with radial wrist pain following wrist trauma were combined. There were 117 scaphoid fractures (28%) confirmed on computed tomography, magnetic resonance imaging, or radiographs. Eighteen fractures (15%) were occult. Predictors of a scaphoid fracture were identified among demographics, mechanism of injury and examination maneuvers. Five ML-algorithms were trained in calculating scaphoid fracture probability. ML-algorithms were assessed on ability to discriminate between patients with and without a fracture (area under the receiver operating characteristic curve), agreement between observed and predicted probabilities (calibration), and overall performance (Brier score). The best performing ML-algorithm was incorporated into a probability calculator. A decision rule was proposed to initiate advanced imaging among patients with negative radiographs.Pain over the scaphoid on ulnar deviation, sex, age, and mechanism of injury were most strongly associated with a true scaphoid fracture. The best performing ML-algorithm yielded an area under the receiver operating characteristic curve, calibration slope, intercept, and Brier score of 0.77, 0.84, -0.01 and 0.159, respectively. The ML-derived decision rule proposes to initiate advanced imaging in patients with radial-sided wrist pain, negative radiographs, and a fracture probability of ≥10%. When applied to our cohort, this would yield 100% sensitivity, 38% specificity, and would have reduced the number of patients undergoing advanced imaging by 36% without missing a fracture.The ML-algorithm accurately calculated scaphoid fracture probability based on scaphoid pain on ulnar deviation, sex, age, and mechanism of injury. The ML-decision rule may reduce the number of patients undergoing advanced imaging by a third with a small risk of missing a fracture. External validation is required before implementation.Diagnostic II.