Abstract
Depending on the application, radiological diagnoses can be associated withhigh inter- and intra-rater variabilities. Most computer-aided diagnosis (CAD)solutions treat such data as incontrovertible, exposing learning algorithms toconsiderable and possibly contradictory label noise and biases. Thus, managingsubjectivity in labels is a fundamental problem in medical imaging analysis. Toaddress this challenge, we introduce auto-decoded deep latent embeddings(ADDLE), which explicitly models the tendencies of each rater using anauto-decoder framework. After a simple linear transformation, the latentvariables can be injected into any backbone at any and multiple points,allowing the model to account for rater-specific effects on the diagnosis.Importantly, ADDLE does not expect multiple raters per image in training,meaning it can readily learn from data mined from hospital archives. Moreover,the complexity of training ADDLE does not increase as more raters are added.During inference each rater can be simulated and a 'mean' or 'greedy' virtualrating can be produced. We test ADDLE on the problem of liver steatosisdiagnosis from 2D ultrasound (US) by collecting 46 084 studies along withclinical US diagnoses originating from 65 different raters. We evaluateddiagnostic performance using a separate dataset with gold-standard biopsydiagnoses. ADDLE can improve the partial areas under the curve (AUCs) fordiagnosing severe steatosis by 10.5% over standard classifiers whileoutperforming other annotator-noise approaches, including those requiring 65times the parameters.