Abstract
Safe deployment of machine learning (ML) models in safety-critical domainssuch as medical imaging requires detecting inputs with characteristics not seenduring training, known as out-of-distribution (OOD) detection, to preventunreliable predictions. Effective OOD detection after deployment could benefitfrom access to the training data, enabling direct comparison between testsamples and the training data distribution to identify differences.State-of-the-art OOD detection methods, however, either discard training dataafter deployment or assume that test samples and training data are centrallystored together, an assumption that rarely holds in real-world settings. Thisis because shipping training data with the deployed model is usually impossibledue to the size of training databases, as well as proprietary or privacyconstraints. We introduce the Isolation Network, an OOD detection frameworkthat quantifies the difficulty of separating a target test sample from thetraining data by solving a binary classification task. We then proposeDecentralized Isolation Networks (DIsoN), which enables the comparison oftraining and test data when data-sharing is impossible, by exchanging onlymodel parameters between the remote computational nodes of training anddeployment. We further extend DIsoN with class-conditioning, comparing a targetsample solely with training data of its predicted class. We evaluate DIsoN onfour medical imaging datasets (dermatology, chest X-ray, breast ultrasound,histopathology) across 12 OOD detection tasks. DIsoN performs favorably againstexisting methods while respecting data-privacy. This decentralized OODdetection framework opens the way for a new type of service that ML developerscould provide along with their models: providing remote, secure utilization oftheir training data for OOD detection services. Code will be available uponacceptance at: *****