Abstract
We present a novel framework, i.e., Segment Any Anomaly + (SAA+), forzero-shot anomaly segmentation with hybrid prompt regularization to improve theadaptability of modern foundation models. Existing anomaly segmentation modelstypically rely on domain-specific fine-tuning, limiting their generalizationacross countless anomaly patterns. In this work, inspired by the greatzero-shot generalization ability of foundation models like Segment Anything, wefirst explore their assembly to leverage diverse multi-modal prior knowledgefor anomaly localization. For non-parameter foundation model adaptation toanomaly segmentation, we further introduce hybrid prompts derived from domainexpert knowledge and target image context as regularization. Our proposed SAA+model achieves state-of-the-art performance on several anomaly segmentationbenchmarks, including VisA, MVTec-AD, MTD, and KSDD2, in the zero-shot setting.We will release the code at\href{https://github.com/caoyunkang/Segment-Any-Anomaly}{https://github.com/caoyunkang/Segment-Any-Anomaly}.