Abstract
In real-world machine learning deployments, models must be continuallyupdated, composed, and when required, selectively undone. However, existingapproaches to model merging and continual learning often suffer from taskinterference, catastrophic forgetting, or lack of reversibility. We proposeModular Delta Merging with Orthogonal Constraints (MDM-OC), a novel frameworkthat enables scalable, interference-free, and reversible composition offine-tuned models. Each task-specific model is encoded as a delta from a sharedbase and projected into an orthogonal subspace to eliminate conflict. Theseprojected deltas are then merged via gradient-based optimization to form aunified model that retains performance across tasks. Our approach supportscontinual integration of new models, structured unmerging for compliance suchas GDPR requirements, and model stability via elastic weight consolidation andsynthetic replay. Extensive experiments on vision and natural languageprocessing benchmarks demonstrate that MDM-OC outperforms prior baselines inaccuracy, backward transfer, and unmerge fidelity, while remainingmemory-efficient and computationally tractable. This framework offers aprincipled solution for modular and compliant AI system design.