Abstract
Recent advancements in machine learning have improved performance while alsoincreasing computational demands. While federated and distributed setupsaddress these issues, their structure is vulnerable to malicious influences. Inthis paper, we address a specific threat, Byzantine attacks, where compromisedclients inject adversarial updates to derail global convergence. We combine thetrust scores concept with trial function methodology to dynamically filteroutliers. Our methods address the critical limitations of previous approaches,allowing functionality even when Byzantine nodes are in the majority. Moreover,our algorithms adapt to widely used scaled methods like Adam and RMSProp, aswell as practical scenarios, including local training and partialparticipation. We validate the robustness of our methods by conductingextensive experiments on both synthetic and real ECG data collected frommedical institutions. Furthermore, we provide a broad theoretical analysis ofour algorithms and their extensions to aforementioned practical setups. Theconvergence guarantees of our methods are comparable to those of classicalalgorithms developed without Byzantine interference.