Abstract
We describe an approach for incorporating prior knowledge into machinelearning algorithms. We aim at applications in physics and signal processing inwhich we know that certain operations must be embedded into the algorithm. Anyoperation that allows computation of a gradient or sub-gradient towards itsinputs is suited for our framework. We derive a maximal error bound for deepnets that demonstrates that inclusion of prior knowledge results in itsreduction. Furthermore, we also show experimentally that known operators reducethe number of free parameters. We apply this approach to various tasks rangingfrom CT image reconstruction over vessel segmentation to the derivation ofpreviously unknown imaging algorithms. As such the concept is widely applicablefor many researchers in physics, imaging, and signal processing. We assume thatour analysis will support further investigation of known operators in otherfields of physics, imaging, and signal processing.