Abstract
Physics-informed machine learning (PIML) as a means of solving partialdifferential equations (PDE) has garnered much attention in the ComputationalScience and Engineering (CS&E) world. This topic encompasses a broad array ofmethods and models aimed at solving a single or a collection of PDE problems,called multitask learning. PIML is characterized by the incorporation ofphysical laws into the training process of machine learning models in lieu oflarge data when solving PDE problems. Despite the overall success of thiscollection of methods, it remains incredibly difficult to analyze, benchmark,and generally compare one approach to another. Using Kolmogorov n-widths as ameasure of effectiveness of approximating functions, we judiciously apply thismetric in the comparison of various multitask PIML architectures. We computelower accuracy bounds and analyze the model's learned basis functions onvarious PDE problems. This is the first objective metric for comparingmultitask PIML architectures and helps remove uncertainty in model validationfrom selective sampling and overfitting. We also identify avenues ofimprovement for model architectures, such as the choice of activation function,which can drastically affect model generalization to "worst-case" scenarios,which is not observed when reporting task-specific errors. We also incorporatethis metric into the optimization process through regularization, whichimproves the models' generalizability over the multitask PDE problem.