We investigate the applicability of machine learning technologies to thedevelopment of parsimonious, interpretable, catchment-scale hydrologic modelsusing directed-graph architectures based on the mass-conserving perceptron(MCP) as the fundamental computational unit. Here, we focus on architecturalcomplexity (depth) at a single location, rather than universal applicability(breadth) across large samples of catchments. The goal is to discover a minimalrepresentation (numbers of cell-states and flow paths) that represents thedominant processes that can explain the input-state-output behaviors of a givencatchment, with particular emphasis given to simulating the full range (high,medium, and low) of flow dynamics. We find that a HyMod-like architecture withthree cell-states and two major flow pathways achieves such a representation atour study location, but that the additional incorporation of an input-bypassmechanism significantly improves the timing and shape of the hydrograph, whilethe inclusion of bi-directional groundwater mass exchanges significantlyenhances the simulation of baseflow. Overall, our results demonstrate theimportance of using multiple diagnostic metrics for model evaluation, whilehighlighting the need for designing training metrics that are better suited toextracting information across the full range of flow dynamics. Further, theyset the stage for interpretable regional-scale MCP-based hydrological modeling(using large sample data) by using neural architecture search to determineappropriate minimal representations for catchments in different hydroclimaticregimes.