Retinal vessel segmentation is an essential step for fundus image analysis.With the recent advances of deep learning technologies, many convolutionalneural networks have been applied in this field, including the successfulU-Net. In this work, we firstly modify the U-Net with functional blocks aimingto pursue higher performance. The absence of the expected performance boostthen lead us to dig into the opposite direction of shrinking the U-Net andexploring the extreme conditions such that its segmentation performance ismaintained. Experiment series to simplify the network structure, reduce thenetwork size and restrict the training conditions are designed. Results showthat for retinal vessel segmentation on DRIVE database, U-Net does notdegenerate until surprisingly acute conditions: one level, one filter inconvolutional layers, and one training sample. This experimental discovery isboth counter-intuitive and worthwhile. Not only are the extremes of the U-Netexplored on a well-studied application, but also one intriguing warning israised for the research methodology which seeks for marginal performanceenhancement regardless of the resource cost.