The comprehension of environmental traffic situation largely ensures thedriving safety of autonomous vehicles. Recently, the mission has beeninvestigated by plenty of researches, while it is hard to be well addressed dueto the limitation of collective influence in complex scenarios. Theseapproaches model the interactions through the spatial relations between thetarget obstacle and its neighbors. However, they oversimplify the challengesince the training stage of the interactions lacks effective supervision. As aresult, these models are far from promising. More intuitively, we transform theproblem into calculating the interaction-aware drivable spaces and propose theCNN-based VisionNet for trajectory prediction. The VisionNet accepts a sequenceof motion states, i.e., location, velocity, and acceleration, to estimate thefuture drivable spaces. The reified interactions significantly increase theinterpretation ability of the VisionNet and refine the prediction. To furtheradvance the performance, we propose an interactive loss to guide the generationof the drivable spaces. Experiments on multiple public datasets demonstrate theeffectiveness of the proposed VisionNet.