Abstract
Recent advances in deep learning have made it possible to quantify urbanmetrics at fine resolution, and over large extents using street-level images.Here, we focus on measuring urban tree cover using Google Street View (GSV)images. First, we provide a small-scale labelled validation dataset and proposestandard metrics to compare the performance of automated estimations of streettree cover using GSV. We apply state-of-the-art deep learning models, andcompare their performance to a previously established benchmark of anunsupervised method. Our training procedure for deep learning models is novel;we utilize the abundance of openly available and similarly labelledstreet-level image datasets to pre-train our model. We then perform additionaltraining on a small training dataset consisting of GSV images. We find thatdeep learning models significantly outperform the unsupervised benchmarkmethod. Our semantic segmentation model increased mean intersection-over-union(IoU) from 44.10% to 60.42% relative to the unsupervised method and ourend-to-end model decreased Mean Absolute Error from 10.04% to 4.67%. We alsoemploy a recently developed method called gradient-weighted class activationmap (Grad-CAM) to interpret the features learned by the end-to-end model. Thistechnique confirms that the end-to-end model has accurately learned to identifytree cover area as key features for predicting percentage tree cover. Our paperprovides an example of applying advanced deep learning techniques on alarge-scale, geo-tagged and image-based dataset to efficiently estimateimportant urban metrics. The results demonstrate that deep learning models arehighly accurate, can be interpretable, and can also be efficient in terms ofdata-labelling effort and computational resources.