Abstract
Deep learning-based algorithms have seen a massive popularity in differentareas of remote sensing image analysis over the past decade. Recently,transformers-based architectures, originally introduced in natural languageprocessing, have pervaded computer vision field where the self-attentionmechanism has been utilized as a replacement to the popular convolutionoperator for capturing long-range dependencies. Inspired by recent advances incomputer vision, remote sensing community has also witnessed an increasedexploration of vision transformers for a diverse set of tasks. Although anumber of surveys have focused on transformers in computer vision in general,to the best of our knowledge we are the first to present a systematic review ofrecent advances based on transformers in remote sensing. Our survey covers morethan 60 recent transformers-based methods for different remote sensing problemsin sub-areas of remote sensing: very high-resolution (VHR), hyperspectral (HSI)and synthetic aperture radar (SAR) imagery. We conclude the survey bydiscussing different challenges and open issues of transformers in remotesensing. Additionally, we intend to frequently update and maintain the latesttransformers in remote sensing papers with their respective code at:https://github.com/VIROBO-15/Transformer-in-Remote-Sensing