文献类型：期刊文献

英文题名：DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image

作者：Lin, Cong[1];Mao, Xin[1];Qiu, Chenghao[2];Zou, Lilan[1]

机构：[1]Guangdong Ocean Univ, Sch Elect & Informat Engn, Zhanjiang 524088, Peoples R China;[2]Univ Elect Sci & Technol China, Sch Life Sci & Technol, Chengdu 610000, Peoples R China

年份：2024

卷号：17

起止页码：11117

外文期刊名：IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING

收录：SCI-EXPANDED(收录号：WOS:001251173200015)、、EI(收录号：20242416236463)、Scopus(收录号：2-s2.0-85195394148)、WOS

基金：No Statement Available

语种：英文

外文关键词：Remote sensing; Transformers; Image reconstruction; Knowledge engineering; Superresolution; Task analysis; Computational modeling; Gaofen satellite; knowledge distillation (KD); lightweight network; remote sensing image; super-resolution (SR)

外文摘要：Super-resolution reconstruction technology is a crucial approach to enhance the quality of remote sensing optical images. Currently, the mainstream reconstruction methods leverage convolutional neural networks (CNNs). However, they overlook the global information of the images, thereby impacting the reconstruction effectiveness. Methods based on Transformer networks have demonstrated the capability to improve reconstruction quality, but the high model complexity renders them unsuitable for remote sensing devices. To enhance reconstruction performance while maintaining the model lightweight, a distillation Transform-CNN Network is proposed in this article. The strategy employs the Transformer network as a teacher network, guiding its long-range features into a compact CNN, achieving distillation across networks. Simultaneously, to rectify misinformation in the teacher network, prior information is introduced to ensure accurate information transfer. Concerning the student network, a novel upsampling approach is devised, utilizing inherent information in downsampled feature maps for padding, thereby avoiding the introduction of zero-information feature points in the traditional deconvolution process. Experimental evaluations conducted on multiple publicly available remote sensing image datasets demonstrate that the proposed method, while maintaining a smaller parameter count, achieves outstanding reconstruction quality for remote sensing images, surpassing existing approaches.