Centre dedocumentation
scientifique

Hyperspectral image fusion and multitemporal image fusion by joint sparsity / Han Pan in IEEE Transactions on geoscience and remote sensing, Vol 59 n° 9 (September 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > Vol 59 n° 9 (September 2021) . - pp 7887 - 7900 Titre : Hyperspectral image fusion and multitemporal image fusion by joint sparsity Type de document : Article/Communication Auteurs : Han Pan, Auteur ; Zhongliang Jing, Auteur ; Henry Leung, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 7887 - 7900 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] correction d'image [Termes IGN] flou [Termes IGN] fusion d'images [Termes IGN] image hyperspectrale [Termes IGN] image multitemporelle [Termes IGN] image panchromatique [Termes IGN] pansharpening (fusion d'images) [Termes IGN] représentation parcimonieuse Résumé : (auteur) Different image fusion systems have been developed to deal with the massive amounts of image data for different applications, such as remote sensing, computer vision, and environment monitoring. However, the generalizability and versatility of these fusion systems remain unknown. This article proposes an efficient regularization framework to achieve different kinds of fusion tasks accounting for the spatiospectral and spatiotemporal variabilities of the fusion process. A joint minimization functional is developed by taking an advantage of a composite regularizer for enforcing joint sparsity in the gradient domain and the frame domain. The proposed composite regularizer is composed of the Hessian Schatten-norm regularization and contourlet-based regularization terms. The resulting problems are solved by the alternating direction method of multipliers (ADMM). The effectiveness of the proposed method is validated in a variety of image fusion experiments: 1) hyperspectral (HS) and panchromatic image fusion; 2) HS and multispectral image fusion; 3) multitemporal image fusion (MIF); and 4) multi-image deblurring. Results show promising performance compared with state-of-the-art fusion methods. Numéro de notice : A2021-649 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3039046 date de publication en ligne : 07/12/2020 En ligne : https://doi.org/10.1109/TGRS.2020.3039046 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98360 [article]

Detail injection-based deep convolutional neural networks for pansharpening / Liang-Jian Deng in IEEE Transactions on geoscience and remote sensing, vol 59 n° 8 (August 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 59 n° 8 (August 2021) . - pp 6995 - 7010 Titre : Detail injection-based deep convolutional neural networks for pansharpening Type de document : Article/Communication Auteurs : Liang-Jian Deng, Auteur ; Gemine Vivone, Auteur ; Cheng Jin, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 6995 - 7010 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] analyse multirésolution [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] image à basse résolution [Termes IGN] image multibande [Termes IGN] image panchromatique [Termes IGN] injection d'image [Termes IGN] modèle non linéaire [Termes IGN] pansharpening (fusion d'images) Résumé : (auteur) The fusion of high spatial resolution panchromatic (PAN) data with simultaneously acquired multispectral (MS) data with the lower spatial resolution is a hot topic, which is often called pansharpening. In this article, we exploit the combination of machine learning techniques and fusion schemes introduced to address the pansharpening problem. In particular, deep convolutional neural networks (DCNNs) are proposed to solve this issue. The latter is combined first with the traditional component substitution and multiresolution analysis fusion schemes in order to estimate the nonlinear injection models that rule the combination of the upsampled low-resolution MS image with the extracted details exploiting the two philosophies. Furthermore, inspired by these two approaches, we also developed another DCNN for pansharpening. This is fed by the direct difference between the PAN image and the upsampled low-resolution MS image. Extensive experiments conducted both at reduced and full resolutions demonstrate that this latter convolutional neural network outperforms both the other detail injection-based proposals and several state-of-the-art pansharpening methods. Numéro de notice : A2021-639 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3031366 En ligne : https://doi.org/10.1109/TGRS.2020.3031366 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98293 [article]

Unsupervised pansharpening based on self-attention mechanism / Ying Qu in IEEE Transactions on geoscience and remote sensing, vol 59 n° 4 (April 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 59 n° 4 (April 2021) . - pp 3192 - 3208 Titre : Unsupervised pansharpening based on self-attention mechanism Type de document : Article/Communication Auteurs : Ying Qu, Auteur ; Razieh Kaviani Baghbaderani, Auteur ; Hairong Qi, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 3192 - 3208 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification non dirigée [Termes IGN] image multibande [Termes IGN] pansharpening (fusion d'images) [Termes IGN] pouvoir de résolution géométrique [Termes IGN] précision infrapixellaire [Termes IGN] reconstruction d'image [Termes IGN] segmentation d'image Résumé : (auteur) Pansharpening is to fuse a multispectral image (MSI) of low-spatial-resolution (LR) but rich spectral characteristics with a panchromatic image (PAN) of high spatial resolution (HR) but poor spectral characteristics. Traditional methods usually inject the extracted high-frequency details from PAN into the upsampled MSI. Recent deep learning endeavors are mostly supervised assuming that the HR MSI is available, which is unrealistic especially for satellite images. Nonetheless, these methods could not fully exploit the rich spectral characteristics in the MSI. Due to the wide existence of mixed pixels in satellite images where each pixel tends to cover more than one constituent material, pansharpening at the subpixel level becomes essential. In this article, we propose an unsupervised pansharpening (UP) method in a deep-learning framework to address the abovementioned challenges based on the self-attention mechanism (SAM), referred to as UP-SAM. The contribution of this article is threefold. First, the SAM is proposed where the spatial varying detail extraction and injection functions are estimated according to the attention representations indicating spectral characteristics of the MSI with subpixel accuracy. Second, such attention representations are derived from mixed pixels with the proposed stacked attention network powered with a stick-breaking structure to meet the physical constraints of mixed pixel formulations. Third, the detail extraction and injection functions are spatial varying based on the attention representations, which largely improves the reconstruction accuracy. Extensive experimental results demonstrate that the proposed approach is able to reconstruct sharper MSI of different types, with more details and less spectral distortion compared with the state-of-the-art. Numéro de notice : A2021-285 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3009207 date de publication en ligne : 23/07/2020 En ligne : https://doi.org/10.1109/TGRS.2020.3009207 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97394 [article]

Pan-sharpening via multiscale dynamic convolutional neural network / Jianwen Hu in IEEE Transactions on geoscience and remote sensing, Vol 59 n° 3 (March 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > Vol 59 n° 3 (March 2021) . - pp 2231 - 2244 Titre : Pan-sharpening via multiscale dynamic convolutional neural network Type de document : Article/Communication Auteurs : Jianwen Hu, Auteur ; Pei Hu, Auteur ; Xudong Kang, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 2231 - 2244 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] données multiéchelles [Termes IGN] image Geoeye [Termes IGN] image multibande [Termes IGN] image panchromatique [Termes IGN] image Quickbird [Termes IGN] image Worldview [Termes IGN] pansharpening (fusion d'images) [Termes IGN] reconstruction d'image Résumé : (Auteur) Pan-sharpening is an effective method to obtain high-resolution multispectral images by fusing panchromatic (PAN) images with fine spatial structure and low-resolution multispectral images with rich spectral information. In this article, a multiscale pan-sharpening method based on dynamic convolutional neural network is proposed. The filters in dynamic convolution are generated dynamically and locally by the filter generation network which is different from the standard convolution and strengthens the adaptivity of the network. The dynamic filters are adaptively changed according to the input images. The proposed multiscale dynamic convolutions extract detail feature of PAN image at different scales. Multiscale network structure is beneficial to obtain effective detail features. The weights obtained by the weight generation network are used to adjust the relationship among the detail features in each scale. The GeoEye-1, QuickBird, and WorldView-3 data are used to evaluate the performance of the proposed method. Compared with the widely used state-of-the-art pan-sharpening approaches, the experimental results demonstrate the superiority of the proposed method in terms of both objective quality indexes and visual performance. Numéro de notice : A2021-216 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3007884 date de publication en ligne : 16/07/2020 En ligne : https://doi.org/10.1109/TGRS.2020.3007884 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97206 [article]

GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening / Hao Zhang in ISPRS Journal of photogrammetry and remote sensing, vol 172 (February 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 172 (February 2021) . - pp 223 - 239 Titre : GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening Type de document : Article/Communication Auteurs : Hao Zhang, Auteur ; Jiayi Ma, Auteur Année de publication : 2021 Article en page(s) : pp 223 - 239 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification dirigée [Termes IGN] fusion d'images [Termes IGN] gradient [Termes IGN] image multibande [Termes IGN] image panchromatique [Termes IGN] Normalized Difference Vegetation Index [Termes IGN] pansharpening (fusion d'images) [Termes IGN] régression Résumé : (auteur) Pansharpening aims to fuse low-resolution multi-spectral image and high-resolution panchromatic (PAN) image to produce a high-resolution multi-spectral (HRMS) image. In this paper, a new residual learning network based on gradient transformation prior, termed as GTP-PNet, is proposed to generate the high-quality HRMS image with accurate spectral distribution as well as reasonable spatial structure. Different from previous deep models that only rely on supervision of the HRMS reference image, we introduce the gradient transformation prior to the deep model, so as to improve the solution accuracy. Our model consists of two networks, namely gradient transformation network (TNet) and pansharpening network (PNet). TNet is committed to seeking the nonlinear mapping between gradients of PAN and HRMS images, which is essentially a spatial relationship regression of imaging bands in different ranges. PNet is the residual learning network used to generate the HRMS image, which is not only supervised by the HRMS reference image, but also constrained by the trained TNet. As a result, the HRMS image generated by PNet not only approximates the HRMS reference image in the spectral distribution, but also conforms to the gradient transformation prior in the spatial structure. Experimental results demonstrate the significant superiority of our method over the current state-of-the-arts in terms of both subjective visual effect and quantitative metrics. We also apply our method to produce the HR normalized difference vegetation index in remote sensing, which can achieve the best performance. Moreover, our method is much competitive compared with the state-of-the-art alternatives in running efficiency. Numéro de notice : A2021-089 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2020.12.014 date de publication en ligne : 11/01/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2020.12.014 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=96859 [article]

Réservation

Réserver ce document

Exemplaires (2)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2021021	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2021022	DEP-RECF	Revue	Nancy	Bibliothèque Nancy IFN	Disponible

A review of image fusion techniques for pan-sharpening of high-resolution satellite imagery / Farzaneh Dadrass Javan in ISPRS Journal of photogrammetry and remote sensing, vol 171 (January 2021)  

Permalink

fusionImage: An R package for pan‐sharpening images in open source software / Fulgencio Cánovas‐García in Transactions in GIS, Vol 24 n° 5 (October 2020)  

Permalink

Comparison of tree-based classification algorithms in mapping burned forest areas / Dilek Kucuk Matci in Geodetski vestnik, vol 64 n° 3 (September - November 2020)  

Permalink

Pansharpening: context-based generalized Laplacian pyramids by robust regression / Gemine Vivone in IEEE Transactions on geoscience and remote sensing, vol 58 n° 9 (September 2020)  

Permalink

Tree species classification in tropical forests using visible to shortwave infrared WorldView-3 images and texture analysis / Matheus Pinheiro Ferreira in ISPRS Journal of photogrammetry and remote sensing, vol 149 (March 2019)  

Permalink

Synergetic efficiency of Lidar and WorldView-2 for 3D urban cartography in Northeast Mexico / Fabiola D. Yepez-Rincon in Geocarto international, vol 34 n° 2 ([01/02/2019])  

Permalink

Super-resolution of Sentinel-2 images : Learning a globally applicable deep neural network / Charis Lanaras in ISPRS Journal of photogrammetry and remote sensing, vol 146 (December 2018)  

Permalink

Pan-sharpening via deep metric learning / Yinghui Xing in ISPRS Journal of photogrammetry and remote sensing, vol 145 - part A (November 2018)  

Permalink

Sensitivity analysis of pansharpening in hyperspectral change detection / Seyd Teymoor Seydi in Applied geomatics, vol 10 n° 1 (March 2018)  

Permalink

Intersensor statistical matching for pansharpening : theoretical issues and practical solutions / Luciano Alparone in IEEE Transactions on geoscience and remote sensing, vol 55 n° 8 (August 2017)  

Permalink