Centre dedocumentation
scientifique

A novel unmixing-based hypersharpening method via convolutional neural network / Xiaochen Lu in IEEE Transactions on geoscience and remote sensing, vol 60 n° 1 (January 2022)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 60 n° 1 (January 2022) . - n° 5503614 Titre : A novel unmixing-based hypersharpening method via convolutional neural network Type de document : Article/Communication Auteurs : Xiaochen Lu, Auteur ; Tong Li, Auteur ; Junping Zhang, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : n° 5503614 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] analyse des mélanges spectraux [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] fusion d'images [Termes IGN] image hyperspectrale [Termes IGN] image multibande [Termes IGN] pansharpening (fusion d'images) [Termes IGN] pouvoir de résolution géométrique [Termes IGN] pouvoir de résolution spectrale Résumé : (auteur) Hypersharpening (namely, hyperspectral (HS) and multispectral (MS) image fusion) aims at enhancing the spatial resolution of HS image via an auxiliary higher resolution MS image. Currently, numerous hypersharpening methods are proposed successively, among which the unmixing-based approaches have been widely researched and demonstrated their effectiveness in the spectral fidelity aspect. However, existing unmixing-based fusion methods substantially employ mathematical techniques to solve the spectral mixture model, without taking full advantage of the collaborative spatial–spectral information that is usually helpful for abundance estimation improvement. To overcome this drawback, in this article, a novel unmixing-based HS and MS image fusion method, via a convolutional neural network (CNN), is proposed to promote spectral fidelity. The main idea of this work is to use CNN to fully explore the spatial information and the spectral information of both HS and MS images simultaneously, thereby enhancing the accuracy of estimating the abundance maps. Experiments on four simulated and real remote sensing data sets demonstrate that the proposed method is beneficial to the spectral fidelity of the fused images compared with some state-of-the-art algorithms. Meanwhile, it is also easy to implement and has a certain advantage in running time. Numéro de notice : A2022-028 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2021.3063105 Date de publication en ligne : 22/03/2021 En ligne : https://doi.org/10.1109/TGRS.2021.3063105 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=99264 [article]

A novel method based on deep learning, GIS and geomatics software for building a 3D city model from VHR satellite stereo imagery / Massimiliano Pepe in ISPRS International journal of geo-information, vol 10 n° 10 (October 2021)  

Public [article]  inISPRS International journal of geo-information > vol 10 n° 10 (October 2021) . - n° 697 Titre : A novel method based on deep learning, GIS and geomatics software for building a 3D city model from VHR satellite stereo imagery Type de document : Article/Communication Auteurs : Massimiliano Pepe, Auteur ; Domenica Costantino, Auteur ; Vincenzo Saverio Alfio, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : n° 697 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] algorithme de Gram-Schmidt [Termes IGN] apprentissage profond [Termes IGN] ArcGIS [Termes IGN] détection du bâti [Termes IGN] empreinte [Termes IGN] hauteur du bâti [Termes IGN] image à très haute résolution [Termes IGN] image Worldview [Termes IGN] modèle 3D de l'espace urbain [Termes IGN] modèle numérique de surface [Termes IGN] Oman [Termes IGN] pansharpening (fusion d'images) [Termes IGN] reconnaissance automatique [Termes IGN] système d'information géographique Résumé : (auteur) The aim of the paper is to identify a suitable method for the construction of a 3D city model from stereo satellite imagery. In order to reach this goal, it is necessary to build a workflow consisting of three main steps: (1) Increasing the geometric resolution of the color images through the use of pan-sharpening techniques, (2) identification of the buildings’ footprint through deep-learning techniques and, finally, (3) building an algorithm in GIS (Geographic Information System) for the extraction of the elevation of buildings. The developed method was applied to stereo imagery acquired by WorldView-2 (WV-2), a commercial Earth-observation satellite. The comparison of the different pan-sharpening techniques showed that the Gram–Schmidt method provided better-quality color images than the other techniques examined; this result was deduced from both the visual analysis of the orthophotos and the analysis of quality indices (RMSE, RASE and ERGAS). Subsequently, a deep-learning technique was applied for pan sharpening an image in order to extract the footprint of buildings. Performance indices (precision, recall, overall accuracy and the F1measure) showed an elevated accuracy in automatic recognition of the buildings. Finally, starting from the Digital Surface Model (DSM) generated by satellite imagery, an algorithm built in the GIS environment allowed the extraction of the building height from the elevation model. In this way, it was possible to build a 3D city model where the buildings are represented as prismatic solids with flat roofs, in a fast and precise way. Numéro de notice : A2021-801 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE/IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.3390/ijgi10100697 Date de publication en ligne : 14/10/2021 En ligne : https://doi.org/10.3390/ijgi10100697 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98853 [article]

Hyperspectral image fusion and multitemporal image fusion by joint sparsity / Han Pan in IEEE Transactions on geoscience and remote sensing, Vol 59 n° 9 (September 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > Vol 59 n° 9 (September 2021) . - pp 7887 - 7900 Titre : Hyperspectral image fusion and multitemporal image fusion by joint sparsity Type de document : Article/Communication Auteurs : Han Pan, Auteur ; Zhongliang Jing, Auteur ; Henry Leung, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 7887 - 7900 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] correction d'image [Termes IGN] flou [Termes IGN] fusion d'images [Termes IGN] image hyperspectrale [Termes IGN] image multitemporelle [Termes IGN] image panchromatique [Termes IGN] pansharpening (fusion d'images) [Termes IGN] représentation parcimonieuse Résumé : (auteur) Different image fusion systems have been developed to deal with the massive amounts of image data for different applications, such as remote sensing, computer vision, and environment monitoring. However, the generalizability and versatility of these fusion systems remain unknown. This article proposes an efficient regularization framework to achieve different kinds of fusion tasks accounting for the spatiospectral and spatiotemporal variabilities of the fusion process. A joint minimization functional is developed by taking an advantage of a composite regularizer for enforcing joint sparsity in the gradient domain and the frame domain. The proposed composite regularizer is composed of the Hessian Schatten-norm regularization and contourlet-based regularization terms. The resulting problems are solved by the alternating direction method of multipliers (ADMM). The effectiveness of the proposed method is validated in a variety of image fusion experiments: 1) hyperspectral (HS) and panchromatic image fusion; 2) HS and multispectral image fusion; 3) multitemporal image fusion (MIF); and 4) multi-image deblurring. Results show promising performance compared with state-of-the-art fusion methods. Numéro de notice : A2021-649 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3039046 Date de publication en ligne : 07/12/2020 En ligne : https://doi.org/10.1109/TGRS.2020.3039046 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98360 [article]

Detail injection-based deep convolutional neural networks for pansharpening / Liang-Jian Deng in IEEE Transactions on geoscience and remote sensing, vol 59 n° 8 (August 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 59 n° 8 (August 2021) . - pp 6995 - 7010 Titre : Detail injection-based deep convolutional neural networks for pansharpening Type de document : Article/Communication Auteurs : Liang-Jian Deng, Auteur ; Gemine Vivone, Auteur ; Cheng Jin, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 6995 - 7010 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] analyse multirésolution [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] image à basse résolution [Termes IGN] image multibande [Termes IGN] image panchromatique [Termes IGN] injection d'image [Termes IGN] modèle non linéaire [Termes IGN] pansharpening (fusion d'images) Résumé : (auteur) The fusion of high spatial resolution panchromatic (PAN) data with simultaneously acquired multispectral (MS) data with the lower spatial resolution is a hot topic, which is often called pansharpening. In this article, we exploit the combination of machine learning techniques and fusion schemes introduced to address the pansharpening problem. In particular, deep convolutional neural networks (DCNNs) are proposed to solve this issue. The latter is combined first with the traditional component substitution and multiresolution analysis fusion schemes in order to estimate the nonlinear injection models that rule the combination of the upsampled low-resolution MS image with the extracted details exploiting the two philosophies. Furthermore, inspired by these two approaches, we also developed another DCNN for pansharpening. This is fed by the direct difference between the PAN image and the upsampled low-resolution MS image. Extensive experiments conducted both at reduced and full resolutions demonstrate that this latter convolutional neural network outperforms both the other detail injection-based proposals and several state-of-the-art pansharpening methods. Numéro de notice : A2021-639 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3031366 En ligne : https://doi.org/10.1109/TGRS.2020.3031366 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98293 [article]

Unsupervised pansharpening based on self-attention mechanism / Ying Qu in IEEE Transactions on geoscience and remote sensing, vol 59 n° 4 (April 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 59 n° 4 (April 2021) . - pp 3192 - 3208 Titre : Unsupervised pansharpening based on self-attention mechanism Type de document : Article/Communication Auteurs : Ying Qu, Auteur ; Razieh Kaviani Baghbaderani, Auteur ; Hairong Qi, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 3192 - 3208 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification non dirigée [Termes IGN] image multibande [Termes IGN] pansharpening (fusion d'images) [Termes IGN] pouvoir de résolution géométrique [Termes IGN] précision infrapixellaire [Termes IGN] reconstruction d'image [Termes IGN] segmentation d'image Résumé : (auteur) Pansharpening is to fuse a multispectral image (MSI) of low-spatial-resolution (LR) but rich spectral characteristics with a panchromatic image (PAN) of high spatial resolution (HR) but poor spectral characteristics. Traditional methods usually inject the extracted high-frequency details from PAN into the upsampled MSI. Recent deep learning endeavors are mostly supervised assuming that the HR MSI is available, which is unrealistic especially for satellite images. Nonetheless, these methods could not fully exploit the rich spectral characteristics in the MSI. Due to the wide existence of mixed pixels in satellite images where each pixel tends to cover more than one constituent material, pansharpening at the subpixel level becomes essential. In this article, we propose an unsupervised pansharpening (UP) method in a deep-learning framework to address the abovementioned challenges based on the self-attention mechanism (SAM), referred to as UP-SAM. The contribution of this article is threefold. First, the SAM is proposed where the spatial varying detail extraction and injection functions are estimated according to the attention representations indicating spectral characteristics of the MSI with subpixel accuracy. Second, such attention representations are derived from mixed pixels with the proposed stacked attention network powered with a stick-breaking structure to meet the physical constraints of mixed pixel formulations. Third, the detail extraction and injection functions are spatial varying based on the attention representations, which largely improves the reconstruction accuracy. Extensive experimental results demonstrate that the proposed approach is able to reconstruct sharper MSI of different types, with more details and less spectral distortion compared with the state-of-the-art. Numéro de notice : A2021-285 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3009207 Date de publication en ligne : 23/07/2020 En ligne : https://doi.org/10.1109/TGRS.2020.3009207 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97394 [article]

Pan-sharpening via multiscale dynamic convolutional neural network / Jianwen Hu in IEEE Transactions on geoscience and remote sensing, Vol 59 n° 3 (March 2021)  

Permalink

GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening / Hao Zhang in ISPRS Journal of photogrammetry and remote sensing, vol 172 (February 2021)  

Permalink

Amélioration des résolutions spatiale et spectrale d’images satellitaires par réseaux antagonistes / Anaïs Gastineau (2021)  

Permalink

A review of image fusion techniques for pan-sharpening of high-resolution satellite imagery / Farzaneh Dadrass Javan in ISPRS Journal of photogrammetry and remote sensing, vol 171 (January 2021)  

Permalink

fusionImage: An R package for pan‐sharpening images in open source software / Fulgencio Cánovas‐García in Transactions in GIS, Vol 24 n° 5 (October 2020)  

Permalink

Comparison of tree-based classification algorithms in mapping burned forest areas / Dilek Kucuk Matci in Geodetski vestnik, vol 64 n° 3 (September - November 2020)  

Permalink

Pansharpening: context-based generalized Laplacian pyramids by robust regression / Gemine Vivone in IEEE Transactions on geoscience and remote sensing, vol 58 n° 9 (September 2020)  

Permalink

Application of geographic Information system and remote sensing in multiple criteria analysis to identify priority areas for biodiversity conservation in Vietnam / Xuan Dinh Vu (2020)  

Permalink

Tree species classification in tropical forests using visible to shortwave infrared WorldView-3 images and texture analysis / Matheus Pinheiro Ferreira in ISPRS Journal of photogrammetry and remote sensing, vol 149 (March 2019)  

Permalink

Synergetic efficiency of Lidar and WorldView-2 for 3D urban cartography in Northeast Mexico / Fabiola D. Yepez-Rincon in Geocarto international, vol 34 n° 2 ([01/02/2019])  

Permalink