Centre dedocumentation
scientifique

Integrating spatio-temporal-spectral information for downscaling Sentinel-3 OLCI images / Yijie Tang in ISPRS Journal of photogrammetry and remote sensing, vol 180 (October 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 180 (October 2021) . - pp 130 - 150 Titre : Integrating spatio-temporal-spectral information for downscaling Sentinel-3 OLCI images Type de document : Article/Communication Auteurs : Yijie Tang, Auteur ; Qunming Wang, Auteur ; Xiaohua Tong, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 130 - 150 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] données spatiotemporelles [Termes IGN] fusion d'images [Termes IGN] image multibande [Termes IGN] image Sentinel-MSI [Termes IGN] image Sentinel-OLCI [Termes IGN] pouvoir de résolution géométrique [Termes IGN] réduction d'échelle [Termes IGN] réflectance Résumé : (auteur) Sentinel-3 is a newly launched satellite implemented by the European Space Agency (ESA) for global observation. The Ocean and Land Colour Imager (OLCI) sensor onboard Sentinel-3 provides 21 band images with a fine spectral resolution and is of great value for ocean, land and atmospheric monitoring. The two platforms (Sentinel-3A and -3B) can provide OLCI images at an almost daily temporal resolution. The coarse spatial resolution of the 21 band OLCI images (i.e., 300 m), however, limits greatly their utility for local, precise monitoring. Sentinel-2, another satellite provided by ESA, carries the Multispectral Imager (MSI) sensor which can supply much finer spatial resolution (e.g., 10 m and 20 m) images. This paper introduces a new fusion framework integrating spatio-temporal-spectral information for downscaling Sentinel-3 OLCI images, which has two parts. Based on bands with similar wavelengths (i.e., bands 2, 3, 4 and 8a for Sentinel-2 and bands Oa4, Oa6, Oa8 and Oa17 for Sentinel-3), the four Sentinel-3 bands are first downscaled to the spatial resolution of Sentinel-2 images by applying spatio-temporal fusion to Sentinel-2 MSI and Sentinel-3 OLCI images. Then, to take full advantage of all 21 available OLCI bands of the Sentinel-3 images, the extended image pair-based spatio-spectral fusion (EIPSSF) method is proposed in this paper to downscale the other 17 bands. EIPSSF is performed based on the new concept of the extended image pair (EIP) and by exploiting existing spatio-temporal fusion approaches. The framework consisting of spatio-temporal and spatio-spectral fusion is entirely general, which provides a practical solution for comprehensive downscaling of Sentinel-3 OLCI images for fine spatial, temporal and spectral resolution monitoring. Numéro de notice : A2021-654 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.08.012 date de publication en ligne : 24/08/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.08.012 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98384 [article]

Recurrent-based regression of Sentinel time series for continuous vegetation monitoring / Anatol Garioud in Remote sensing of environment, vol 263 (15 September 2021)  

Public [article]  inRemote sensing of environment > vol 263 (15 September 2021) . - n° 112419 Titre : Recurrent-based regression of Sentinel time series for continuous vegetation monitoring Type de document : Article/Communication Auteurs : Anatol Garioud , Auteur ; Silvia Valero, Auteur ; Sébastien Giordano , Auteur ; Clément Mallet , Auteur Année de publication : 2021 Projets : 3-projet - voir note / Article en page(s) : n° 112419 Note générale : bibliographie This work is funded by the Agence de la transition écologique (ADEME) and the Centre National d'Études Spatiales (CNES). Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications de télédétection [Termes IGN] classification par réseau neuronal [Termes IGN] classification par réseau neuronal récurrent [Termes IGN] fusion d'images [Termes IGN] image Sentinel-MSI [Termes IGN] image Sentinel-SAR [Termes IGN] Normalized Difference Vegetation Index [Termes IGN] régression [Termes IGN] série temporelle [Termes IGN] surveillance de la végétation Résumé : (auteur) Dense time series of optical satellite imagery describing vegetation activity provide essential information for the efficient and regular monitoring of vegetation. Nevertheless, the temporal resolution of optical sensors is strongly affected by cloud cover, resulting in significant missing information. The use of complementary acquisitions, such as Synthetic Aperture Radar (SAR) data, opens the door to the development of new multi-sensor methodologies aiming at the reconstruction of missing information. However, the joint exploitation of new radar and optical missions, such as the Sentinel, raises new challenges given the different nature and response of the two data sources. In this work, the SenRVM methodology is proposed as a new multi-sensor approach to regress SAR time series towards Normalized Difference Vegetation Index (NDVI). A deep Recurrent Neural Network architecture which integrates SAR acquisitions and ancillary data is adopted. The regression task permits a continuous optical temporal resolution of 6 days. Multiple experiments are carried out to assess the SenRVM framework by studying two large-scale areas in France. Through an extensive interpretation of the results, SenRVM is evaluated on three main vegetation types (grasslands, crops, and forests). High accurate results (R2 > 0.83 and MAE Numéro de notice : A2021-499 Affiliation des auteurs : UGE-LaSTIG+Ext (2020- ) Thématique : FORET/IMAGERIE Nature : Article DOI : 10.1016/j.rse.2021.112419 date de publication en ligne : 25/06/2021 En ligne : https://doi.org/10.1016/j.rse.2021.112419 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98004 [article]

Hyperspectral image fusion and multitemporal image fusion by joint sparsity / Han Pan in IEEE Transactions on geoscience and remote sensing, Vol 59 n° 9 (September 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > Vol 59 n° 9 (September 2021) . - pp 7887 - 7900 Titre : Hyperspectral image fusion and multitemporal image fusion by joint sparsity Type de document : Article/Communication Auteurs : Han Pan, Auteur ; Zhongliang Jing, Auteur ; Henry Leung, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 7887 - 7900 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] correction d'image [Termes IGN] flou [Termes IGN] fusion d'images [Termes IGN] image hyperspectrale [Termes IGN] image multitemporelle [Termes IGN] image panchromatique [Termes IGN] pansharpening (fusion d'images) [Termes IGN] représentation parcimonieuse Résumé : (auteur) Different image fusion systems have been developed to deal with the massive amounts of image data for different applications, such as remote sensing, computer vision, and environment monitoring. However, the generalizability and versatility of these fusion systems remain unknown. This article proposes an efficient regularization framework to achieve different kinds of fusion tasks accounting for the spatiospectral and spatiotemporal variabilities of the fusion process. A joint minimization functional is developed by taking an advantage of a composite regularizer for enforcing joint sparsity in the gradient domain and the frame domain. The proposed composite regularizer is composed of the Hessian Schatten-norm regularization and contourlet-based regularization terms. The resulting problems are solved by the alternating direction method of multipliers (ADMM). The effectiveness of the proposed method is validated in a variety of image fusion experiments: 1) hyperspectral (HS) and panchromatic image fusion; 2) HS and multispectral image fusion; 3) multitemporal image fusion (MIF); and 4) multi-image deblurring. Results show promising performance compared with state-of-the-art fusion methods. Numéro de notice : A2021-649 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3039046 date de publication en ligne : 07/12/2020 En ligne : https://doi.org/10.1109/TGRS.2020.3039046 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98360 [article]

Detail injection-based deep convolutional neural networks for pansharpening / Liang-Jian Deng in IEEE Transactions on geoscience and remote sensing, vol 59 n° 8 (August 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 59 n° 8 (August 2021) . - pp 6995 - 7010 Titre : Detail injection-based deep convolutional neural networks for pansharpening Type de document : Article/Communication Auteurs : Liang-Jian Deng, Auteur ; Gemine Vivone, Auteur ; Cheng Jin, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 6995 - 7010 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] analyse multirésolution [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] image à basse résolution [Termes IGN] image multibande [Termes IGN] image panchromatique [Termes IGN] injection d'image [Termes IGN] modèle non linéaire [Termes IGN] pansharpening (fusion d'images) Résumé : (auteur) The fusion of high spatial resolution panchromatic (PAN) data with simultaneously acquired multispectral (MS) data with the lower spatial resolution is a hot topic, which is often called pansharpening. In this article, we exploit the combination of machine learning techniques and fusion schemes introduced to address the pansharpening problem. In particular, deep convolutional neural networks (DCNNs) are proposed to solve this issue. The latter is combined first with the traditional component substitution and multiresolution analysis fusion schemes in order to estimate the nonlinear injection models that rule the combination of the upsampled low-resolution MS image with the extracted details exploiting the two philosophies. Furthermore, inspired by these two approaches, we also developed another DCNN for pansharpening. This is fed by the direct difference between the PAN image and the upsampled low-resolution MS image. Extensive experiments conducted both at reduced and full resolutions demonstrate that this latter convolutional neural network outperforms both the other detail injection-based proposals and several state-of-the-art pansharpening methods. Numéro de notice : A2021-639 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3031366 En ligne : https://doi.org/10.1109/TGRS.2020.3031366 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98293 [article]

Marrying deep learning and data fusion for accurate semantic labeling of Sentinel-2 images / Guillemette Fonteix in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, V-2-2021 (July 2021)  

Public [article]  inISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences > V-2-2021 (July 2021) . - pp 101 - 107 Titre : Marrying deep learning and data fusion for accurate semantic labeling of Sentinel-2 images Type de document : Article/Communication Auteurs : Guillemette Fonteix, Auteur ; M. Swaine, Auteur ; M. Leras, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 101 - 107 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] carte de confiance [Termes IGN] chaîne de traitement [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] étiquetage sémantique [Termes IGN] fusion d'images [Termes IGN] image optique [Termes IGN] image Sentinel-MSI [Termes IGN] série temporelle Résumé : (auteur) The understanding of the Earth through global land monitoring from satellite images paves the way towards many applications including flight simulations, urban management and telecommunications. The twin satellites from the Sentinel-2 mission developed by the European Space Agency (ESA) provide 13 spectral bands with a high observation frequency worldwide. In this paper, we present a novel multi-temporal approach for land-cover classification of Sentinel-2 images whereby a time-series of images is classified using fully convolutional network U-Net models and then coupled by a developed probabilistic algorithm. The proposed pipeline further includes an automatic quality control and correction step whereby an external source can be introduced in order to validate and correct the deep learning classification. The final step consists of adjusting the combined predictions to the cloud-free mosaic built from Sentinel-2 L2A images in order for the classification to more closely match the reference mosaic image. Numéro de notice : A2021-492 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.5194/isprs-annals-V-3-2021-101-2021 date de publication en ligne : 17/06/2021 En ligne : http://dx.doi.org/10.5194/isprs-annals-V-3-2021-101-2021 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97957 [article]

Resolution enhancement for large-scale land cover mapping via weakly supervised deep learning / Qiutong Yu in Photogrammetric Engineering & Remote Sensing, PERS, vol 87 n° 6 (June 2021)  

Permalink

Unsupervised pansharpening based on self-attention mechanism / Ying Qu in IEEE Transactions on geoscience and remote sensing, vol 59 n° 4 (April 2021)  

Permalink

Pan-sharpening via multiscale dynamic convolutional neural network / Jianwen Hu in IEEE Transactions on geoscience and remote sensing, Vol 59 n° 3 (March 2021)  

Permalink

GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening / Hao Zhang in ISPRS Journal of photogrammetry and remote sensing, vol 172 (February 2021)  

Permalink

FuNet: A novel road extraction network with fusion of location data and remote sensing imagery / Kai Zhou in ISPRS International journal of geo-information, vol 10 n° 1 (January 2021)  

Permalink

Hyperspectral and multispectral image fusion via graph Laplacian-guided coupled tensor decomposition / Yuanyang Bu in IEEE Transactions on geoscience and remote sensing, vol 59 n° 1 (January 2021)  

Permalink

Real-time multimodal semantic scene understanding for autonomous UGV navigation / Yifei Zhang (2021)  

Permalink

A review of image fusion techniques for pan-sharpening of high-resolution satellite imagery / Farzaneh Dadrass Javan in ISPRS Journal of photogrammetry and remote sensing, vol 171 (January 2021)  

Permalink

Unmixing-based Sentinel-2 downscaling for urban land cover mapping / Fei Xu in ISPRS Journal of photogrammetry and remote sensing, vol 171 (January 2021)  

Permalink

Understanding the synergies of deep learning and data fusion of multispectral and panchromatic high resolution commercial satellite imagery for automated ice-wedge polygon detection / Chandi Witharana in ISPRS Journal of photogrammetry and remote sensing, vol 170 (December 2020)  

Permalink