Centre dedocumentation
scientifique

Downscaling MODIS spectral bands using deep learning / Rohit Mukherjee in GIScience and remote sensing, vol 58 n° 8 (2021)  

Public [article]  inGIScience and remote sensing > vol 58 n° 8 (2021) . - pp 1300 - 1315 Titre : Downscaling MODIS spectral bands using deep learning Type de document : Article/Communication Auteurs : Rohit Mukherjee, Auteur ; Desheng Liu, Auteur Année de publication : 2021 Article en page(s) : pp 1300 - 1315 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] bande spectrale [Termes IGN] image à basse résolution [Termes IGN] image Terra-MODIS [Termes IGN] image thermique [Termes IGN] rayonnement proche infrarouge [Termes IGN] réduction d'échelle [Termes IGN] résolution multiple Résumé : (auteur) MODIS sensors are widely used in a broad range of environmental studies, many of which involve joint analysis of multiple MODIS spectral bands acquired at disparate spatial resolutions. To extract land surface information from multi-resolution MODIS spectral bands, existing studies often downscale lower resolution (LR) bands to match the higher resolution (HR) bands based on simple interpolation or more advanced statistical modeling. Statistical downscaling methods rely on the functional relationship between the LR spectral bands and HR spatial information, which may vary across different land surface types, making statistical downscaling methods less robust. In this paper, we propose an alternative approach based on deep learning to downscale 500 m and 1000 m spectral bands of MODIS to 250 m without additional spatial information. We employ a superresolution architecture based on an encoder decoder network. This deep learning-based method uses a custom loss function and a self-attention layer to preserve local and global spatial relationships of the predictions. We compare our approach with a statistical method specifically developed for downscaling MODIS spectral bands, an interpolation method widely used for downscaling multi-resolution spectral bands, and a deep learning superresolution architecture previously used for downscaling satellite imagery. Results show that our deep learning method outperforms on almost all spectral bands both quantitatively and qualitatively. In particular, our deep learning-based method performs very well on the thermal bands due to the larger scale difference between the input and target resolution. This study demonstrates that our proposed deep learning-based downscaling method can maintain the spatial and spectral fidelity of satellite images and contribute to the integration and enhancement of multi-resolution satellite imagery. Numéro de notice : A2021-124 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1080/15481603.2021.1984129 Date de publication en ligne : 26/10/2021 En ligne : https://doi.org/10.1080/15481603.2021.1984129 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=99309 [article]

Stochastic super-resolution for downscaling time-evolving atmospheric fields with a generative adversarial network / Jussi Leinonen in IEEE Transactions on geoscience and remote sensing, Vol 59 n° 9 (September 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > Vol 59 n° 9 (September 2021) . - pp 7211 - 7223 Titre : Stochastic super-resolution for downscaling time-evolving atmospheric fields with a generative adversarial network Type de document : Article/Communication Auteurs : Jussi Leinonen, Auteur ; Daniele Nerini, Auteur ; Alexis Berne, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 7211 - 7223 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] données météorologiques [Termes IGN] épaisseur de nuage [Termes IGN] image à basse résolution [Termes IGN] image GOES [Termes IGN] modèle atmosphérique [Termes IGN] précipitation [Termes IGN] processus stochastique [Termes IGN] réduction d'échelle [Termes IGN] réseau antagoniste génératif [Termes IGN] réseau neuronal convolutif [Termes IGN] Suisse Résumé : (auteur) Generative adversarial networks (GANs) have been recently adopted for super-resolution, an application closely related to what is referred to as “downscaling” in the atmospheric sciences: improving the spatial resolution of low-resolution images. The ability of conditional GANs to generate an ensemble of solutions for a given input lends itself naturally to stochastic downscaling, but the stochastic nature of GANs is not usually considered in super-resolution applications. Here, we introduce a recurrent, stochastic super-resolution GAN that can generate ensembles of time-evolving high-resolution atmospheric fields for an input consisting of a low-resolution sequence of images of the same field. We test the GAN using two data sets: one consisting of radar-measured precipitation from Switzerland; the other of cloud optical thickness derived from the Geostationary Earth Observing Satellite 16 (GOES-16). We find that the GAN can generate realistic, temporally consistent super-resolution sequences for both data sets. The statistical properties of the generated ensemble are analyzed using rank statistics, a method adapted from ensemble weather forecasting; these analyses indicate that the GAN produces close to the correct amount of variability in its outputs. As the GAN generator is fully convolutional, it can be applied after training to input images larger than the images used to train it. It is also able to generate time series much longer than the training sequences, as demonstrated by applying the generator to a three-month data set of the precipitation radar data. The source code to our GAN is available at https://github.com/jleinonen/downscaling-rnn-gan. Numéro de notice : A2021-645 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3032790 Date de publication en ligne : 02/11/2020 En ligne : https://doi.org/10.1109/TGRS.2020.3032790 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98349 [article]

Detail injection-based deep convolutional neural networks for pansharpening / Liang-Jian Deng in IEEE Transactions on geoscience and remote sensing, vol 59 n° 8 (August 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 59 n° 8 (August 2021) . - pp 6995 - 7010 Titre : Detail injection-based deep convolutional neural networks for pansharpening Type de document : Article/Communication Auteurs : Liang-Jian Deng, Auteur ; Gemine Vivone, Auteur ; Cheng Jin, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 6995 - 7010 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] analyse multirésolution [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] image à basse résolution [Termes IGN] image multibande [Termes IGN] image panchromatique [Termes IGN] injection d'image [Termes IGN] modèle non linéaire [Termes IGN] pansharpening (fusion d'images) Résumé : (auteur) The fusion of high spatial resolution panchromatic (PAN) data with simultaneously acquired multispectral (MS) data with the lower spatial resolution is a hot topic, which is often called pansharpening. In this article, we exploit the combination of machine learning techniques and fusion schemes introduced to address the pansharpening problem. In particular, deep convolutional neural networks (DCNNs) are proposed to solve this issue. The latter is combined first with the traditional component substitution and multiresolution analysis fusion schemes in order to estimate the nonlinear injection models that rule the combination of the upsampled low-resolution MS image with the extracted details exploiting the two philosophies. Furthermore, inspired by these two approaches, we also developed another DCNN for pansharpening. This is fed by the direct difference between the PAN image and the upsampled low-resolution MS image. Extensive experiments conducted both at reduced and full resolutions demonstrate that this latter convolutional neural network outperforms both the other detail injection-based proposals and several state-of-the-art pansharpening methods. Numéro de notice : A2021-639 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.3031366 En ligne : https://doi.org/10.1109/TGRS.2020.3031366 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98293 [article]

Detection of subpixel targets on hyperspectral remote sensing imagery based on background endmember extraction / Xiaorui Song in IEEE Transactions on geoscience and remote sensing, Vol 59 n° 3 (March 2021)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > Vol 59 n° 3 (March 2021) . - pp 2365 - 2377 Titre : Detection of subpixel targets on hyperspectral remote sensing imagery based on background endmember extraction Type de document : Article/Communication Auteurs : Xiaorui Song, Auteur ; Ling Zou, Auteur ; Lingda Wu, Auteur Année de publication : 2021 Article en page(s) : pp 2365 - 2377 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] détection de cible [Termes IGN] données d'entrainement (apprentissage automatique) [Termes IGN] image à basse résolution [Termes IGN] image hyperspectrale [Termes IGN] méthode robuste [Termes IGN] précision infrapixellaire Résumé : (Auteur) The low spatial resolution associated with imaging spectrometers has caused subpixel target detection to become a special problem in hyperspectral image (HSI) processing that poses considerable challenges. In subpixel target detection, the size of the target is smaller than that of a pixel, making the spatial information of the target almost useless so that a detection algorithm must rely on the spectral information of the image. To address this problem, this article proposes a subpixel target detection algorithm for hyperspectral remote sensing imagery based on background endmember extraction. First, we propose a background endmember extraction algorithm based on robust nonnegative dictionary learning to obtain the background endmember spectrum of the image. Next, we construct a hyperspectral subpixel target detector based on pixel reconstruction (HSPRD) to perform pixel-by-pixel target detection on the image to be tested using the background endmember spectral matrix and the spectra of known ground targets. Finally, the subpixel target detection results are obtained. The experimental results show that, compared with other existing subpixel target detection methods, the algorithm proposed here can provide the optimum target detection results for both synthetic and real-world data sets. Numéro de notice : A2021-217 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1109/TGRS.2020.3002461 Date de publication en ligne : 24/06/2020 En ligne : https://doi.org/10.1109/TGRS.2020.3002461 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97209 [article]

Context-aware image super-resolution using deep neural networks / Mohammad Saeed Rad (2021)  

Public Titre : Context-aware image super-resolution using deep neural networks Type de document : Thèse/HDR Auteurs : Mohammad Saeed Rad, Auteur ; Jean-Philippe Thiran, Directeur de thèse Editeur : Lausanne : Ecole Polytechnique Fédérale de Lausanne EPFL Année de publication : 2021 Importance : 148 p. Format : 21 x 30 cm Note générale : bibliographie Thèse présentée pour l'obtention du grade de Docteur ès Sciences Langues : Français (fre) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] image à basse résolution [Termes IGN] image à haute résolution [Termes IGN] pouvoir de résolution spectrale [Termes IGN] reconstruction d'image [Termes IGN] réseau antagoniste génératif [Termes IGN] segmentation sémantique [Termes IGN] vision par ordinateur Index. décimale : THESE Thèses et HDR Résumé : (auteur) Image super-resolution is a classic ill-posed computer vision and image processing problem, addressing the question of how to reconstruct a high-resolution image from its low-resolution counterpart. Current state-of-the-art methods have improved the performance of the single image super-resolution task significantly by benefiting from machine learning and AI-powered algorithms, and more specifically, with the advent of Deep Learning-based approaches. Although these advances allow a machine to learn and have better exploitation of an image and its content, recent methods are still unable to constrain the plausible solution space based on the available contextual information within an image. This limitation mostly results in poor reconstructions, even for well-known types of objects and textures easily recognizable for humans. In this thesis, we aim at proving that the categorical prior, which characterizes the semantic class of a region in an image (e.g., sky, building, plant), is crucial in super-resolution task for reaching a higher reconstruction quality. In particular, we propose several approaches to improve the perceived image quality and generalization capability of deep learning-based methods by exploiting the context and semantic meaning of images. To prove the effectiveness of this categorical information, we first propose a convolutional neural network-based framework that is able to extract and use semantic information to super-resolve a given image by using multitask learning, simultaneously for learning image super-resolution and semantic segmentation. The proposed decoder is forced to explore categorical information during training, as this setting employs only one shared deep network for both semantic segmentation and super-resolution tasks. We further investigate the possibility of using semantic information by a novel objective function to introduce additional spatial control over the training process. We propose penalizing images at different semantic levels using appropriate loss terms by benefiting from our new OBB (Object, Background, and Boundary) labels generated from segmentation labels. Then, we introduce a new test time adaptation-based technique to leverage high-resolution images with perceptually similar context to a given test image to improve the reconstruction quality. We further validate this approach's effectiveness by using a novel numerical experiment analyzing the correlation between filters learned by our network and what we define as `ideal' filters. Finally, we present a generic solution to enable adapting all our previous contributions in this thesis, as well as other recent super-resolution works trained on synthetic datasets, to real-world super-resolution problem. Real-world super-resolution refers to super-resolving images with real degradations caused by physical imaging systems, instead of low-resolution images from simulated datasets assuming a simple and uniform degradation model (i.e., bicubic downsampling). We study and develop an image-to-image translator to map the distribution of real low-resolution images to the well-understood distribution of bicubically downsampled images. This translator is used as a plug-in to integrate real inputs into any super-resolution framework trained on simulated datasets. We carry out extensive qualitative and quantitative experiments for each mentioned contribution, including user studies, to compare our proposed approaches to state-of-the-art method. Note de contenu : 1- Introduction 2- Brief image super-resolution review 3- Extracting image context by multi-task learning 4- Spatial control over image genertion process 5- Test-time adaptation based on perceptual similarity 6- Integrating into real-world SR 7- Conclusion Numéro de notice : 28652 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Thèse étrangère Note de thèse : Thèse de Doctorat : Sciences : EPFL, Lausanne : 2021 DOI : sans En ligne : https://infoscience.epfl.ch/record/286804?ln=fr Format de la ressource électronique : URL Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=99790

Multiview automatic target recognition for infrared imagery using collaborative sparse priors / Xuelu Li in IEEE Transactions on geoscience and remote sensing, vol 58 n° 10 (October 2020)  

Permalink

Super-resolution of Sentinel-2 images : Learning a globally applicable deep neural network / Charis Lanaras in ISPRS Journal of photogrammetry and remote sensing, vol 146 (December 2018)  

Permalink

Spatially sensitive statistical shape analysis for pedestrian recognition from LIDAR data / Michalis A. Savelonas in Computer Vision and image understanding, vol 171 (June 2018)  

Permalink

Improved geometric modeling of 1960s KH-5 ARGON satellite images for regional Antarctica applications / Wenkai Ye in Photogrammetric Engineering & Remote Sensing, PERS, vol 83 n° 7 (July 2017)  

Permalink

Single Image Super-Resolution based on Neural Networks for text and face recognition / Clément Peyrard (2017)  

Permalink

Multiband image fusion based on spectral unmixing / Qi Wei in IEEE Transactions on geoscience and remote sensing, vol 54 n° 12 (December 2016)  

Permalink

Sub-pixel-scale land cover map updating by integrating change detection and sub-pixel mapping / Xiaodong Li in Photogrammetric Engineering & Remote Sensing, PERS, vol 81 n° 1 (January 2015)  

Permalink

Land cover classification of finer resolution remote sensing data integrating temporal features from time series coarser resolution data / Kun Jia in ISPRS Journal of photogrammetry and remote sensing, vol 93 (July 2014)  

Permalink

Using thermal time and pixel purity for enhancing biophysical variable time series: An interproduct comparison / Grégory Duveiller in IEEE Transactions on geoscience and remote sensing, vol 51 n° 4 Tome 1 (April 2013)  

Permalink

Semi-automatic quality control of topographic data sets / Petra Helmholz in Photogrammetric Engineering & Remote Sensing, PERS, vol 78 n° 9 (September 2012)  

Permalink