Centre dedocumentation
scientifique

Multi-modal learning in photogrammetry and remote sensing / Michael Ying Yang in ISPRS Journal of photogrammetry and remote sensing, vol 176 (June 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 176 (June 2021) . - pp 54 - 54 Titre : Multi-modal learning in photogrammetry and remote sensing Type de document : Article/Communication Auteurs : Michael Ying Yang, Auteur ; Loïc Landrieu , Auteur ; Devis Tuia, Auteur ; Charles Toth, Auteur Année de publication : 2021 Projets : 1-Pas de projet / Article en page(s) : pp 54 - 54 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Télédétection [Termes IGN] acquisition d'images [Termes IGN] apprentissage automatique [Termes IGN] données multisources Résumé : (Auteur) [Editorial] There is a growing interest in the photogrammetry and remote sensing community for multi-modal data, i. e., data simultaneously acquired from a variety of platforms, including satellites, aircraft, UAS/UGS, autonomous vehicles, etc., by different sensors, such as radar, optical, LiDAR. Thanks to their different spatial, spectral, or temporal resolutions, the use of complementary data sources leads to richer and more robust information extraction. We expect that the use of multiple modalities will rapidly become a standard approach in the future. The main difficulty of jointly processing multi-modal data is due to the differences in structure among modalities. Another issue is the unbalanced number of labelled samples available across modalities, resulting in a significant gap in performance when models are trained separately. Clearly, the photogrammetry and remote sensing community has not yet exploited the full potential of multi-modal data. Neural networks seem well suited for accommodating different data sources, thanks to their capabilities to learn representations adapted to each task in an end-to-end fashion. In this context, there is a strong need for research and development of approaches for multi-sensory and multi-modal deep learning within the geospatial domain. Numéro de notice : A2021-364 Affiliation des auteurs : UGE-LaSTIG+Ext (2020- ) Thématique : IMAGERIE/INFORMATIQUE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.03.022 date de publication en ligne : 23/04/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.03.022 Format de la ressource électronique : URL Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97660 [article]

Improved crop classification with rotation knowledge using Sentinel-1 and -2 time series / Sébastien Giordano in Photogrammetric Engineering & Remote Sensing, PERS, vol 86 n° 7 (July 2020)  

Public [article]  inPhotogrammetric Engineering & Remote Sensing, PERS > vol 86 n° 7 (July 2020) . - pp 431 - 441 Titre : Improved crop classification with rotation knowledge using Sentinel-1 and -2 time series Type de document : Article/Communication Auteurs : Sébastien Giordano , Auteur ; Simon Bailly, Auteur ; Loïc Landrieu , Auteur ; Nesrine Chehata , Auteur Année de publication : 2020 Projets : MAESTRIA / Mallet, Clément Article en page(s) : pp 431 - 441 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image mixte [Termes IGN] Alpes-de-haute-provence (04) [Termes IGN] chaîne de traitement [Termes IGN] classification par forêts aléatoires [Termes IGN] image Sentinel-MSI [Termes IGN] image Sentinel-SAR [Termes IGN] parcelle agricole [Termes IGN] photo-identification [Termes IGN] Seine-et-Marne (77) [Termes IGN] série temporelle [Termes IGN] surface cultivée Résumé : (Auteur) Leveraging the recent availability of accurate, frequent, and multimodal (radar and optical) Sentinel-1 and -2 acquisitions, this paper investigates the automation of land parcel identification system (LPIS) crop type classification. Our approach allows for the automatic integration of temporal knowledge, i.e., crop rotations using existing parcel-based land cover databases and multi-modal Sentinel-1 and -2 time series. The temporal evolution of crop types was modeled with a linear-chain conditional random field, trained with time series of multimodal (radar and optical) satellite acquisitions and associated LPIS. Our model was tested on two study areas in France (≥ 1250 km2) which show different crop types, various parcel sizes, and agricultural practices: . the Seine et Marne and the Alpes de Haute-Provence classified accordingly to a fine national 25-class nomenclature. We first trained a Random Forest classifier without temporal structure to achieve 89.0% overall accuracy in Seine et Marne (10 classes) and 73% in Alpes de Haute-Provence (14 classes). We then demonstrated experimentally that taking into account the temporal structure of crop rotation with our model resulted in an increase of 3% to +5% in accuracy. This increase was especially important (+12%) for classes which were poorly classified without using the temporal structure. A stark positive impact was also demonstrated on permanent crops, while it was fairly limited or even detrimental for annual crops. Numéro de notice : A2020-382 Affiliation des auteurs : LaSTIG MATIS+Ext (2012-2019) Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.14358/PERS.86.7.431 date de publication en ligne : 01/07/2020 En ligne : https://doi.org/10.14358/PERS.86.7.431 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=95428 [article]

Réservation

Réserver ce document

Exemplaires (1)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
105-2020071	SL	Revue	Centre de documentation	Revues en salle	Disponible

Lightweight temporal self-attention for classifying satellite images time series / Vivien Sainte Fare Garnot (2020)  

Public Titre : Lightweight temporal self-attention for classifying satellite images time series Type de document : Article/Communication Auteurs : Vivien Sainte Fare Garnot , Auteur ; Loïc Landrieu , Auteur Editeur : Le Chesnay : Institut National de Recherche en Informatique et en Automatique INRIA Année de publication : 2020 Conférence : AALTD 2020, Workshop on Advanced Analytics and Learning on Temporal Data 18/09/2020 18/09/2020 en ligne Belgique Importance : 11 p. Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] chaîne de traitement [Termes IGN] efficacité [Termes IGN] image Sentinel [Termes IGN] série temporelle Résumé : (auteur) The increasing accessibility and precision of Earth observation satellite data offers considerable opportunities for industrial and state actors alike. This calls however for efficient methods able to process time series on a global scale. Building on recent work employing multi-headed self-attention mechanisms to classify remote sensing time sequences, we propose a modification of the Temporal Attention Encoderof Garnot et al.[5]. In our network, the channels of the temporal inputs are distributed among several compact attention heads operating in parallel. Each head extracts highly-specialized temporal features which arein turn concatenated into a single representation. Our approach outper-forms other state-of-the-art time series classification algorithms on an open-access satellite image dataset, while using significantly fewer parameters and with a reduced computational complexity. Numéro de notice : C2020-020 Affiliation des auteurs : UGE-LaSTIG (2020- ) Autre URL associée : vers HAL Thématique : IMAGERIE/INFORMATIQUE Nature : Poster nature-HAL : Poster-avec-CL DOI : sans En ligne : https://project.inria.fr/aaltd20/files/2020/08/AALTD_20_paper_SainteFareGarnot.p [...] Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=96458

Satellite image time series classification with pixel-set encoders and temporal self-attention / Vivien Sainte Fare Garnot (2020)    

Public Titre : Satellite image time series classification with pixel-set encoders and temporal self-attention Type de document : Article/Communication Auteurs : Vivien Sainte Fare Garnot , Auteur ; Loïc Landrieu , Auteur ; Sébastien Giordano , Auteur ; Nesrine Chehata , Auteur Editeur : Computer vision foundation Année de publication : 2020 Projets : 1-Pas de projet / Conférence : CVPR 2020, IEEE Conference on Computer Vision and Pattern Recognition 14/06/2020 19/06/2020 en ligne Chine Open Access Proceedings Importance : pp 12325 - 12334 Format : 21 x 30 cm Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage automatique [Termes IGN] classification automatique [Termes IGN] classification orientée objet [Termes IGN] classification par forêts aléatoires [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] extraction de traits caractéristiques [Termes IGN] géocodage [Termes IGN] image multibande [Termes IGN] image satellite [Termes IGN] parcelle agricole [Termes IGN] politique agricole commune [Termes IGN] série temporelle [Termes IGN] utilisation du sol Résumé : (auteur) Satellite image time series, bolstered by their growing availability, are at the forefront of an extensive effort towards automated Earth monitoring by international institutions. In particular, large-scale control of agricultural parcels is an issue of major political and economic importance. In this regard, hybrid convolutional-recurrent neural architectures have shown promising results for the automated classification of satellite image time series.We propose an alternative approach in which the convolutional layers are advantageously replaced with encoders operating on unordered sets of pixels to exploit the typically coarse resolution of publicly available satellite images. We also propose to extract temporal features using a bespoke neural architecture based on self-attention instead of recurrent networks. We demonstrate experimentally that our method not only outperforms previous state-of-the-art approaches in terms of precision, but also significantly decreases processing time and memory requirements. Lastly, we release a large openaccess annotated dataset as a benchmark for future work on satellite image time series. Numéro de notice : C2020-016 Affiliation des auteurs : LaSTIG MATIS+Ext (2012-2019) Autre URL associée : vers ArXiv/vers CVF Thématique : IMAGERIE Nature : Communication nature-HAL : ComAvecCL&ActesPubliésIntl DOI : 10.1109/CVPR42600.2020.01234 date de publication en ligne : 05/08/2020 En ligne : https://doi.org/10.1109/CVPR42600.2020.01234 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=94225

Documents numériques

en open access Satellite image time series classification - pdf préprint Adobe Acrobat PDF

Torch-Points3D: A modular multi-task framework for reproducible deep learning on 3D point clouds / Thomas Chaton (2020)  

Public Titre : Torch-Points3D: A modular multi-task framework for reproducible deep learning on 3D point clouds Type de document : Article/Communication Auteurs : Thomas Chaton, Auteur ; Nicolas Chaulet, Auteur ; Sofiane Horache, Auteur ; Loïc Landrieu , Auteur Editeur : New York : Institute of Electrical and Electronics Engineers IEEE Année de publication : 2020 Projets : AI4GEO / Conférence : 3DV 2020, International Conference on 3D Vision 25/11/2020 27/11/2020 en ligne Japon Importance : 12 p. - n° 282 Format : 21 x 30 cm Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Informatique [Termes IGN] apprentissage profond [Termes IGN] cadre conceptuel [Termes IGN] code source libre [Termes IGN] données localisées 3D [Termes IGN] reproductibilité [Termes IGN] réseau neuronal profond Résumé : (auteur) We introduce Torch-Points3D, an open-source framework designed to facilitate the use of deep networks on 3D data. Its modular design, efficient implementation, and user-friendly interfaces make it a relevant tool for research and productization alike. Beyond multiple quality-of-life features, our goal is to standardize a higher level of transparency and reproducibility in 3D deep learning research, and to lower its barrier to entry. In this paper, we present the design principles of Torch-Points3D, as well as extensive benchmarks of multiple state-of-the-art algorithms and inference schemes across several datasets and tasks. The modularity of Torch-Points3D allows us to design fair and rigorous experimental protocols in which all methods are evaluated in the same conditions. The Torch-Points3D repository : https://github.com/nicolas-chaulet/torch-points3d. Numéro de notice : C2020-019 Affiliation des auteurs : UGE-LaSTIG+Ext (2020- ) Autre URL associée : vers HAL Thématique : IMAGERIE/INFORMATIQUE Nature : Communication nature-HAL : ComAvecCL&ActesPubliésIntl DOI : 10.1109/3DV50981.2020.00029 date de publication en ligne : 19/01/2021 En ligne : https://doi.org/10.1109/3DV50981.2020.00029 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=96456

Piecewise-planar approximation of large 3D data as graph-structured optimization / Stéphane Guinard in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-2/W5 (May 2019)  

Permalink

Parallel cut pursuit for minimization of the graph total variation / Hugo Raguet (2019)  

Permalink

Point cloud oversegmentation with graph-structured deep metric learning / Loïc Landrieu (2019)  

Permalink

Supervized segmentation with graph-structured deep metric learning / Loïc Landrieu (2019)  

Permalink

Time-space tradeoff in deep learning models for crop classification on satellite multi-spectral image time series / Vivien Sainte Fare Garnot (2019)  

Permalink

Crop-rotation structured classification using multi-source sentinel images and LPIS for crop type mapping / Simon Bailly (2018)  

Permalink

Cut-Pursuit algorithm for regularizing nonsmooth functionals with graph total variation / Hugo Raguet (2018)    

Permalink

Large-scale point cloud semantic segmentation with superpoint graphs / Loïc Landrieu (2018)    

Permalink

Segmentation sémantique à grande échelle par graphes de superpoints / Loïc Landrieu (2018)    

Permalink

SuperPoint Graph : segmentation sémantique de nuages de points LiDAR à grande échelle / Loïc Landrieu (2018) 

Permalink