Centre dedocumentation
scientifique

A hierarchical deep learning framework for the consistent classification of land use objects in geospatial databases / Chun Yang in ISPRS Journal of photogrammetry and remote sensing, vol 177 (July 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 177 (July 2021) . - pp 38 - 56 Titre : A hierarchical deep learning framework for the consistent classification of land use objects in geospatial databases Type de document : Article/Communication Auteurs : Chun Yang, Auteur ; Franz Rottensteiner, Auteur ; Christian Heipke, Auteur Année de publication : 2021 Article en page(s) : pp 38 - 56 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Bases de données localisées [Termes descripteurs IGN] Allemagne [Termes descripteurs IGN] apprentissage profond [Termes descripteurs IGN] approche hiérarchique [Termes descripteurs IGN] classification automatique d'objets [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] image aérienne [Termes descripteurs IGN] jointure [Termes descripteurs IGN] objet géographique [Termes descripteurs IGN] occupation du sol [Termes descripteurs IGN] optimisation (mathématiques) [Termes descripteurs IGN] utilisation du sol Résumé : (Auteur) Land use as contained in geospatial databases constitutes an essential input for different applications such as urban management, regional planning and environmental monitoring. In this paper, a hierarchical deep learning framework is proposed to verify the land use information. For this purpose, a two-step strategy is applied. First, given high-resolution aerial images, the land cover information is determined. To achieve this, an encoder-decoder based convolutional neural network (CNN) is proposed. Second, the pixel-wise land cover information along with the aerial images serves as input for another CNN to classify land use. Because the object catalogue of geospatial databases is frequently constructed in a hierarchical manner, we propose a new CNN-based method aiming to predict land use in multiple levels hierarchically and simultaneously. A so called Joint Optimization (JO) is proposed where predictions are made by selecting the hierarchical tuple over all levels which has the maximum joint class scores, providing consistent results across the different levels. The conducted experiments show that the CNN relying on JO outperforms previous results, achieving an overall accuracy up to 92.5%. In addition to the individual experiments on two test sites, we investigate whether data showing different characteristics can improve the results of land cover and land use classification, when processed together. To do so, we combine the two datasets and undertake some additional experiments. The results show that adding more data helps both land cover and land use classification, especially the identification of underrepresented categories, despite their different characteristics. Numéro de notice : A2021-370 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE/IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.04.022 date de publication en ligne : 13/05/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.04.022 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97774 [article]

Feature detection and description for image matching: from hand-crafted design to deep learning / Lin Chen in Geo-spatial Information Science, vol 24 n° 1 (March 2021)  

Public [article]  inGeo-spatial Information Science > vol 24 n° 1 (March 2021) . - pp 58 - 74 Titre : Feature detection and description for image matching: from hand-crafted design to deep learning Type de document : Article/Communication Auteurs : Lin Chen, Auteur ; Franz Rottensteiner, Auteur ; Christian Heipke, Auteur Année de publication : 2021 Article en page(s) : pp 58 - 74 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes descripteurs IGN] appariement automatique [Termes descripteurs IGN] appariement d'images [Termes descripteurs IGN] appariement de formes [Termes descripteurs IGN] apprentissage automatique [Termes descripteurs IGN] apprentissage profond [Termes descripteurs IGN] extraction de traits caractéristiques [Termes descripteurs IGN] image aérienne oblique [Termes descripteurs IGN] orientation d'image [Termes descripteurs IGN] SIFT (algorithme) Résumé : (Auteur) In feature based image matching, distinctive features in images are detected and represented by feature descriptors. Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate points. In this paper, we first shortly discuss the general framework. Then, we review feature detection as well as the determination of affine shape and orientation of local features, before analyzing feature description in more detail. In the feature description review, the general framework of local feature description is presented first. Then, the review discusses the evolution from hand-crafted feature descriptors, e.g. SIFT (Scale Invariant Feature Transform), to machine learning and deep learning based descriptors. The machine learning models, the training loss and the respective training data of learning-based algorithms are looked at in more detail; subsequently the various advantages and challenges of the different approaches are discussed. Finally, we present and assess some current research directions before concluding the paper. Numéro de notice : A2021-297 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1080/10095020.2020.1843376 date de publication en ligne : 17/11/2020 En ligne : https://doi.org/10.1080/10095020.2020.1843376 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97379 [article]

Aleatoric uncertainty estimation for dense stereo matching via CNN-based cost volume analysis / Max Mehltretter in ISPRS Journal of photogrammetry and remote sensing, vol 171 (January 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 171 (January 2021) . - pp 63 - 75 Titre : Aleatoric uncertainty estimation for dense stereo matching via CNN-based cost volume analysis Type de document : Article/Communication Auteurs : Max Mehltretter, Auteur ; Christian Heipke, Auteur Année de publication : 2021 Article en page(s) : pp 63 - 75 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes descripteurs IGN] appariement d'images [Termes descripteurs IGN] apprentissage profond [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] corrélation épipolaire dense [Termes descripteurs IGN] couple stéréoscopique [Termes descripteurs IGN] courbe épipolaire [Termes descripteurs IGN] disparité [Termes descripteurs IGN] effet de profondeur cinétique [Termes descripteurs IGN] image RVB [Termes descripteurs IGN] modèle d'incertitude [Termes descripteurs IGN] modèle stochastique [Termes descripteurs IGN] voxel Résumé : (auteur) Motivated by the need to identify erroneous disparity estimates, various methods for the estimation of aleatoric uncertainty in the context of dense stereo matching have been presented in recent years. Especially, the introduction of deep learning based methods and the accompanying significant improvement in accuracy have greatly increased the popularity of this field. Despite this remarkable development, most of these methods rely on features learned from disparity maps only, neglecting the corresponding 3-dimensional cost volumes. However, conventional hand-crafted methods have already demonstrated that the additional information contained in such cost volumes are beneficial for the task of uncertainty estimation. In this paper, we combine the advantages of deep learning and cost volume based features and present a new Convolutional Neural Network (CNN) architecture to directly learn features for the task of aleatoric uncertainty estimation from volumetric 3D data. Furthermore, we discuss and apply three different uncertainty models to train our CNN without the need to provide ground truth for uncertainty. In an extensive evaluation on three datasets using three common dense stereo matching methods, we investigate the effects of these uncertainty models and demonstrate the generality and state-of-the-art accuracy of the proposed method. Numéro de notice : A2021-012 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2020.11.003 date de publication en ligne : 18/11/2020 En ligne : https://doi.org/10.1016/j.isprsjprs.2020.11.003 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=96415 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2021011	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2021013	DEP-RECP	Revue	MATIS	Dépôt en unité	Exclu du prêt
081-2021012	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Context pyramidal network for stereo matching regularized by disparity gradients / Junhua Kang in ISPRS Journal of photogrammetry and remote sensing, vol 157 (November 2019)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 157 (November 2019) . - pp 201 - 215 Titre : Context pyramidal network for stereo matching regularized by disparity gradients Type de document : Article/Communication Auteurs : Junhua Kang, Auteur ; Lin Chen, Auteur ; Fei Deng, Auteur ; Christian Heipke, Auteur Année de publication : 2019 Article en page(s) : pp 201 - 215 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Termes descripteurs IGN] appariement d'images [Termes descripteurs IGN] appariement de formes [Termes descripteurs IGN] apprentissage profond [Termes descripteurs IGN] chaîne de traitement [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] extraction de traits caractéristiques [Termes descripteurs IGN] gradient [Termes descripteurs IGN] vision par ordinateur [Termes descripteurs IGN] vision stéréoscopique Résumé : (Auteur) Also after many years of research, stereo matching remains to be a challenging task in photogrammetry and computer vision. Recent work has achieved great progress by formulating dense stereo matching as a pixel-wise learning task to be resolved with a deep convolutional neural network (CNN). However, most estimation methods, including traditional and deep learning approaches, still have difficulty to handle real-world challenging scenarios, especially those including large depth discontinuity and low texture areas. To tackle these problems, we investigate a recently proposed end-to-end disparity learning network, DispNet (Mayer et al., 2015), and improve it to yield better results in these problematic areas. The improvements consist of three major contributions. First, we use dilated convolutions to develop a context pyramidal feature extraction module. A dilated convolution expands the receptive field of view when extracting features, and aggregates more contextual information, which allows our network to be more robust in weakly textured areas. Second, we construct the matching cost volume with patch-based correlation to handle larger disparities. We also modify the basic encoder-decoder module to regress detailed disparity images with full resolution. Third, instead of using post-processing steps to impose smoothness in the presence of depth discontinuities, we incorporate disparity gradient information as a gradient regularizer into the loss function to preserve local structure details in large depth discontinuity areas. We evaluate our model in terms of end-point-error on several challenging stereo datasets including Scene Flow, Sintel and KITTI. Experimental results demonstrate that our model decreases the estimation error compared with DispNet on most datasets (e.g. we obtain an improvement of 46% on Sintel) and estimates better structure-preserving disparity maps. Moreover, our proposal also achieves competitive performance compared to other methods. Numéro de notice : A2019-496 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2019.09.012 date de publication en ligne : 27/09/2019 En ligne : https://doi.org/10.1016/j.isprsjprs.2019.09.012 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=93729 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2019111	RAB	Revue	Centre de documentation	En réserve 3L	Disponible
081-2019113	DEP-RECP	Revue	MATIS	Dépôt en unité	Exclu du prêt
081-2019112	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Modelling of buildings from aerial LiDAR point clouds using TINs and label maps / Minglei Li in ISPRS Journal of photogrammetry and remote sensing, vol 154 (August 2019)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 154 (August 2019) . - pp 127 - 138 Titre : Modelling of buildings from aerial LiDAR point clouds using TINs and label maps Type de document : Article/Communication Auteurs : Minglei Li, Auteur ; Franz Rottensteiner, Auteur ; Christian Heipke, Auteur Année de publication : 2019 Article en page(s) : pp 127 - 138 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes descripteurs IGN] données lidar [Termes descripteurs IGN] données localisées 3D [Termes descripteurs IGN] modèle numérique du bâti [Termes descripteurs IGN] semis de points [Termes descripteurs IGN] toit [Termes descripteurs IGN] Triangulated Irregular Network Résumé : (Auteur) This paper presents a new framework for automatically creating compact building models from aerial LiDAR point clouds, where each point is known to belong to the class building. The approach addresses the issues of non-uniform point density and outlier detection to extract and refine semantic roof structures by a sequence of operations on a label map. We first partition the points into some coarse regions based on a region growing method over the Triangulated Irregular Network (TIN) model. The region label IDs are then projected to a 2D grid map, which is used to refine the roof regions and their boundaries. We design an energy optimization approach on the label map to optimize the region labels. In order to regularize the contours of roof regions extracted from the label map, we propose a new method for refining contour segment vertices, which iteratively filters the normals of contour segments and uses them to guide the update of contour vertices. The effectiveness of this method is evaluated on LiDAR point clouds from different scenes, and its performance is validated by extensive comparisons to state-of-the-art techniques. Numéro de notice : A2019-267 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2019.06.003 date de publication en ligne : 11/06/2019 En ligne : https://doi.org/10.1016/j.isprsjprs.2019.06.003 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=93082 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2019081	RAB	Revue	Centre de documentation	En réserve 3L	Disponible
081-2019083	DEP-RECP	Revue	MATIS	Dépôt en unité	Exclu du prêt
081-2019082	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Robust structure from motion based on relative rotations and tie points / Xin Wang in Photogrammetric Engineering & Remote Sensing, PERS, vol 85 n° 5 (May 2019)  

Permalink

Structure from motion for ordered and unordered image sets based on random k-d forests and global pose estimation / Xin Wang in ISPRS Journal of photogrammetry and remote sensing, vol 147 (January 2019)  

Permalink

A higher order conditional random field model for simultaneous classification of land cover and land use / Lena Albert in ISPRS Journal of photogrammetry and remote sensing, vol 130 (August 2017)  

Permalink

IV-1/W1 - ISPRS Hannover Workshop: HRIGI 17 – CMRT 17 – ISA 17 – EuroCOW 17, 6–9 June 2017, Hannover, Germany (Bulletin de ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-1/W1 [30/05/2017]) / Christian Heipke  

Permalink

Information from imagery: ISPRS scientific vision and research agenda / Jun Chen in ISPRS Journal of photogrammetry and remote sensing, vol 115 (May 2016)  

Permalink

vol 115 - May 2016 - State-of-the-art in photogrammetry, remote sensing and spatial information science (Bulletin de ISPRS Journal of photogrammetry and remote sensing) / Christian Heipke  

Permalink

II-3 W4 - March 2015 - [actes] PIA15+HRIGI15 Joint ISPRS conference, 25 - 27 March 2015; Munich, Germany (Bulletin de ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences) / Uwe Stilla  

Permalink

vol 100 - February 2015 - High-resolution Earth imaging for geospatial information (Bulletin de ISPRS Journal of photogrammetry and remote sensing) / Christian Heipke  

Permalink

An overview of close-range photogrammetry in France / Raphaële Heno in Revue Française de Photogrammétrie et de Télédétection, n° 200 (Novembre 2012)  

Permalink

Matching of straight line segments from aerial stereo images of urban areas / A. Ok in ISPRS Journal of photogrammetry and remote sensing, vol 74 (Novembrer 2012)

Permalink