Centre dedocumentation
scientifique

Pose estimation and 3D reconstruction of vehicles from stereo-images using a subcategory-aware shape prior / Maximilian Alexander Coenen in ISPRS Journal of photogrammetry and remote sensing, Vol 181 (November 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > Vol 181 (November 2021) . - pp 27 - 47 Titre : Pose estimation and 3D reconstruction of vehicles from stereo-images using a subcategory-aware shape prior Type de document : Article/Communication Auteurs : Maximilian Alexander Coenen, Auteur ; Franz Rottensteiner, Auteur Année de publication : 2021 Article en page(s) : pp 27 - 47 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] détection d'objet [Termes IGN] estimation de pose [Termes IGN] modèle stochastique [Termes IGN] problème inverse [Termes IGN] reconstruction 3D [Termes IGN] reconstruction d'objet [Termes IGN] robotique [Termes IGN] véhicule automobile [Termes IGN] vision par ordinateur Résumé : (auteur) The 3D reconstruction of objects is a prerequisite for many highly relevant applications of computer vision such as mobile robotics or autonomous driving. To deal with the inverse problem of reconstructing 3D objects from their 2D projections, a common strategy is to incorporate prior object knowledge into the reconstruction approach by establishing a 3D model and aligning it to the 2D image plane. However, current approaches are limited due to inadequate shape priors and the insufficiency of the derived image observations for a reliable alignment with the 3D model. The goal of this paper is to show how 3D object reconstruction can profit from a more sophisticated shape prior and from a combined incorporation of different observation types inferred from the images. We introduce a subcategory-aware deformable vehicle model that makes use of a prediction of the vehicle type for a more appropriate regularisation of the vehicle shape. A multi-branch CNN is presented to derive predictions of the vehicle type and orientation. This information is also introduced as prior information for model fitting. Furthermore, the CNN extracts vehicle keypoints and wireframes, which are well-suited for model-to-image association and model fitting. The task of pose estimation and reconstruction is addressed by a versatile probabilistic model. Extensive experiments are conducted using two challenging real-world data sets on both of which the benefit of the developed shape prior can be shown. A comparison to state-of-the-art methods for vehicle pose estimation shows that the proposed approach performs on par or better, confirming the suitability of the developed shape prior and probabilistic model for vehicle reconstruction. Numéro de notice : A2021-772 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.07.006 Date de publication en ligne : 14/09/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.07.006 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98829 [article]

A hierarchical deep learning framework for the consistent classification of land use objects in geospatial databases / Chun Yang in ISPRS Journal of photogrammetry and remote sensing, vol 177 (July 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 177 (July 2021) . - pp 38 - 56 Titre : A hierarchical deep learning framework for the consistent classification of land use objects in geospatial databases Type de document : Article/Communication Auteurs : Chun Yang, Auteur ; Franz Rottensteiner, Auteur ; Christian Heipke, Auteur Année de publication : 2021 Article en page(s) : pp 38 - 56 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Bases de données localisées [Termes IGN] Allemagne [Termes IGN] apprentissage profond [Termes IGN] approche hiérarchique [Termes IGN] classification automatique d'objets [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] image aérienne [Termes IGN] jointure [Termes IGN] objet géographique [Termes IGN] occupation du sol [Termes IGN] optimisation (mathématiques) [Termes IGN] utilisation du sol Résumé : (Auteur) Land use as contained in geospatial databases constitutes an essential input for different applications such as urban management, regional planning and environmental monitoring. In this paper, a hierarchical deep learning framework is proposed to verify the land use information. For this purpose, a two-step strategy is applied. First, given high-resolution aerial images, the land cover information is determined. To achieve this, an encoder-decoder based convolutional neural network (CNN) is proposed. Second, the pixel-wise land cover information along with the aerial images serves as input for another CNN to classify land use. Because the object catalogue of geospatial databases is frequently constructed in a hierarchical manner, we propose a new CNN-based method aiming to predict land use in multiple levels hierarchically and simultaneously. A so called Joint Optimization (JO) is proposed where predictions are made by selecting the hierarchical tuple over all levels which has the maximum joint class scores, providing consistent results across the different levels. The conducted experiments show that the CNN relying on JO outperforms previous results, achieving an overall accuracy up to 92.5%. In addition to the individual experiments on two test sites, we investigate whether data showing different characteristics can improve the results of land cover and land use classification, when processed together. To do so, we combine the two datasets and undertake some additional experiments. The results show that adding more data helps both land cover and land use classification, especially the identification of underrepresented categories, despite their different characteristics. Numéro de notice : A2021-370 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE/IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.04.022 Date de publication en ligne : 13/05/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.04.022 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97774 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2021071	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2021073	DEP-RECP	Revue	LaSTIG	Dépôt en unité	Exclu du prêt
081-2021072	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Feature detection and description for image matching: from hand-crafted design to deep learning / Lin Chen in Geo-spatial Information Science, vol 24 n° 1 (March 2021)  

Public [article]  inGeo-spatial Information Science > vol 24 n° 1 (March 2021) . - pp 58 - 74 Titre : Feature detection and description for image matching: from hand-crafted design to deep learning Type de document : Article/Communication Auteurs : Lin Chen, Auteur ; Franz Rottensteiner, Auteur ; Christian Heipke, Auteur Année de publication : 2021 Article en page(s) : pp 58 - 74 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement automatique [Termes IGN] appariement d'images [Termes IGN] appariement de formes [Termes IGN] apprentissage automatique [Termes IGN] apprentissage profond [Termes IGN] extraction de traits caractéristiques [Termes IGN] image aérienne oblique [Termes IGN] orientation d'image [Termes IGN] SIFT (algorithme) Résumé : (Auteur) In feature based image matching, distinctive features in images are detected and represented by feature descriptors. Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate points. In this paper, we first shortly discuss the general framework. Then, we review feature detection as well as the determination of affine shape and orientation of local features, before analyzing feature description in more detail. In the feature description review, the general framework of local feature description is presented first. Then, the review discusses the evolution from hand-crafted feature descriptors, e.g. SIFT (Scale Invariant Feature Transform), to machine learning and deep learning based descriptors. The machine learning models, the training loss and the respective training data of learning-based algorithms are looked at in more detail; subsequently the various advantages and challenges of the different approaches are discussed. Finally, we present and assess some current research directions before concluding the paper. Numéro de notice : A2021-297 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1080/10095020.2020.1843376 Date de publication en ligne : 17/11/2020 En ligne : https://doi.org/10.1080/10095020.2020.1843376 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97379 [article]

Deep learning for geometric and semantic tasks in photogrammetry and remote sensing / Christian Helpke in Geo-spatial Information Science, vol 23 n° 1 (March 2020)  

Public [article]  inGeo-spatial Information Science > vol 23 n° 1 (March 2020) . - pp 10 - 19 Titre : Deep learning for geometric and semantic tasks in photogrammetry and remote sensing Type de document : Article/Communication Auteurs : Christian Helpke, Auteur ; Franz Rottensteiner, Auteur Année de publication : 2020 Article en page(s) : pp 10 - 19 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image [Termes IGN] apprentissage automatique [Termes IGN] apprentissage profond [Termes IGN] approche géométrique [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] image aérienne [Termes IGN] intelligence artificielle [Termes IGN] photogrammétrie numérique [Termes IGN] télédétection Résumé : (auteur) During the last few years, artificial intelligence based on deep learning, and particularly based on convolutional neural networks, has acted as a game changer in just about all tasks related to photogrammetry and remote sensing. Results have shown partly significant improvements in many projects all across the photogrammetric processing chain from image orientation to surface reconstruction, scene classification as well as change detection, object extraction and object tracking and recognition in image sequences. This paper summarizes the foundations of deep learning for photogrammetry and remote sensing before illustrating, by way of example, different projects being carried out at the Institute of Photogrammetry and GeoInformation, Leibniz University Hannover, in this exciting and fast moving field of research and development. Numéro de notice : A2020-161 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1080/10095020.2020.1718003 Date de publication en ligne : 03/02/2020 En ligne : https://doi.org/https://doi.org/10.1080/10095020.2020.1718003 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=94821 [article]

Modelling of buildings from aerial LiDAR point clouds using TINs and label maps / Minglei Li in ISPRS Journal of photogrammetry and remote sensing, vol 154 (August 2019)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 154 (August 2019) . - pp 127 - 138 Titre : Modelling of buildings from aerial LiDAR point clouds using TINs and label maps Type de document : Article/Communication Auteurs : Minglei Li, Auteur ; Franz Rottensteiner, Auteur ; Christian Heipke, Auteur Année de publication : 2019 Article en page(s) : pp 127 - 138 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] modèle numérique du bâti [Termes IGN] semis de points [Termes IGN] toit [Termes IGN] Triangulated Irregular Network Résumé : (Auteur) This paper presents a new framework for automatically creating compact building models from aerial LiDAR point clouds, where each point is known to belong to the class building. The approach addresses the issues of non-uniform point density and outlier detection to extract and refine semantic roof structures by a sequence of operations on a label map. We first partition the points into some coarse regions based on a region growing method over the Triangulated Irregular Network (TIN) model. The region label IDs are then projected to a 2D grid map, which is used to refine the roof regions and their boundaries. We design an energy optimization approach on the label map to optimize the region labels. In order to regularize the contours of roof regions extracted from the label map, we propose a new method for refining contour segment vertices, which iteratively filters the normals of contour segments and uses them to guide the update of contour vertices. The effectiveness of this method is evaluated on LiDAR point clouds from different scenes, and its performance is validated by extensive comparisons to state-of-the-art techniques. Numéro de notice : A2019-267 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2019.06.003 Date de publication en ligne : 11/06/2019 En ligne : https://doi.org/10.1016/j.isprsjprs.2019.06.003 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=93082 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2019081	RAB	Revue	Centre de documentation	En réserve 3L	Disponible
081-2019083	DEP-RECP	Revue	LaSTIG	Dépôt en unité	Exclu du prêt
081-2019082	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Robust structure from motion based on relative rotations and tie points / Xin Wang in Photogrammetric Engineering & Remote Sensing, PERS, vol 85 n° 5 (May 2019)  

Permalink

Structure from motion for ordered and unordered image sets based on random k-d forests and global pose estimation / Xin Wang in ISPRS Journal of photogrammetry and remote sensing, vol 147 (January 2019)  

Permalink

A higher order conditional random field model for simultaneous classification of land cover and land use / Lena Albert in ISPRS Journal of photogrammetry and remote sensing, vol 130 (August 2017)  

Permalink

IV-1/W1 - ISPRS Hannover Workshop: HRIGI 17 – CMRT 17 – ISA 17 – EuroCOW 17, 6–9 June 2017, Hannover, Germany (Bulletin de ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-1/W1 [30/05/2017]) / Christian Heipke  

Permalink

III-3 - July 2016 - [actes] XXIII ISPRS Congress, Commission III, 12–19 July 2016, Prague, Czech Republic (Bulletin de ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences) / Lena Halounova  

Permalink

Information from imagery: ISPRS scientific vision and research agenda / Jun Chen in ISPRS Journal of photogrammetry and remote sensing, vol 115 (May 2016)  

Permalink

23th ISPRS international congress, 3. Commission III / Lena Halounova (2016)  

Permalink

II-3 W5 - October 2015 - [actes] ISPRS Geospatial Week 2015, 28 September–3 October 2015, La Grande Motte, France (Bulletin de ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences) / Clément Mallet  

Permalink

Contextual classification of point cloud data by exploiting individual 3d neigbourhoods / Martin Weinmann in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, II-3 W4 (March 2015)    

Permalink

vol 100 - February 2015 - High-resolution Earth imaging for geospatial information (Bulletin de ISPRS Journal of photogrammetry and remote sensing) / Christian Heipke  

Permalink