Centre dedocumentation
scientifique

3D building reconstruction from single street view images using deep learning / Hui En Pang in International journal of applied Earth observation and geoinformation, vol 112 (August 2022)  

Public [article]  inInternational journal of applied Earth observation and geoinformation > vol 112 (August 2022) . - n° 102859 Titre : 3D building reconstruction from single street view images using deep learning Type de document : Article/Communication Auteurs : Hui En Pang, Auteur ; Filip Biljecki, Auteur Année de publication : 2022 Article en page(s) : n° 102859 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] empreinte [Termes IGN] Helsinki [Termes IGN] image Streetview [Termes IGN] maillage [Termes IGN] morphologie urbaine [Termes IGN] précision géométrique (imagerie) [Termes IGN] reconstruction 3D du bâti [Termes IGN] segmentation d'image [Termes IGN] semis de points Résumé : (auteur) 3D building models are an established instance of geospatial information in the built environment, but their acquisition remains complex and topical. Approaches to reconstruct 3D building models often require existing building information (e.g. their footprints) and data such as point clouds, which are scarce and laborious to acquire, limiting their expansion. In parallel, street view imagery (SVI) has been gaining currency, driven by the rapid expansion in coverage and advances in computer vision (CV), but it has not been used much for generating 3D city models. Traditional approaches that can use SVI for reconstruction require multiple images, while in practice, often only few street-level images provide an unobstructed view of a building. We develop the reconstruction of 3D building models from a single street view image using image-to-mesh reconstruction techniques modified from the CV domain. We regard three scenarios: (1) standalone single-view reconstruction; (2) reconstruction aided by a top view delineating the footprint; and (3) refinement of existing 3D models, i.e. we examine the use of SVI to enhance the level of detail of block (LoD1) models, which are common. The results suggest that trained models supporting (2) and (3) are able to reconstruct the overall geometry of a building, while the first scenario may derive the approximate mass of the building, useful to infer the urban form of cities. We evaluate the results by demonstrating their usefulness for volume estimation, with mean errors of less than 10% for the last two scenarios. As SVI is now available in most countries worldwide, including many regions that do not have existing footprint and/or 3D building data, our method can derive rapidly and cost-effectively the 3D urban form from SVI without requiring any existing building information. Obtaining 3D building models in regions that hitherto did not have any, may enable a number of 3D geospatial analyses locally for the first time. Numéro de notice : A2022-544 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1016/j.jag.2022.102859 Date de publication en ligne : 17/06/2022 En ligne : https://doi.org/10.1016/j.jag.2022.102859 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101160 [article]

DiffusionNet: discretization agnostic learning on surfaces / Nicholas Sharp in ACM Transactions on Graphics, TOG, Vol 41 n° 3 (June 2022)  

Public [article]  inACM Transactions on Graphics, TOG > Vol 41 n° 3 (June 2022) . - pp 1 - 16 Titre : DiffusionNet: discretization agnostic learning on surfaces Type de document : Article/Communication Auteurs : Nicholas Sharp, Auteur ; Souhaib Attaiki, Auteur ; K. Crane, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : pp 1 - 16 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Intelligence artificielle [Termes IGN] apprentissage profond [Termes IGN] discrétisation [Termes IGN] maillage [Termes IGN] Perceptron multicouche [Termes IGN] semis de points [Termes IGN] Triangular Regular Network [Termes IGN] voisinage (relation topologique) Résumé : (auteur) We introduce a new general-purpose approach to deep learning on three-dimensional surfaces based on the insight that a simple diffusion layer is highly effective for spatial communication. The resulting networks are automatically robust to changes in resolution and sampling of a surface—a basic property that is crucial for practical applications. Our networks can be discretized on various geometric representations, such as triangle meshes or point clouds, and can even be trained on one representation and then applied to another. We optimize the spatial support of diffusion as a continuous network parameter ranging from purely local to totally global, removing the burden of manually choosing neighborhood sizes. The only other ingredients in the method are a multi-layer perceptron applied independently at each point and spatial gradient features to support directional filters. The resulting networks are simple, robust, and efficient. Here, we focus primarily on triangle mesh surfaces and demonstrate state-of-the-art results for a variety of tasks, including surface classification, segmentation, and non-rigid correspondence. Numéro de notice : A2022-321 Affiliation des auteurs : non IGN Thématique : IMAGERIE/INFORMATIQUE Nature : Article DOI : 10.1145/3507905 Date de publication en ligne : 07/03/2022 En ligne : https://doi.org/10.1145/3507905 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100369 [article]

Summarizing large scale 3D mesh for urban navigation / Imeen Ben Salah in Robotics and autonomous systems, vol 152 (June 2022)  

Public [article]  inRobotics and autonomous systems > vol 152 (June 2022) . - n° 104037 Titre : Summarizing large scale 3D mesh for urban navigation Type de document : Article/Communication Auteurs : Imeen Ben Salah, Auteur ; Sébastien Kramm, Auteur ; Cédric Demonceaux, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : n° 104037 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] algorithme ICP [Termes IGN] carte en 3D [Termes IGN] données lidar [Termes IGN] entropie [Termes IGN] image hémisphérique [Termes IGN] image RVB [Termes IGN] information sémantique [Termes IGN] localisation basée vision [Termes IGN] maillage [Termes IGN] navigation autonome [Termes IGN] précision géométrique (imagerie) [Termes IGN] précision radiométrique [Termes IGN] profondeur [Termes IGN] Rouen [Termes IGN] saillance [Termes IGN] zone urbaine Résumé : (auteur) Cameras have become increasingly common in vehicles, smartphones, and advanced driver assistance systems. The areas of application of these cameras in the world of intelligent transportation systems are becoming more and more varied: pedestrian detection, line crossing detection, navigation, …A major area of research currently focuses on mapping that is essential for localization and navigation. However, this step generates an important problem of memory management. Indeed, the memory space required to accommodate the map of a small city is measured in tens gigabytes. In addition, several providers today are competing to produce High-Definition (HD) maps. These maps offer a rich and detailed representation of the environment for highly accurate localization. However, they require a large storage capacity and high transmission and update costs. To overcome these problems, we propose a solution to summarize this type of map by reducing the size while maintaining the relevance of the data for navigation based on vision only. The summary consists in a set of spherical images augmented by depth and semantic information and allowing to keep the same level of visibility in every directions. These spheres are used as landmarks to offer guidance information to a distant agent. They then have to guarantee, at a lower cost, a good level of precision and speed during navigation. Some experiments on real data demonstrate the feasibility for obtaining a summarized map while maintaining a localization with interesting performances. Numéro de notice : A2022-290 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1016/j.robot.2022.104037 Date de publication en ligne : 03/02/2022 En ligne : https://doi.org/10.1016/j.robot.2022.104037 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100335 [article]

Semantic segmentation of urban textured meshes through point sampling / Grégoire Grzeczkowicz in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol V-2-2022 (2022 edition)  

Public [article]  inISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences > vol V-2-2022 (2022 edition) . - pp 177 - 184 Titre : Semantic segmentation of urban textured meshes through point sampling Type de document : Article/Communication Auteurs : Grégoire Grzeczkowicz, Auteur ; Bruno Vallet , Auteur Année de publication : 2022 Projets : 1-Pas de projet / Article en page(s) : pp 177 - 184 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications photogrammétriques [Termes IGN] échantillonnage de données [Termes IGN] maillage [Termes IGN] maille carrée [Termes IGN] maille texturée [Termes IGN] maille triangulaire [Termes IGN] scène urbaine [Termes IGN] segmentation sémantique [Termes IGN] semis de points [Termes IGN] traitement de semis de points Résumé : (auteur) Textured meshes are becoming an increasingly popular representation combining the 3D geometry and radiometry of real scenes. However, semantic segmentation algorithms for urban mesh have been little investigated and do not exploit all radiometric information. To address this problem, we adopt an approach consisting in sampling a point cloud from the textured mesh, then using a point cloud semantic segmentation algorithm on this cloud, and finally using the obtained semantic to segment the initial mesh. In this paper, we study the influence of different parameters such as the sampling method, the density of the extracted cloud, the features selected (color, normal, elevation) as well as the number of points used at each training period. Our result outperforms the state-of-the-art on the SUM dataset, earning about 4 points in OA and 18 points in mIoU. Numéro de notice : A2022-427 Affiliation des auteurs : UGE-LASTIG (2020- ) Thématique : IMAGERIE/INFORMATIQUE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.5194/isprs-annals-V-2-2022-177-2022 Date de publication en ligne : 17/05/2022 En ligne : https://doi.org/10.5194/isprs-annals-V-2-2022-177-2022 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100733 [article]

3D building model simplification method considering both model mesh and building structure / Jiangfeng She in Transactions in GIS, vol 26 n° 3 (May 2022)  

Public [article]  inTransactions in GIS > vol 26 n° 3 (May 2022) . - pp 1182 - 1203 Titre : 3D building model simplification method considering both model mesh and building structure Type de document : Article/Communication Auteurs : Jiangfeng She, Auteur ; Bo Chen, Auteur ; Junzhong Tan, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : pp 1182 - 1203 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Géomatique [Termes IGN] contour [Termes IGN] contrainte géométrique [Termes IGN] empreinte [Termes IGN] maillage [Termes IGN] maillage par triangles [Termes IGN] modélisation 3D du bâti BIM [Termes IGN] saillance [Termes IGN] simplification de maillage [Termes IGN] simplification de surface Résumé : (auteur) The simplification of three-dimensional (3D) building models to improve rendering efficiency has gained widespread attention. To maintain the model's overall appearance features while increasing the simplification rate, we propose a novel 3D building simplification method that considers both the model mesh and building structure. The method divides a 3D building into a primary structure and subsidiary structures. It then organizes these structures using StructureTree, a multi-way tree. The structures are organized according to the dependency relationships between building structures. When simplifying a building, the decision whether to simplify the mesh or remove the subsidiary structure in the leaf node of the StructureTree depends on the volume change caused by the edge collapse and the visual saliency of the removed structure. The experimental results show that our method exhibits a better simplification effect than the traditional simplification method, and the proposed method can achieve a high simplification rate while maintaining the simplification quality. Furthermore, the results of some spatial analyses based on the highly simplified building model are consistent with those of the original model. Numéro de notice : A2022-464 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE Nature : Article DOI : https://doi.org/10.1111/tgis.12907 Date de publication en ligne : 14/02/2022 En ligne : https://doi.org/10.1111/tgis.12907 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100792 [article]

GeoRec: Geometry-enhanced semantic 3D reconstruction of RGB-D indoor scenes / Linxi Huan in ISPRS Journal of photogrammetry and remote sensing, vol 186 (April 2022)  

Permalink

A cost-effective method for reconstructing city-building 3D models from sparse Lidar point clouds / Marek Kulawiak in Remote sensing, vol 14 n° 5 (March-1 2022)  

Permalink

Using vertices of a triangular irregular network to calculate slope and aspect / Guanghui Hu in International journal of geographical information science IJGIS, vol 36 n° 2 (February 2022)  

Permalink

Multi-layer modeling of dense vegetation from aerial LiDAR scans / Ekaterina Kalinicheva (2022)  

Permalink

Detection of periodic displacements of shell structures with edges using spline surfaces, meshes and point clouds / Grzegorz Lenda in Reports on geodesy and geoinformatics, vol 112 n° 1 (December 2021)  

Permalink

Structure-aware indoor scene reconstruction via two levels of abstraction / Hao Fang in ISPRS Journal of photogrammetry and remote sensing, vol 178 (August 2021)  

Permalink

Vectorized indoor surface reconstruction from 3D point cloud with multistep 2D optimization / Jiali Han in ISPRS Journal of photogrammetry and remote sensing, vol 177 (July 2021)  

Permalink

Structure-aware completion of photogrammetric meshes in urban road environment / Qing Zhu in ISPRS Journal of photogrammetry and remote sensing, vol 175 (May 2021)  

Permalink

Dynamic human body reconstruction and motion tracking with low-cost depth cameras / Kangkan Wang in The Visual Computer, vol 37 n° 3 (March 2021)  

Permalink

Minimum-error world map projections defined by polydimensional meshes / Justin H. Kunimune in International journal of cartography, vol 7 n° 1 (March 2021)  

Permalink