Centre dedocumentation
scientifique

Vectorized indoor surface reconstruction from 3D point cloud with multistep 2D optimization / Jiali Han in ISPRS Journal of photogrammetry and remote sensing, vol 177 (July 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 177 (July 2021) . - pp 57 - 74 Titre : Vectorized indoor surface reconstruction from 3D point cloud with multistep 2D optimization Type de document : Article/Communication Auteurs : Jiali Han, Auteur ; Mengqi Rong, Auteur ; Hanqing Jiang, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 57 - 74 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] champ aléatoire de Markov [Termes IGN] données lidar [Termes IGN] espace intérieur [Termes IGN] maillage [Termes IGN] programmation linéaire [Termes IGN] Ransac (algorithme) [Termes IGN] reconstruction 3D [Termes IGN] reconstruction d'objet [Termes IGN] segmentation sémantique [Termes IGN] semis de points [Termes IGN] vectorisation Résumé : (Auteur) Vectorized reconstruction from indoor point cloud has attracted increasing attention in recent years due to its high regularity and low memory consumption. Compared with aerial mapping of outdoor urban environments, indoor point cloud generated by LiDAR scanning or image-based 3D reconstruction usually contain more clutter and missing areas, which greatly increase the difficulty of vectorized reconstruction. In this paper, we propose an effective multistep pipeline to reconstruct vectorized models from indoor point cloud without the Manhattan or Atlanta world assumptions. The core idea behind our method is the combination of a sequence of 2D segment or cell assembly problems that are defined as global optimizations while reducing the reconstruction complexity and enhancing the robustness to different scenes. The proposed method includes a semantic segmentation stage and a reconstruction stage. First, we segment the permanent structures of indoor scenes, including ceilings, floors, walls and cylinders, from the input data, and then, we reconstruct these structures in sequence. The floorplan is first generated by detecting wall planes and selecting optimal subsets of projected wall segments with Integer Linear Programming (ILP), followed by constructing a 2D arrangement and recovering the ceiling and floor structures by Markov Random Field (MRF) labeling on the arrangement. Finally, the wall structures are modeled by lifting each edge of the arrangement to a proper height by means of another global optimization. Merging the respective results yields the final model. The experimental results show that the proposed method could obtain accurate and compact vectorized models on both precise LiDAR data and defect-laden MVS data compared with other state-of-the-art approaches. Numéro de notice : A2021-371 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.04.019 date de publication en ligne : 15/05/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.04.019 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97779 [article]

Integration of laser scanner and photogrammetry for heritage BIM enhancement / Yahya Alshawabkeh in ISPRS International journal of geo-information, vol 10 n° 5 (May 2021)  

Public [article]  inISPRS International journal of geo-information > vol 10 n° 5 (May 2021) . - n° 316 Titre : Integration of laser scanner and photogrammetry for heritage BIM enhancement Type de document : Article/Communication Auteurs : Yahya Alshawabkeh, Auteur ; Ahmad Baik, Auteur ; Yehia Miky, Auteur Année de publication : 2021 Article en page(s) : n° 316 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications photogrammétriques [Termes IGN] algorithme ICP [Termes IGN] Djeddah [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] données TLS (télémétrie) [Termes IGN] image captée par drone [Termes IGN] lasergrammétrie [Termes IGN] modélisation 3D du bâti BIM [Termes IGN] monument historique [Termes IGN] ombre [Termes IGN] reconstruction d'objet [Termes IGN] semis de points Résumé : (auteur) Digital 3D capture and reliable reproduction of architectural features is the first and most difficult step towards defining a heritage BIM. Three-dimensional digital survey technologies, such as TLS and photogrammetry, enable experts to scan buildings with a new level of detail. Challenges in the tracing of parametric objects in a TLS point cloud include the reconstruction of occluded parts, measurement of uncertainties relevant to surface reflectivity, and edge detection and location. In addition to image-based techniques being considered cost effective, highly flexible, and efficient in producing a high-quality 3D textured model, they also provide a better interpretation of surface linear characteristics. This article addresses an architecture survey workflow using photogrammetry and TLS to optimize a point cloud that is sufficient for a reliable HBIM. Fusion-based workflows were proposed during the recording of two heritage sites—the Matbouli House Museum in Historic Jeddah, a UNESCO World Heritage Site; and Asfan Castle. In the Matbouli House Museum building, which is rich with complex architectural features, multi-sensor recording was implemented at different resolutions and levels of detail. The TLS data were used to reconstruct the basic shape of the main structural elements, while the imagery’s superior radiometric data and accessibility were effectively used to enhance the TLS point clouds for improving the geometry, data interpretation, and parametric tracing of irregular objects in the facade. Furthermore, in the workflow that is considered to be the ragged terrain of the Castle of Asfan, here, the TLS point cloud was supplemented with UAV data in the upper building zones where the shadow data originated. Both datasets were registered using an ICP algorithm to scale the photogrammetric data and define their actual position in the construction system. The hybrid scans were imported and processed in the BIM environment. The building components were segmented and classified into regular and irregular surfaces, in order to perform detailed building information modeling of the architectural elements. The proposed workflows demonstrated an appropriate performance in terms of reliable and complete BIM mapping in the complex structures. Numéro de notice : A2021-393 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.3390/ijgi10050316 date de publication en ligne : 08/05/2021 En ligne : https://doi.org/10.3390/ijgi10050316 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97678 [article]

Structure-aware completion of photogrammetric meshes in urban road environment / Qing Zhu in ISPRS Journal of photogrammetry and remote sensing, vol 175 (May 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 175 (May 2021) . - pp 56 - 70 Titre : Structure-aware completion of photogrammetric meshes in urban road environment Type de document : Article/Communication Auteurs : Qing Zhu, Auteur ; Qisen Shang, Auteur ; Han Hu, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 56 - 70 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] détection d'objet [Termes IGN] détection de partie cachée [Termes IGN] espace urbain [Termes IGN] image aérienne oblique [Termes IGN] maillage [Termes IGN] modélisation 3D [Termes IGN] reconstruction de route [Termes IGN] réseau routier [Termes IGN] texture Résumé : (auteur) Photogrammetric mesh models obtained from aerial oblique images have been widely used for urban reconstruction. However, photogrammetric meshes suffer from severe texture problems, particularly in typical road areas, owing to occlusion. This paper proposes a structure-aware completion approach to improve mesh quality by seamlessly removing undesired vehicles. Specifically, a discontinuous texture atlas is first integrated into a continuous screen space by rendering trough a graphics pipeline. The rendering also records the necessary mapping for deintegration to the original texture atlas after editing. Vehicle regions are masked by a standard object detection approach, namely, Faster RCNN. Subsequently, the masked regions are completed, guided by the linear structures and regularities in the road region; this is implemented based on PatchMatch. Finally, the completed rendered image is deintegrated to the original texture atlas, and the triangles for the vehicles are also flattened so that improved meshes can be obtained. Experimental evaluation and analysis are conducted on three datasets, which were captured with different sensors and ground sample distances. The results demonstrate that the proposed method can produce quite realistic meshes after removing the vehicles. The structure-aware completion approach for road regions outperforms popular image completion methods, and an ablation study further confirms the effectiveness of the linear guidance. It should be noted that the proposed method can also handle tiled mesh models for large-scale scenes. Code and datasets are available at the project website. Numéro de notice : A2021-263 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.02.010 date de publication en ligne : 11/03/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.02.010 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97312 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2021051	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2021052	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt
081-2021053	DEP-RECP	Revue	Saint-Mandé	Dépôt en unité	Exclu du prêt

Dynamic human body reconstruction and motion tracking with low-cost depth cameras / Kangkan Wang in The Visual Computer, vol 37 n° 3 (March 2021)  

Public [article]  inThe Visual Computer > vol 37 n° 3 (March 2021) . - pp 603 - 618 Titre : Dynamic human body reconstruction and motion tracking with low-cost depth cameras Type de document : Article/Communication Auteurs : Kangkan Wang, Auteur ; Guofeng Zhang, Auteur ; Jian Yang, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 603 - 618 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement de formes [Termes IGN] déformation de projection [Termes IGN] données d'apprentissage [Termes IGN] filtrage spatiotemporel [Termes IGN] maillage [Termes IGN] modèle dynamique [Termes IGN] modélisation 3D [Termes IGN] mouvement [Termes IGN] objet mobile [Termes IGN] reconstruction d'objet [Termes IGN] squelettisation Résumé : (auteur) We present a novel approach for dynamic human body reconstruction and motion tracking using low-cost depth cameras. Our reconstruction system is able to produce a sequence of dynamic 3D human body models from the noisy input depth data. To accurately align the template model with noisy input data, we combine skeleton-driven deformation and mesh deformation techniques to enhance the registration robustness to depth missing, occlusions, and severe noise. In addition, a novel data-driven 3D human body model is introduced to efficiently reconstruct human body models with wide shape and pose variations only using a limited number of training databases with standard standing pose. We perform quantitative and qualitative experiments to evaluate our method and compare it with other methods for body reconstruction on both synthetic and real datasets. Experimental results demonstrate the effectiveness of the proposed approach. Numéro de notice : A2021-341 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1007/s00371-020-01826-4 date de publication en ligne : 26/02/2020 En ligne : https://doi.org/10.1007/s00371-020-01826-4 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97579 [article]

From point clouds to high-fidelity models - advanced methods for image-based 3D reconstruction / Audrey Richard (2021)  

Public Titre : From point clouds to high-fidelity models - advanced methods for image-based 3D reconstruction Type de document : Thèse/HDR Auteurs : Audrey Richard, Auteur Editeur : Zurich : Eidgenossische Technische Hochschule ETH - Ecole Polytechnique Fédérale de Zurich EPFZ Année de publication : 2021 Note générale : bibliographie A thesis submitted to attain the degree of Doctor of Sciences of ETH Zurich Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] chaîne de traitement [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] compréhension de l'image [Termes IGN] démonstration de faisabilité [Termes IGN] discrétisation spatiale [Termes IGN] Dortmund [Termes IGN] Enschede (Pays-Bas) [Termes IGN] jeu de données localisées [Termes IGN] modèle 3D de l'espace urbain [Termes IGN] modélisation sémantique [Termes IGN] optimisation (mathématiques) [Termes IGN] reconstruction 3D [Termes IGN] reconstruction d'objet [Termes IGN] texturage [Termes IGN] Zurich (Suisse) Résumé : (auteur) Capturing automatically a virtual 3D model of an object or a scene from a collection of images is a useful capability with a wide range of applications, including virtual/augmented reality, heritage preservation, consumer digital entertainment, autonomous robotics, navigation, industrial vision or metrology, and many more. Since the early days of photogrammetry and computer vision, it has been a topic of intensive research but has eluded a general solution for it. 3D modeling requires more than reconstructing a cloud of 3D points from images; it requires a high-fidelity representation whose form is often dependent on individual objects. This thesis guides you in the journey of image-based 3D reconstruction through several advanced methods that aims to push its boundaries, from precise and complete geometry to detailed appearance, using both theory with elegant mathematics and more recent breakthroughs in deep learning. To evaluate these methods, thorough experiments are conducted at scene level (and large-scale) where efficiency is of key importance, and at object level where accuracy, completeness and photorealism can be better appreciated. To show the individual potential of each of these methods, as well as the possible wide coverage in terms of applications, different scenarios are considered and serve as a proof-of-concept. Thereby, the journey starts with large-scale city modeling using aerial photography from the cities of Zürich (Switzerland), Enschede (Netherlands) and Dortmund (Germany), followed by single object completion using the synthetic dataset ShapeNet, that includes objects like cars, benches or planes that can be found in every city, to finish with the embellishment of these digital models via high-resolution texture mapping using a multi-view 3D dataset of real and synthetic objects, like for example statues and fountains that also dress the landscape of cities. Combining them together into an incremental pipeline dedicated to a specific application would require further tailoring but is quite possible. Numéro de notice : 17650 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Thèse étrangère Note de thèse : PhD : Sciences : ETH Zurich : 2021 En ligne : http://dx.doi.org/10.3929/ethz-b-000461735 Format de la ressource électronique : URL Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97892

Underwater object detection and reconstruction based on active single-pixel imaging and super-resolution convolutional neural network / Mengdi Li in Sensors, vol 21 n° 1 (January 2021)  

Permalink

3D hand mesh reconstruction from a monocular RGB image / Hao Peng in The Visual Computer, vol 36 n° 10 - 12 (October 2020)  

Permalink

A point cloud feature regularization method by fusing judge criterion of field force / Xijiang Chen in IEEE Transactions on geoscience and remote sensing, vol 58 n° 5 (May 2020)  

Permalink

The "Incense Road" from Petra to Gaza: an analysis using GIS and Cost functions / Motti Zohar in International journal of geographical information science IJGIS, vol 34 n° 2 (February 2020)  

Permalink

Contribution à la segmentation et à la modélisation 3D du milieu urbain à partir de nuages de points / Tania Landes (2020)  

Permalink

Simplicial complexes reconstruction and generalisation of 3d lidar data in urban scenes / Stéphane Guinard (2020)  

Permalink

Complete 3D scene parsing from an RGBD image / Chuhang Zou in International journal of computer vision, vol 127 n° 2 (February 2019)  

Permalink

Tile & merge: Distributed Delaunay triangulations for cloud computing / Laurent Caraffa (2019)  

Permalink

Visibility estimation in point clouds with variable density / Pierre Biasutti (2019)    

Permalink

Surface reconstruction of incomplete datasets: A novel Poisson surface approach based on CSRBF / Jules Morel in Computers and graphics, vol 74 (August 2018)  

Permalink