Centre dedocumentation
scientifique

Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms / Ningli Xu in ISPRS Open Journal of Photogrammetry and Remote Sensing, vol 8 (April 2023)  

Public [article]  inISPRS Open Journal of Photogrammetry and Remote Sensing > vol 8 (April 2023) . - n° 100032 Titre : Point cloud registration for LiDAR and photogrammetric data: A critical synthesis and performance analysis on classic and deep learning algorithms Type de document : Article/Communication Auteurs : Ningli Xu, Auteur ; Rongjun Qin, Auteur ; Shuang Song, Auteur Année de publication : 2023 Article en page(s) : n° 100032 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] algorithme ICP [Termes IGN] chevauchement [Termes IGN] données lidar [Termes IGN] processus gaussien [Termes IGN] recalage de données localisées [Termes IGN] semis de points [Termes IGN] superposition de données Résumé : (auteur) Three-dimensional (3D) point cloud registration is a fundamental step for many 3D modeling and mapping applications. Existing approaches are highly disparate in the data source, scene complexity, and application, therefore the current practices in various point cloud registration tasks are still ad-hoc processes. Recent advances in computer vision and deep learning have shown promising performance in estimating rigid/similarity transformation between unregistered point clouds of complex objects and scenes. However, their performances are mostly evaluated using a limited number of datasets from a single sensor (e.g. Kinect or RealSense cameras), lacking a comprehensive overview of their applicability in photogrammetric 3D mapping scenarios. In this work, we provide a comprehensive review of the state-of-the-art (SOTA) point cloud registration methods, where we analyze and evaluate these methods using a diverse set of point cloud data from indoor to satellite sources. The quantitative analysis allows for exploring the strengths, applicability, challenges, and future trends of these methods. In contrast to existing analysis works that introduce point cloud registration as a holistic process, our experimental analysis is based on its inherent two-step process to better comprehend these approaches including feature/keypoint-based initial coarse registration and dense fine registration through cloud-to-cloud (C2C) optimization. More than ten methods, including classic hand-crafted, deep-learning-based feature correspondence, and robust C2C methods were tested. We observed that the success rate of most of the algorithms are fewer than 40% over the datasets we tested and there are still are large margin of improvement upon existing algorithms concerning 3D sparse corresopondence search, and the ability to register point clouds with complex geometry and occlusions. With the evaluated statistics on three datasets, we conclude the best-performing methods for each step and provide our recommendations, and outlook future efforts. Numéro de notice : A2023-149 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.ophoto.2023.100032 Date de publication en ligne : 16/02/2023 En ligne : https://doi.org/10.1016/j.ophoto.2023.100032 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102808 [article]

A hierarchical multiview registration framework of TLS point clouds based on loop constraint / Hao Wu in ISPRS Journal of photogrammetry and remote sensing, vol 195 (January 2023)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 195 (January 2023) . - pp 65 - 76 Titre : A hierarchical multiview registration framework of TLS point clouds based on loop constraint Type de document : Article/Communication Auteurs : Hao Wu, Auteur ; Li Yan, Auteur ; Hong Xie, Auteur ; et al., Auteur Année de publication : 2023 Article en page(s) : pp 65 - 76 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] algorithme ICP [Termes IGN] appariement de points [Termes IGN] approche hiérarchique [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] graphe [Termes IGN] recalage d'image [Termes IGN] semis de points [Termes IGN] superposition de données [Termes IGN] traitement de semis de points Résumé : (auteur) Automatic registration of multiple point clouds is a significant preprocessing step for 3D computer vision tasks including semantic segmentation, 3D modelling, change detection, etc. Many methods were proposed to deal with this problem and yet most of them are not fully utilizing the redundant information offered by multiple common overlaps among point clouds. The existing methods are also inefficient when dealing with large-scale point clouds. In this paper, a novel automatic registration framework is presented to align point clouds efficiently and robustly. First, the overall number of scans is grouped into several scan-blocks by a proposed blocking strategy, and we build the pairwise relationship among scans through a fully connected graph in each scan-block. Second, perform loop-based coarse registration in each scan-block using a proposed false matches removal strategy. The proposed strategy can effectively identify grossly wrong scan-to-scan matches. Third, the minimum spanning tree is extracted from the graph, and ICP is applied along its edges. Moreover, the Lu–Milios algorithm is used to further optimize all poses at once by utilizing all redundant information in each scan-block. Finally, global block-to-block registration aligns all scan-blocks into a uniform coordinate reference. We test our framework on challenging WHU-TLS datasets, ETH datasets, and Robotic 3D Scan datasets to evaluate the efficiency, accuracy, as well as robustness. The experiment results show that our method achieves the state-of-the-art accuracy, while the time performance is improved by more than 30% compared with the state-of-the-art algorithms. Our source code is made available at https://github.com/WuHao-WHU/HL-MRF for benchmarking purposes. Numéro de notice : A2023-008 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.11.004 Date de publication en ligne : 19/11/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.11.004 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102112 [article]

Solid waste mapping based on very high resolution remote sensing imagery and a novel deep learning approach / Bowen Niu in Geocarto international, vol 38 n° 1 ([01/01/2023])  

Public [article]  inGeocarto international > vol 38 n° 1 [01/01/2023] . - n° 2164361 Titre : Solid waste mapping based on very high resolution remote sensing imagery and a novel deep learning approach Type de document : Article/Communication Auteurs : Bowen Niu, Auteur ; Quanlong Feng, Auteur ; Jianyu Yang, Auteur ; et al., Auteur Année de publication : 2023 Article en page(s) : n° 2164361 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications de télédétection [Termes IGN] cartographie thématique [Termes IGN] Chine [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] contour [Termes IGN] déchet [Termes IGN] fusion de données [Termes IGN] image à très haute résolution [Termes IGN] Inde [Termes IGN] Mexique [Termes IGN] urbanisation Résumé : (auteur) The urbanization worldwide leads to the rapid increase of solid waste, posing a threat to environment and people’s wellbeing. However, it is challenging to detect solid waste sites with high accuracy due to complex landscape, and very few studies considered solid waste mapping across multi-cities and in large areas. To tackle this issue, this study proposes a novel deep learning model for solid waste mapping from very high resolution remote sensing imagery. By integrating a multi-scale dilated convolutional neural network (CNN) and a Swin-Transformer, both local and global features are aggregated. Experiments in China, India and Mexico indicate that the proposed model achieves high performance with an average accuracy of 90.62%. The novelty lies in the fusion of CNN and Transformer for solid waste mapping in multi-cities without the need for pixel-wise labelled data. Future work would consider more sophisticated methods such as semantic segmentation for fine-grained solid waste classification. Numéro de notice : A2023-109 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1080/10106049.2022.2164361 Date de publication en ligne : 04/01/2023 En ligne : https://doi.org/10.1080/10106049.2022.2164361 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102407 [article]

Automatic registration method of multi-source point clouds based on building facades matching in urban scenes / Yumin Tan in Photogrammetric Engineering & Remote Sensing, PERS, vol 88 n° 12 (December 2022)  

Public [article]  inPhotogrammetric Engineering & Remote Sensing, PERS > vol 88 n° 12 (December 2022) . - pp 767 - 782 Titre : Automatic registration method of multi-source point clouds based on building facades matching in urban scenes Type de document : Article/Communication Auteurs : Yumin Tan, Auteur ; Yanzhe Shi, Auteur ; Yunxin Li, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : pp 767 - 782 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Photogrammétrie [Termes IGN] algorithme ICP [Termes IGN] appariement de formes [Termes IGN] appariement de points [Termes IGN] données lidar [Termes IGN] extraction de traits caractéristiques [Termes IGN] façade [Termes IGN] fusion de données multisource [Termes IGN] modélisation 3D [Termes IGN] photogrammétrie aérienne [Termes IGN] points registration [Termes IGN] Ransac (algorithme) [Termes IGN] recalage de données localisées [Termes IGN] scène urbaine [Termes IGN] superposition de données Résumé : (auteur) Both UAV photogrammetry and lidar have become common in deriv- ing three-dimensional models of urban scenes, and each has its own advantages and disadvantages. However, the fusion of these multisource data is still challenging, in which registration is one of the most important stages. In this paper, we propose a method of coarse point cloud registration which consists of two steps. The first step is to extract urban building facades in both an oblique photogrammetric point cloud and a lidar point cloud. The second step is to align the two point clouds using the extracted building facades. Object Vicinity Distribution Feature (Dijkman and Van Den Heuvel 2002) is introduced to describe the distribution of building facades and register the two heterologous point clouds. This method provides a good initial state for later refined registration process and is translation, rotation, and scale invariant. Experiment results show that the accuracy of this proposed automatic registration method is equiva- lent to the accuracy of manual registration with control points. Numéro de notice : A2022-882 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.14358/PERS.22-00069R3 Date de publication en ligne : 01/12/2022 En ligne : https://doi.org/10.14358/PERS.22-00069R3 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102206 [article]

A unified framework for automated registration of point clouds, mesh surfaces and 3D models by using planar surfaces / Yuan Zhao in Photogrammetric record, vol 37 n° 180 (December 2022)  

Public [article]  inPhotogrammetric record > vol 37 n° 180 (December 2022) . - pp 366 - 384 Titre : A unified framework for automated registration of point clouds, mesh surfaces and 3D models by using planar surfaces Type de document : Article/Communication Auteurs : Yuan Zhao, Auteur ; Hang Zhao, Auteur ; Marko Radanovic, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : pp 366 - 384 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] algorithme ICP [Termes IGN] chevauchement [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] maillage [Termes IGN] modélisation 3D du bâti BIM [Termes IGN] recalage de données localisées [Termes IGN] semis de points [Termes IGN] superposition de données [Termes IGN] surface plane Résumé : (auteur) Numéro de notice : A2022-939 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1111/phor.12428 Date de publication en ligne : 18/10/2022 En ligne : https://doi.org/10.1111/phor.12428 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102685 [article]

The FIRST model: Spatiotemporal fusion incorrporting spectral autocorrelation / Shuaijun Liu in Remote sensing of environment, vol 279 (September-15 2022)  

Permalink

An improved multi-task pointwise network for segmentation of building roofs in airborne laser scanning point clouds / Chaoquan Zhang in Photogrammetric record, vol 37 n° 179 (September 2022)  

Permalink

Identification of urban agglomeration spatial range based on social and remote-sensing data - For evaluating development level of urban agglomerations / Shuai Zhang in ISPRS International journal of geo-information, vol 11 n° 8 (August 2022)  

Permalink

Fusion of GNSS and InSAR time series using the improved STRE model: applications to the San Francisco bay area and Southern California / Huineng Yan in Journal of geodesy, vol 96 n° 7 (July 2022)  

Permalink

Summarizing large scale 3D mesh for urban navigation / Imeen Ben Salah in Robotics and autonomous systems, vol 152 (June 2022)  

Permalink

Developing a data-fusing method for mapping fine-scale urban three-dimensional building structure / Xinxin Wu in Sustainable Cities and Society, vol 80 (May 2022)  

Permalink

Potential of Bayesian formalism for the fusion and assimilation of sequential forestry data in time and space / Cheikh Mohamedou in Canadian Journal of Forest Research, Vol 52 n° 4 (April 2022)  

Permalink

Land surface phenology retrieval through spectral and angular harmonization of Landsat-8, Sentinel-2 and Gaofen-1 data / Jun Lu in Remote sensing, vol 14 n° 5 (March-1 2022)  

Permalink

Decision fusion of deep learning and shallow learning for marine oil spill detection / Junfang Yang in Remote sensing, vol 14 n° 3 (February-1 2022)  

Permalink

Spatiotemporal fusion modelling using STARFM: Examples of Landsat 8 and Sentinel-2 NDVI in Bavaria / Maninder Singh Dhillon in Remote sensing, vol 14 n° 3 (February-1 2022)  

Permalink