Centre de documentation
scientifique

Automatic registration of point cloud and panoramic images in urban scenes based on pole matching / Yuan Wang in International journal of applied Earth observation and geoinformation, vol 115 (December 2022)  

Public [article]  inInternational journal of applied Earth observation and geoinformation > vol 115 (December 2022) . - n° 103083 Titre : Automatic registration of point cloud and panoramic images in urban scenes based on pole matching Type de document : Article/Communication Auteurs : Yuan Wang, Auteur ; Yuhao Li, Auteur ; Yiping Chen, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : n° 103083 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] appariement de formes [Termes IGN] chevauchement [Termes IGN] extraction de traits caractéristiques [Termes IGN] image panoramique [Termes IGN] image virtuelle [Termes IGN] optimisation par essaim de particules [Termes IGN] points registration [Termes IGN] recalage d'image [Termes IGN] scène urbaine [Termes IGN] segmentation sémantique [Termes IGN] semis de points [Termes IGN] télémétrie laser mobile [Termes IGN] zone tampon Résumé : (auteur) Given the initial calibration of multiple sensors, the fine registration between Mobile Laser Scanning (MLS) point clouds and panoramic images is still challenging due to the unforeseen movement and temporal misalignment while collecting. To tackle this issue, we proposed a novel automatic method to register the panoramic images and MLS point clouds based on the matching of pole objects. Firstly, 2D pole instances in the panoramic images are extracted by a semantic segmentation network and then optimized. Secondly, every corresponding frustum point cloud of each pole instance is obtained by a shape-adaptive buffer region in the panoramic image, and the 3D pole object is extracted via a combination of slicing, clustering, and connected domain analysis, then all 3D pole objects are fused. Finally, 2D and 3D pole objects are re-projected onto virtual images respectively, and then fine 2D-3D correspondences are collected through maximizing pole overlapping area by Particle Swarm Optimization (PSO). The accurate extrinsic orientation parameters are acquired by the Efficient Perspective-N-Point (EPnP). The experiments indicate that the proposed method performs effectively on two challenging urban scenes with an average registration error of 2.01 pixels (with RMSE 0.88) and 2.35 pixels (with RMSE 1.03), respectively. Numéro de notice : A2022-827 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1016/j.jag.2022.103083 Date de publication en ligne : 07/11/2022 En ligne : https://doi.org/10.1016/j.jag.2022.103083 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102011 [article]