Centre dedocumentation
scientifique

A hierarchical multiview registration framework of TLS point clouds based on loop constraint / Hao Wu in ISPRS Journal of photogrammetry and remote sensing, vol 195 (January 2023)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 195 (January 2023) . - pp 65 - 76 Titre : A hierarchical multiview registration framework of TLS point clouds based on loop constraint Type de document : Article/Communication Auteurs : Hao Wu, Auteur ; Li Yan, Auteur ; Hong Xie, Auteur ; et al., Auteur Année de publication : 2023 Article en page(s) : pp 65 - 76 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] algorithme ICP [Termes IGN] appariement de points [Termes IGN] approche hiérarchique [Termes IGN] chevauchement [Termes IGN] graphe [Termes IGN] recalage d'image [Termes IGN] semis de points [Termes IGN] superposition de données [Termes IGN] traitement de semis de points Résumé : (auteur) Automatic registration of multiple point clouds is a significant preprocessing step for 3D computer vision tasks including semantic segmentation, 3D modelling, change detection, etc. Many methods were proposed to deal with this problem and yet most of them are not fully utilizing the redundant information offered by multiple common overlaps among point clouds. The existing methods are also inefficient when dealing with large-scale point clouds. In this paper, a novel automatic registration framework is presented to align point clouds efficiently and robustly. First, the overall number of scans is grouped into several scan-blocks by a proposed blocking strategy, and we build the pairwise relationship among scans through a fully connected graph in each scan-block. Second, perform loop-based coarse registration in each scan-block using a proposed false matches removal strategy. The proposed strategy can effectively identify grossly wrong scan-to-scan matches. Third, the minimum spanning tree is extracted from the graph, and ICP is applied along its edges. Moreover, the Lu–Milios algorithm is used to further optimize all poses at once by utilizing all redundant information in each scan-block. Finally, global block-to-block registration aligns all scan-blocks into a uniform coordinate reference. We test our framework on challenging WHU-TLS datasets, ETH datasets, and Robotic 3D Scan datasets to evaluate the efficiency, accuracy, as well as robustness. The experiment results show that our method achieves the state-of-the-art accuracy, while the time performance is improved by more than 30% compared with the state-of-the-art algorithms. Our source code is made available at https://github.com/WuHao-WHU/HL-MRF for benchmarking purposes. Numéro de notice : A2023-008 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.11.004 Date de publication en ligne : 19/11/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.11.004 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102112 [article]

Summarizing large scale 3D mesh for urban navigation / Imeen Ben Salah in Robotics and autonomous systems, vol 152 (June 2022)  

Public [article]  inRobotics and autonomous systems > vol 152 (June 2022) . - n° 104037 Titre : Summarizing large scale 3D mesh for urban navigation Type de document : Article/Communication Auteurs : Imeen Ben Salah, Auteur ; Sébastien Kramm, Auteur ; Cédric Demonceaux, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : n° 104037 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] algorithme ICP [Termes IGN] carte en 3D [Termes IGN] données lidar [Termes IGN] entropie [Termes IGN] image hémisphérique [Termes IGN] image RVB [Termes IGN] information sémantique [Termes IGN] localisation basée vision [Termes IGN] maillage [Termes IGN] navigation autonome [Termes IGN] précision géométrique (imagerie) [Termes IGN] précision radiométrique [Termes IGN] profondeur [Termes IGN] Rouen [Termes IGN] saillance [Termes IGN] zone urbaine Résumé : (auteur) Cameras have become increasingly common in vehicles, smartphones, and advanced driver assistance systems. The areas of application of these cameras in the world of intelligent transportation systems are becoming more and more varied: pedestrian detection, line crossing detection, navigation, …A major area of research currently focuses on mapping that is essential for localization and navigation. However, this step generates an important problem of memory management. Indeed, the memory space required to accommodate the map of a small city is measured in tens gigabytes. In addition, several providers today are competing to produce High-Definition (HD) maps. These maps offer a rich and detailed representation of the environment for highly accurate localization. However, they require a large storage capacity and high transmission and update costs. To overcome these problems, we propose a solution to summarize this type of map by reducing the size while maintaining the relevance of the data for navigation based on vision only. The summary consists in a set of spherical images augmented by depth and semantic information and allowing to keep the same level of visibility in every directions. These spheres are used as landmarks to offer guidance information to a distant agent. They then have to guarantee, at a lower cost, a good level of precision and speed during navigation. Some experiments on real data demonstrate the feasibility for obtaining a summarized map while maintaining a localization with interesting performances. Numéro de notice : A2022-290 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1016/j.robot.2022.104037 Date de publication en ligne : 03/02/2022 En ligne : https://doi.org/10.1016/j.robot.2022.104037 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100335 [article]

Decision fusion of deep learning and shallow learning for marine oil spill detection / Junfang Yang in Remote sensing, vol 14 n° 3 (February-1 2022)  

Public [article]  inRemote sensing > vol 14 n° 3 (February-1 2022) . - n° 666 Titre : Decision fusion of deep learning and shallow learning for marine oil spill detection Type de document : Article/Communication Auteurs : Junfang Yang, Auteur ; Yi Ma, Auteur ; Yabin Hu, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : n° 666 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] algorithme de fusion [Termes IGN] analyse multiéchelle [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] classification par séparateurs à vaste marge [Termes IGN] hydrocarbure [Termes IGN] image hyperspectrale [Termes IGN] marée noire [Termes IGN] milieu marin [Termes IGN] pollution des mers [Termes IGN] précision de la classification [Termes IGN] sous ensemble flou [Termes IGN] surveillance écologique [Termes IGN] transformation en ondelettes Résumé : (auteur) Marine oil spills are an emergency of great harm and have become a hot topic in marine environmental monitoring research. Optical remote sensing is an important means to monitor marine oil spills. Clouds, weather, and light control the amount of available data, which often limit feature characterization using a single classifier and therefore difficult to accurate monitoring of marine oil spills. In this paper, we develop a decision fusion algorithm to integrate deep learning methods and shallow learning methods based on multi-scale features for improving oil spill detection accuracy in the case of limited samples. Based on the multi-scale features after wavelet transform, two deep learning methods and two classical shallow learning algorithms are used to extract oil slick information from hyperspectral oil spill images. The decision fusion algorithm based on fuzzy membership degree is introduced to fuse multi-source oil spill information. The research shows that oil spill detection accuracy using the decision fusion algorithm is higher than that of the single detection algorithms. It is worth noting that oil spill detection accuracy is affected by different scale features. The decision fusion algorithm under the first-level scale features can further improve the accuracy of oil spill detection. The overall classification accuracy of the proposed method is 91.93%, which is 2.03%, 2.15%, 1.32%, and 0.43% higher than that of SVM, DBN, 1D-CNN, and MRF-CNN algorithms, respectively. Numéro de notice : A2022-125 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.3390/rs14030666 Date de publication en ligne : 30/01/2022 En ligne : https://doi.org/10.3390/rs14030666 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=99688 [article]

Robust registration of aerial images and LiDAR data using spatial constraints and Gabor structural features / Bai Zhu in ISPRS Journal of photogrammetry and remote sensing, Vol 181 (November 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > Vol 181 (November 2021) . - pp 129 - 147 Titre : Robust registration of aerial images and LiDAR data using spatial constraints and Gabor structural features Type de document : Article/Communication Auteurs : Bai Zhu, Auteur ; Yuanxin Ye, Auteur ; Liang Zhou, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 129 - 147 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] algorithme ICP [Termes IGN] correction géométrique [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] élément d'orientation externe [Termes IGN] enregistrement de données [Termes IGN] filtre de Gabor [Termes IGN] image aérienne [Termes IGN] recalage d'image [Termes IGN] semis de points [Termes IGN] SIFT (algorithme) [Termes IGN] structure-from-motion Résumé : (auteur) Co-registration of aerial imagery and Light Detection and Ranging (LiDAR) data is quite challenging because the different imaging mechanisms produce significant geometric and radiometric distortions between the two multimodal data sources. To address this problem, we propose a robust and effective coarse-to-fine registration method that is conducted in two stages utilizing spatial constraints and Gabor structural features. In the first stage, the LiDAR point cloud data is transformed into an intensity map that is used as the reference image. Then, coarse registration is completed by designing a partition-based Features from Accelerated Segment Test (FAST) operator to extract the uniformly distributed interest points in the aerial images and thereafter performing a local geometric correction based on the collinearity equations using the exterior orientation parameters (EoPs). The coarse registration aims to provide a reliable spatial geometry relationship for the subsequent fine registration and is designed to eliminate rotation and scale changes, as well as making only a few translation differences exist between the images. In the second stage, a novel feature descriptor called multi-Scale and multi-Directional Features of odd Gabor (SDFG) is first built to capture the multi-scale and multi-directional structural properties of the images. Then, the three-dimensional (3D) phase correlation (PC) of the SDFG descriptor is established to detect the control points (CPs) between the aerial and LiDAR intensity image in the frequency domain, where the image matching is accelerated by the 3D Fast Fourier Transform (FFT) technique. Finally, the obtained CPs not only are employed to refine the EoPs, but also are used to achieve the fine registration of the aerial images and LiDAR data. We conduct experiments to verify the robustness of the proposed registration method using three sets of aerial images and LiDAR data with different scene coverage. Experimental results show that the proposed method is robust to geometric distortions and radiometric changes. Moreover, it achieves the registration accuracy of less than 2 pixels for all cases, which outperforms the current four state-of-the-art methods, demonstrating its superior registration performance. Numéro de notice : A2021-773 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.09.010 Date de publication en ligne : 21/09/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.09.010 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98830 [article]

Integration of laser scanner and photogrammetry for heritage BIM enhancement / Yahya Alshawabkeh in ISPRS International journal of geo-information, vol 10 n° 5 (May 2021)  

Public [article]  inISPRS International journal of geo-information > vol 10 n° 5 (May 2021) . - n° 316 Titre : Integration of laser scanner and photogrammetry for heritage BIM enhancement Type de document : Article/Communication Auteurs : Yahya Alshawabkeh, Auteur ; Ahmad Baik, Auteur ; Yehia Miky, Auteur Année de publication : 2021 Article en page(s) : n° 316 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications photogrammétriques [Termes IGN] algorithme ICP [Termes IGN] Djeddah [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] données TLS (télémétrie) [Termes IGN] image captée par drone [Termes IGN] lasergrammétrie [Termes IGN] modélisation 3D du bâti BIM [Termes IGN] monument historique [Termes IGN] ombre [Termes IGN] reconstruction d'objet [Termes IGN] semis de points Résumé : (auteur) Digital 3D capture and reliable reproduction of architectural features is the first and most difficult step towards defining a heritage BIM. Three-dimensional digital survey technologies, such as TLS and photogrammetry, enable experts to scan buildings with a new level of detail. Challenges in the tracing of parametric objects in a TLS point cloud include the reconstruction of occluded parts, measurement of uncertainties relevant to surface reflectivity, and edge detection and location. In addition to image-based techniques being considered cost effective, highly flexible, and efficient in producing a high-quality 3D textured model, they also provide a better interpretation of surface linear characteristics. This article addresses an architecture survey workflow using photogrammetry and TLS to optimize a point cloud that is sufficient for a reliable HBIM. Fusion-based workflows were proposed during the recording of two heritage sites—the Matbouli House Museum in Historic Jeddah, a UNESCO World Heritage Site; and Asfan Castle. In the Matbouli House Museum building, which is rich with complex architectural features, multi-sensor recording was implemented at different resolutions and levels of detail. The TLS data were used to reconstruct the basic shape of the main structural elements, while the imagery’s superior radiometric data and accessibility were effectively used to enhance the TLS point clouds for improving the geometry, data interpretation, and parametric tracing of irregular objects in the facade. Furthermore, in the workflow that is considered to be the ragged terrain of the Castle of Asfan, here, the TLS point cloud was supplemented with UAV data in the upper building zones where the shadow data originated. Both datasets were registered using an ICP algorithm to scale the photogrammetric data and define their actual position in the construction system. The hybrid scans were imported and processed in the BIM environment. The building components were segmented and classified into regular and irregular surfaces, in order to perform detailed building information modeling of the architectural elements. The proposed workflows demonstrated an appropriate performance in terms of reliable and complete BIM mapping in the complex structures. Numéro de notice : A2021-511 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.3390/ijgi10050316 Date de publication en ligne : 08/05/2021 En ligne : https://doi.org/10.3390/ijgi10050316 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97678 [article]

Automated registration of SfM‐MVS multitemporal datasets using terrestrial and oblique aerial images / Luigi Parente in Photogrammetric record, vol 36 n° 173 (March 2021)  

Permalink

Improving trajectory estimation using 3D city models and kinematic point clouds / Lucas Lucks in Transactions in GIS, Vol 25 n° 1 (February 2021)  

Permalink

Cartographie dense et compacte par vision RGB-D pour la navigation d’un robot mobile / Bruce Canovas (2021)  

Permalink

Understanding the synergies of deep learning and data fusion of multispectral and panchromatic high resolution commercial satellite imagery for automated ice-wedge polygon detection / Chandi Witharana in ISPRS Journal of photogrammetry and remote sensing, vol 170 (December 2020)  

Permalink

An integrated approach to registration and fusion of hyperspectral and multispectral images / Yuan Zhou in IEEE Transactions on geoscience and remote sensing, vol 58 n° 5 (May 2020)  

Permalink

Delineating minor landslide displacements using GPS and terrestrial laser scanning-derived terrain surfaces and trees: a case study of the Slumgullion landslide, Lake City, Colorado / Jin Wang in Survey review, vol 52 n° 372 (May 2020)  

Permalink

Restitution de profils verticaux de la distribution de gouttes de pluie à partir de mesures au sol et en altitude / Christophe Samboun (2020) 

Permalink

Unsupervised classification of multispectral images embedded with a segmentation of panchromatic images using localized clusters / Ting Mao in IEEE Transactions on geoscience and remote sensing, vol 57 n° 11 (November 2019)  

Permalink

Automated fusion of forest airborne and terrestrial point clouds through canopy density analysis / Wenxia Dai in ISPRS Journal of photogrammetry and remote sensing, vol 156 (October 2019)  

Permalink

Review of mobile laser scanning target‐free registration methods for urban areas using improved error metrics / Hoang Long Nguyen in Photogrammetric record, vol 34 n° 167 (September 2019)  

Permalink