Centre dedocumentation
scientifique

Large-scale individual building extraction from open-source satellite imagery via super-resolution-based instance segmentation approach / Shenglong Chen in ISPRS Journal of photogrammetry and remote sensing, vol 195 (January 2023)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 195 (January 2023) . - pp 129 - 152 Titre : Large-scale individual building extraction from open-source satellite imagery via super-resolution-based instance segmentation approach Type de document : Article/Communication Auteurs : Shenglong Chen, Auteur ; Yoshiki Ogawa, Auteur ; Chenbo Zhao, Auteur ; et al., Auteur Année de publication : 2023 Article en page(s) : pp 129 - 152 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] couleur (variable spectrale) [Termes IGN] détection du bâti [Termes IGN] distribution de Gauss [Termes IGN] image à haute résolution [Termes IGN] mosaïquage d'images [Termes IGN] segmentation sémantique Résumé : (auteur) Building footprint is a primary dataset of an urban geographic information system (GIS) database. Therefore, it is essential to establish a robust and automated framework for large-scale building extraction. However, the characteristic of remote sensing images complicates the application of the instance segmentation method based on the Mask R-CNN model, which ought to be improved toward extracting and fusing multi-scale features. Moreover, open-source satellite image datasets with wider spatial coverage and temporal resolution than high-resolution images may exhibit different coloration and resolution. This study proposes a large-scale building extraction framework based on super-resolution (SR) and instance segmentation using a relatively lower-resolution (>0.6 m) open-sourced dataset. The framework comprises four steps: color normalization and image super-resolution, scene classification, building extraction, and scene mosaicking. We took Hyogo Prefecture, Japan (19,187 km2) as a test area and extracted 1,726,006 (29.12 km2) of the 3,301,488 buildings (32.46 km2), where the number of buildings and footprint area increased by 3.0 % and 5.0 % respectively. The result indicated that the color normalization and image super-resolution could improve the visual quality of open-source satellite images and contribute to building extraction accuracy. Moreover, the improved Mask R-CNN based on Multi-Path Vision Transformer (MPViT) backbone achieved F1 scores of 0.71, 0.70, 0.81, and 0.67 for non-built-up, rural, suburban, and urban areas, respectively, which is better than those of the baseline model and other mainstream instance segmentation approaches. This study demonstrates the potential of acquiring acceptable building footprint maps from open-source satellite images, which has significant practical implications. Numéro de notice : A2023-019 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.11.006 Date de publication en ligne : 30/11/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.11.006 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102214 [article]

Automatic registration of point cloud and panoramic images in urban scenes based on pole matching / Yuan Wang in International journal of applied Earth observation and geoinformation, vol 115 (December 2022)  

Public [article]  inInternational journal of applied Earth observation and geoinformation > vol 115 (December 2022) . - n° 103083 Titre : Automatic registration of point cloud and panoramic images in urban scenes based on pole matching Type de document : Article/Communication Auteurs : Yuan Wang, Auteur ; Yuhao Li, Auteur ; Yiping Chen, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : n° 103083 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] appariement de formes [Termes IGN] chevauchement [Termes IGN] extraction de traits caractéristiques [Termes IGN] image panoramique [Termes IGN] image virtuelle [Termes IGN] optimisation par essaim de particules [Termes IGN] points registration [Termes IGN] recalage d'image [Termes IGN] scène urbaine [Termes IGN] segmentation sémantique [Termes IGN] semis de points [Termes IGN] télémétrie laser mobile [Termes IGN] zone tampon Résumé : (auteur) Given the initial calibration of multiple sensors, the fine registration between Mobile Laser Scanning (MLS) point clouds and panoramic images is still challenging due to the unforeseen movement and temporal misalignment while collecting. To tackle this issue, we proposed a novel automatic method to register the panoramic images and MLS point clouds based on the matching of pole objects. Firstly, 2D pole instances in the panoramic images are extracted by a semantic segmentation network and then optimized. Secondly, every corresponding frustum point cloud of each pole instance is obtained by a shape-adaptive buffer region in the panoramic image, and the 3D pole object is extracted via a combination of slicing, clustering, and connected domain analysis, then all 3D pole objects are fused. Finally, 2D and 3D pole objects are re-projected onto virtual images respectively, and then fine 2D-3D correspondences are collected through maximizing pole overlapping area by Particle Swarm Optimization (PSO). The accurate extrinsic orientation parameters are acquired by the Efficient Perspective-N-Point (EPnP). The experiments indicate that the proposed method performs effectively on two challenging urban scenes with an average registration error of 2.01 pixels (with RMSE 0.88) and 2.35 pixels (with RMSE 1.03), respectively. Numéro de notice : A2022-827 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1016/j.jag.2022.103083 Date de publication en ligne : 07/11/2022 En ligne : https://doi.org/10.1016/j.jag.2022.103083 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102011 [article]

Instance segmentation of standing dead trees in dense forest from aerial imagery using deep learning / Aboubakar Sani-Mohammed in ISPRS Open Journal of Photogrammetry and Remote Sensing, vol 6 (December 2022)  

Public [article]  inISPRS Open Journal of Photogrammetry and Remote Sensing > vol 6 (December 2022) . - n° 100024 Titre : Instance segmentation of standing dead trees in dense forest from aerial imagery using deep learning Type de document : Article/Communication Auteurs : Aboubakar Sani-Mohammed, Auteur ; Wei Yao, Auteur ; Marco Heurich, Auteur Année de publication : 2022 Article en page(s) : n° 100024 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] arbre mort [Termes IGN] Bavière (Allemagne) [Termes IGN] bois sur pied [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] détection automatique [Termes IGN] gestion forestière [Termes IGN] image à haute résolution [Termes IGN] image aérienne [Termes IGN] image infrarouge couleur [Termes IGN] peuplement mélangé [Termes IGN] puits de carbone [Termes IGN] segmentation sémantique Résumé : (auteur) Mapping standing dead trees, especially, in natural forests is very important for evaluation of the forest's health status, and its capability for storing Carbon, and the conservation of biodiversity. Apparently, natural forests have larger areas which renders the classical field surveying method very challenging, time-consuming, labor-intensive, and unsustainable. Thus, for effective forest management, there is the need for an automated approach that would be cost-effective. With the advent of Machine Learning, Deep Learning has proven to successfully achieve excellent results. This study presents an adjusted Mask R-CNN Deep Learning approach for detecting and segmenting standing dead trees in a mixed dense forest from CIR aerial imagery using a limited (195 images) training dataset. First, transfer learning is considered coupled with the image augmentation technique to leverage the limitation of training datasets. Then, we strategically selected hyperparameters to suit appropriately our model's architecture that fits well with our type of data (dead trees in images). Finally, to assess the generalization capability of our model's performance, a test dataset that was not confronted to the deep neural network was used for comprehensive evaluation. Our model recorded promising results reaching a mean average precision, average recall, and average F1-Score of 0.85, 0.88, and 0.87 respectively, despite our relatively low resolution (20 cm) dataset. Consequently, our model could be used for automation in standing dead tree detection and segmentation for enhanced forest management. This is equally significant for biodiversity conservation, and forest Carbon storage estimation. Numéro de notice : A2022-871 Affiliation des auteurs : non IGN Thématique : FORET/IMAGERIE Nature : Article DOI : 10.1016/j.ophoto.2022.100024 Date de publication en ligne : 10/11/2022 En ligne : https://doi.org/10.1016/j.ophoto.2022.100024 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102165 [article]

Semantic segmentation of bridge components and road infrastructure from mobile LiDAR data / Yi-Chun Lin in ISPRS Open Journal of Photogrammetry and Remote Sensing, vol 6 (December 2022)  

Public [article]  inISPRS Open Journal of Photogrammetry and Remote Sensing > vol 6 (December 2022) . - n° 100023 Titre : Semantic segmentation of bridge components and road infrastructure from mobile LiDAR data Type de document : Article/Communication Auteurs : Yi-Chun Lin, Auteur ; Ayman Habib, Auteur Année de publication : 2022 Article en page(s) : n° 100023 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] apprentissage profond [Termes IGN] autoroute [Termes IGN] couplage GNSS-INS [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] lidar mobile [Termes IGN] pont [Termes IGN] réseau neuronal de graphes [Termes IGN] réseau routier [Termes IGN] segmentation sémantique [Termes IGN] semis de points Résumé : (auteur) Emerging mobile LiDAR mapping systems exhibit great potential as an alternative for mapping urban environments. Such systems can acquire high-quality, dense point clouds that capture detailed information over an area of interest through efficient field surveys. However, automatically recognizing and semantically segmenting different components from the point clouds with efficiency and high accuracy remains a challenge. Towards this end, this study proposes a semantic segmentation framework to simultaneously classify bridge components and road infrastructure using mobile LiDAR point clouds while providing the following contributions: 1) a deep learning approach exploiting graph convolutions is adopted for point cloud semantic segmentation; 2) cross-labeling and transfer learning techniques are developed to reduce the need for manual annotation; and 3) geometric quality control strategies are proposed to refine the semantic segmentation results. The proposed framework is evaluated using data from two mobile mapping systems along an interstate highway with 27 highway bridges. With the help of the proposed cross-labeling and transfer learning strategies, the deep learning model achieves an overall accuracy of 84% using limited training data. Moreover, the effectiveness of the proposed framework is verified through test covering approximately 42 miles along the interstate highway, where substantial improvement after quality control can be observed. Numéro de notice : A2022-814 Affiliation des auteurs : non IGN Thématique : IMAGERIE/INFORMATIQUE Nature : Article DOI : 10.1016/j.ophoto.2022.100023 Date de publication en ligne : 24/10/2022 En ligne : https://doi.org/10.1016/j.ophoto.2022.100023 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101975 [article]

Graph-based leaf–wood separation method for individual trees using terrestrial lidar point clouds / Zhilin Tian in IEEE Transactions on geoscience and remote sensing, vol 60 n° 11 (November 2022)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 60 n° 11 (November 2022) . - n° 5705111 Titre : Graph-based leaf–wood separation method for individual trees using terrestrial lidar point clouds Type de document : Article/Communication Auteurs : Zhilin Tian, Auteur ; Shihua Li, Auteur Année de publication : 2022 Article en page(s) : n° 5705111 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] bois [Termes IGN] branche (arbre) [Termes IGN] chemin le plus court, algorithme du [Termes IGN] données lidar [Termes IGN] échantillonnage de données [Termes IGN] extraction de traits caractéristiques [Termes IGN] feuille (végétation) [Termes IGN] graphe [Termes IGN] Python (langage de programmation) [Termes IGN] segmentation [Termes IGN] semis de points Résumé : (auteur) Terrestrial light detection and ranging (lidar) is capable of resolving trees at the branch/leaf level with accurate and dense point clouds. The separation of leaf and wood components is a prerequisite for the estimation of branch/leaf-scale biophysical properties and realistic tree model reconstruction. Most existing methods have been tested on trees with similar structures; their robustness for trees of different species and sizes remains relatively unexplored. This study proposed a new graph-based leaf–wood separation (GBS) method for individual trees purely using the xyz -information of the point cloud. The GBS method fully utilized the shortest path-based features, as the shortest path can effectively reflect the structures for trees of different species and sizes. Ten types of tree data—covering tropical, temperate, and boreal species—with heights ranging from 5.4 to 43.7 m, were used to test the method performance. The mean accuracy and kappa coefficient at the point level were 94% and 0.78, respectively, and our method outperformed two other state-of-the-art methods. Through further analysis and testing, the GBS method exhibited a strong ability for detecting small and leaf-surrounded branches, and was also sufficiently robust in terms of data subsampling. Our research further demonstrated the potential of the shortest path-based features in leaf–wood separation. The entire framework was provided for use as an open-source Python package, along with our labeled validation data. Numéro de notice : A2022-853 Affiliation des auteurs : non IGN Thématique : FORET/IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2022.3218603 Date de publication en ligne : 01/11/2022 En ligne : https://doi.org/10.1109/TGRS.2022.3218603 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102099 [article]

Improving deep learning on point cloud by maximizing mutual information across layers / Di Wang in Pattern recognition, vol 131 (November 2022)  

Permalink

Improving image segmentation with boundary patch refinement / Xiaolin Hu in International journal of computer vision, vol 130 n° 11 (November 2022)  

Permalink

Measuring visual walkability perception using panoramic street view images, virtual reality, and deep learning / Yunqin Li in Sustainable Cities and Society, vol 86 (November 2022)  

Permalink

Multi-level self-adaptive individual tree detection for coniferous forest using airborne LiDAR / Zhenyang Hui in International journal of applied Earth observation and geoinformation, vol 114 (November 2022)  

Permalink

A robust edge detection algorithm based on feature-based image registration (FBIR) using improved canny with fuzzy logic (ICWFL) / Anchal Kumawat in The Visual Computer, vol 38 n° 11 (November 2022)  

Permalink

Raster-based method for building selection in the multi-scale representation of two-dimensional maps / Yilang Shen in Geocarto international, vol 37 n° 22 ([10/10/2022])  

Permalink

Incremental road network update method with trajectory data and UAV remote sensing imagery / Jianxin Qin in ISPRS International journal of geo-information, vol 11 n° 10 (October 2022)  

Permalink

The iterative convolution–thresholding method (ICTM) for image segmentation / Dong Wang in Pattern recognition, vol 130 (October 2022)  

Permalink

Learning indoor point cloud semantic segmentation from image-level labels / Youcheng Song in The Visual Computer, vol 38 n° 9 (September 2022)  

Permalink

Structured binary neural networks for image recognition / Bohan Zhuang in International journal of computer vision, vol 130 n° 9 (September 2022)  

Permalink