Centre dedocumentation
scientifique

Large-scale individual building extraction from open-source satellite imagery via super-resolution-based instance segmentation approach / Shenglong Chen in ISPRS Journal of photogrammetry and remote sensing, vol 195 (January 2023)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 195 (January 2023) . - pp 129 - 152 Titre : Large-scale individual building extraction from open-source satellite imagery via super-resolution-based instance segmentation approach Type de document : Article/Communication Auteurs : Shenglong Chen, Auteur ; Yoshiki Ogawa, Auteur ; Chenbo Zhao, Auteur ; et al., Auteur Année de publication : 2023 Article en page(s) : pp 129 - 152 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] couleur (variable spectrale) [Termes IGN] détection du bâti [Termes IGN] distribution de Gauss [Termes IGN] image à haute résolution [Termes IGN] mosaïquage d'images [Termes IGN] segmentation sémantique Résumé : (auteur) Building footprint is a primary dataset of an urban geographic information system (GIS) database. Therefore, it is essential to establish a robust and automated framework for large-scale building extraction. However, the characteristic of remote sensing images complicates the application of the instance segmentation method based on the Mask R-CNN model, which ought to be improved toward extracting and fusing multi-scale features. Moreover, open-source satellite image datasets with wider spatial coverage and temporal resolution than high-resolution images may exhibit different coloration and resolution. This study proposes a large-scale building extraction framework based on super-resolution (SR) and instance segmentation using a relatively lower-resolution (>0.6 m) open-sourced dataset. The framework comprises four steps: color normalization and image super-resolution, scene classification, building extraction, and scene mosaicking. We took Hyogo Prefecture, Japan (19,187 km2) as a test area and extracted 1,726,006 (29.12 km2) of the 3,301,488 buildings (32.46 km2), where the number of buildings and footprint area increased by 3.0 % and 5.0 % respectively. The result indicated that the color normalization and image super-resolution could improve the visual quality of open-source satellite images and contribute to building extraction accuracy. Moreover, the improved Mask R-CNN based on Multi-Path Vision Transformer (MPViT) backbone achieved F1 scores of 0.71, 0.70, 0.81, and 0.67 for non-built-up, rural, suburban, and urban areas, respectively, which is better than those of the baseline model and other mainstream instance segmentation approaches. This study demonstrates the potential of acquiring acceptable building footprint maps from open-source satellite images, which has significant practical implications. Numéro de notice : A2023-019 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.11.006 Date de publication en ligne : 30/11/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.11.006 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102214 [article]

Automatic registration of point cloud and panoramic images in urban scenes based on pole matching / Yuan Wang in International journal of applied Earth observation and geoinformation, vol 115 (December 2022)  

Public [article]  inInternational journal of applied Earth observation and geoinformation > vol 115 (December 2022) . - n° 103083 Titre : Automatic registration of point cloud and panoramic images in urban scenes based on pole matching Type de document : Article/Communication Auteurs : Yuan Wang, Auteur ; Yuhao Li, Auteur ; Yiping Chen, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : n° 103083 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] appariement de formes [Termes IGN] chevauchement [Termes IGN] extraction de traits caractéristiques [Termes IGN] image panoramique [Termes IGN] image virtuelle [Termes IGN] optimisation par essaim de particules [Termes IGN] points registration [Termes IGN] recalage d'image [Termes IGN] scène urbaine [Termes IGN] segmentation sémantique [Termes IGN] semis de points [Termes IGN] télémétrie laser mobile [Termes IGN] zone tampon Résumé : (auteur) Given the initial calibration of multiple sensors, the fine registration between Mobile Laser Scanning (MLS) point clouds and panoramic images is still challenging due to the unforeseen movement and temporal misalignment while collecting. To tackle this issue, we proposed a novel automatic method to register the panoramic images and MLS point clouds based on the matching of pole objects. Firstly, 2D pole instances in the panoramic images are extracted by a semantic segmentation network and then optimized. Secondly, every corresponding frustum point cloud of each pole instance is obtained by a shape-adaptive buffer region in the panoramic image, and the 3D pole object is extracted via a combination of slicing, clustering, and connected domain analysis, then all 3D pole objects are fused. Finally, 2D and 3D pole objects are re-projected onto virtual images respectively, and then fine 2D-3D correspondences are collected through maximizing pole overlapping area by Particle Swarm Optimization (PSO). The accurate extrinsic orientation parameters are acquired by the Efficient Perspective-N-Point (EPnP). The experiments indicate that the proposed method performs effectively on two challenging urban scenes with an average registration error of 2.01 pixels (with RMSE 0.88) and 2.35 pixels (with RMSE 1.03), respectively. Numéro de notice : A2022-827 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1016/j.jag.2022.103083 Date de publication en ligne : 07/11/2022 En ligne : https://doi.org/10.1016/j.jag.2022.103083 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102011 [article]

Instance segmentation of standing dead trees in dense forest from aerial imagery using deep learning / Aboubakar Sani-Mohammed in ISPRS Open Journal of Photogrammetry and Remote Sensing, vol 6 (December 2022)  

Public [article]  inISPRS Open Journal of Photogrammetry and Remote Sensing > vol 6 (December 2022) . - n° 100024 Titre : Instance segmentation of standing dead trees in dense forest from aerial imagery using deep learning Type de document : Article/Communication Auteurs : Aboubakar Sani-Mohammed, Auteur ; Wei Yao, Auteur ; Marco Heurich, Auteur Année de publication : 2022 Article en page(s) : n° 100024 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] arbre mort [Termes IGN] Bavière (Allemagne) [Termes IGN] bois sur pied [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] détection automatique [Termes IGN] gestion forestière [Termes IGN] image à haute résolution [Termes IGN] image aérienne [Termes IGN] image infrarouge couleur [Termes IGN] peuplement mélangé [Termes IGN] puits de carbone [Termes IGN] segmentation sémantique Résumé : (auteur) Mapping standing dead trees, especially, in natural forests is very important for evaluation of the forest's health status, and its capability for storing Carbon, and the conservation of biodiversity. Apparently, natural forests have larger areas which renders the classical field surveying method very challenging, time-consuming, labor-intensive, and unsustainable. Thus, for effective forest management, there is the need for an automated approach that would be cost-effective. With the advent of Machine Learning, Deep Learning has proven to successfully achieve excellent results. This study presents an adjusted Mask R-CNN Deep Learning approach for detecting and segmenting standing dead trees in a mixed dense forest from CIR aerial imagery using a limited (195 images) training dataset. First, transfer learning is considered coupled with the image augmentation technique to leverage the limitation of training datasets. Then, we strategically selected hyperparameters to suit appropriately our model's architecture that fits well with our type of data (dead trees in images). Finally, to assess the generalization capability of our model's performance, a test dataset that was not confronted to the deep neural network was used for comprehensive evaluation. Our model recorded promising results reaching a mean average precision, average recall, and average F1-Score of 0.85, 0.88, and 0.87 respectively, despite our relatively low resolution (20 cm) dataset. Consequently, our model could be used for automation in standing dead tree detection and segmentation for enhanced forest management. This is equally significant for biodiversity conservation, and forest Carbon storage estimation. Numéro de notice : A2022-871 Affiliation des auteurs : non IGN Thématique : FORET/IMAGERIE Nature : Article DOI : 10.1016/j.ophoto.2022.100024 Date de publication en ligne : 10/11/2022 En ligne : https://doi.org/10.1016/j.ophoto.2022.100024 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102165 [article]

Semantic segmentation of bridge components and road infrastructure from mobile LiDAR data / Yi-Chun Lin in ISPRS Open Journal of Photogrammetry and Remote Sensing, vol 6 (December 2022)  

Public [article]  inISPRS Open Journal of Photogrammetry and Remote Sensing > vol 6 (December 2022) . - n° 100023 Titre : Semantic segmentation of bridge components and road infrastructure from mobile LiDAR data Type de document : Article/Communication Auteurs : Yi-Chun Lin, Auteur ; Ayman Habib, Auteur Année de publication : 2022 Article en page(s) : n° 100023 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] apprentissage profond [Termes IGN] autoroute [Termes IGN] couplage GNSS-INS [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] lidar mobile [Termes IGN] pont [Termes IGN] réseau neuronal de graphes [Termes IGN] réseau routier [Termes IGN] segmentation sémantique [Termes IGN] semis de points Résumé : (auteur) Emerging mobile LiDAR mapping systems exhibit great potential as an alternative for mapping urban environments. Such systems can acquire high-quality, dense point clouds that capture detailed information over an area of interest through efficient field surveys. However, automatically recognizing and semantically segmenting different components from the point clouds with efficiency and high accuracy remains a challenge. Towards this end, this study proposes a semantic segmentation framework to simultaneously classify bridge components and road infrastructure using mobile LiDAR point clouds while providing the following contributions: 1) a deep learning approach exploiting graph convolutions is adopted for point cloud semantic segmentation; 2) cross-labeling and transfer learning techniques are developed to reduce the need for manual annotation; and 3) geometric quality control strategies are proposed to refine the semantic segmentation results. The proposed framework is evaluated using data from two mobile mapping systems along an interstate highway with 27 highway bridges. With the help of the proposed cross-labeling and transfer learning strategies, the deep learning model achieves an overall accuracy of 84% using limited training data. Moreover, the effectiveness of the proposed framework is verified through test covering approximately 42 miles along the interstate highway, where substantial improvement after quality control can be observed. Numéro de notice : A2022-814 Affiliation des auteurs : non IGN Thématique : IMAGERIE/INFORMATIQUE Nature : Article DOI : 10.1016/j.ophoto.2022.100023 Date de publication en ligne : 24/10/2022 En ligne : https://doi.org/10.1016/j.ophoto.2022.100023 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101975 [article]

Improving deep learning on point cloud by maximizing mutual information across layers / Di Wang in Pattern recognition, vol 131 (November 2022)  

Public [article]  inPattern recognition > vol 131 (November 2022) . - n° 108892 Titre : Improving deep learning on point cloud by maximizing mutual information across layers Type de document : Article/Communication Auteurs : Di Wang, Auteur ; Lulu Tang, Auteur ; Xu Wang, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : n° 108892 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] détection d'objet [Termes IGN] entropie de Shannon [Termes IGN] information sémantique [Termes IGN] segmentation sémantique [Termes IGN] semis de points [Termes IGN] transformation géométrique [Termes IGN] vision par ordinateur [Termes IGN] visualisation 3D Résumé : (auteur) It is a fundamental and vital task to enhance the perception capability of the point cloud learning network in 3D machine vision applications. Most existing methods utilize feature fusion and geometric transformation to improve point cloud learning without paying enough attention to mining further intrinsic information across multiple network layers. Motivated to improve consistency between hierarchical features and strengthen the perception capability of the point cloud network, we propose exploring whether maximizing the mutual information (MI) across shallow and deep layers is beneficial to improve representation learning on point clouds. A novel design of Maximizing Mutual Information (MMI) Module is proposed, which assists the training process of the main network to capture discriminative features of the input point clouds. Specifically, the MMI-based loss function is employed to constrain the differences of semantic information in two hierarchical features extracted from the shallow and deep layers of the network. Extensive experiments show that our method is generally applicable to point cloud tasks, including classification, shape retrieval, indoor scene segmentation, 3D object detection, and completion, and illustrate the efficacy of our proposed method and its advantages over existing ones. Our source code is available at https://github.com/wendydidi/MMI.git. Numéro de notice : A2022-780 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : https://doi.org/10.1016/j.patcog.2022.108892 Date de publication en ligne : 08/07/2022 En ligne : https://doi.org/10.1016/j.patcog.2022.108892 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101859 [article]

Improving image segmentation with boundary patch refinement / Xiaolin Hu in International journal of computer vision, vol 130 n° 11 (November 2022)  

Permalink

Measuring visual walkability perception using panoramic street view images, virtual reality, and deep learning / Yunqin Li in Sustainable Cities and Society, vol 86 (November 2022)  

Permalink

Learning indoor point cloud semantic segmentation from image-level labels / Youcheng Song in The Visual Computer, vol 38 n° 9 (September 2022)  

Permalink

Structured binary neural networks for image recognition / Bohan Zhuang in International journal of computer vision, vol 130 n° 9 (September 2022)  

Permalink

3D semantic scene completion: A survey / Luis Roldão in International journal of computer vision, vol 130 n° 8 (August 2022)  

Permalink

An automatic approach for tree species detection and profile estimation of urban street trees using deep learning and Google street view images / Kwanghun Choi in ISPRS Journal of photogrammetry and remote sensing, vol 190 (August 2022)  

Permalink

Transfer learning from citizen science photographs enables plant species identification in UAV imagery / Salim Soltani in ISPRS Open Journal of Photogrammetry and Remote Sensing, vol 5 (August 2022)  

Permalink

A lightweight network with attention decoder for real-time semantic segmentation / Kang Wang in The Visual Computer, vol 38 n° 7 (July 2022)  

Permalink

Street-view imagery guided street furniture inventory from mobile laser scanning point clouds / Yuzhou Zhou in ISPRS Journal of photogrammetry and remote sensing, vol 189 (July 2022)  

Permalink

Context-aware network for semantic segmentation toward large-scale point clouds in urban environments / Chun Liu in IEEE Transactions on geoscience and remote sensing, vol 60 n° 6 (June 2022)  

Permalink