Centre dedocumentation
scientifique

A joint deep learning network of point clouds and multiple views for roadside object classification from lidar point clouds / Lina Fang in ISPRS Journal of photogrammetry and remote sensing, vol 193 (November 2022)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 193 (November 2022) . - pp 115 - 136 Titre : A joint deep learning network of point clouds and multiple views for roadside object classification from lidar point clouds Type de document : Article/Communication Auteurs : Lina Fang, Auteur ; Zhilong You, Auteur ; Guixi Shen, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : pp 115 - 136 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] apprentissage profond [Termes IGN] attention (apprentissage automatique) [Termes IGN] classification orientée objet [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] extraction de traits caractéristiques [Termes IGN] fusion d'images [Termes IGN] image captée par drone [Termes IGN] reconnaissance d'objets [Termes IGN] route [Termes IGN] scène urbaine [Termes IGN] semis de points Résumé : (auteur) Urban management and survey departments have begun investigating the feasibility of acquiring data from various laser scanning systems for urban infrastructure measurements and assessments. Roadside objects such as cars, trees, traffic poles, pedestrians, bicycles and e-bicycles describe the static and dynamic urban information available for acquisition. Because of the unstructured nature of 3D point clouds, the rich targets in complex road scenes, and the varying scales of roadside objects, finely classifying these roadside objects from various point clouds is a challenging task. In this paper, we integrate two representations of roadside objects, point clouds and multiview images to propose a point-group-view network named PGVNet for classifying roadside objects into cars, trees, traffic poles, and small objects (pedestrians, bicycles and e-bicycles) from generalized point clouds. To utilize the topological information of the point clouds, we propose a graph attention convolution operation called AtEdgeConv to mine the relationship among the local points and to extract local geometric features. In addition, we employ a hierarchical view-group-object architecture to diminish the redundant information between similar views and to obtain salient viewwise global features. To fuse the local geometric features from the point clouds and the global features from multiview images, we stack an attention-guided fusion network in PGVNet. In particular, we quantify and leverage the global features as an attention mask to capture the intrinsic correlation and discriminability of the local geometric features, which contributes to recognizing the different roadside objects with similar shapes. To verify the effectiveness and generalization of our methods, we conduct extensive experiments on six test datasets of different urban scenes, which were captured by different laser scanning systems, including mobile laser scanning (MLS) systems, unmanned aerial vehicle (UAV)-based laser scanning (ULS) systems and backpack laser scanning (BLS) systems. Experimental results, and comparisons with state-of-the-art methods, demonstrate that the PGVNet model is able to effectively identify various cars, trees, traffic poles and small objects from generalized point clouds, and achieves promising performances on roadside object classifications, with an overall accuracy of 95.76%. Our code is released on https://github.com/flidarcode/PGVNet. Numéro de notice : A2022-756 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.08.022 Date de publication en ligne : 22/09/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.08.022 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101759 [article]

Deep learning feature representation for image matching under large viewpoint and viewing direction change / Lin Chen in ISPRS Journal of photogrammetry and remote sensing, vol 190 (August 2022)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 190 (August 2022) . - pp 94 -112 Titre : Deep learning feature representation for image matching under large viewpoint and viewing direction change Type de document : Article/Communication Auteurs : Lin Chen, Auteur ; Christian Heipke, Auteur Année de publication : 2022 Article en page(s) : pp 94 -112 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] extraction de traits caractéristiques [Termes IGN] image aérienne oblique [Termes IGN] orientation d'image [Termes IGN] reconnaissance de formes [Termes IGN] réseau neuronal siamois [Termes IGN] SIFT (algorithme) Résumé : (auteur) Feature based image matching has been a research focus in photogrammetry and computer vision for decades, as it is the basis for many applications where multi-view geometry is needed. A typical feature based image matching algorithm contains five steps: feature detection, affine shape estimation, orientation assignment, description and descriptor matching. This paper contains innovative work in different steps of feature matching based on convolutional neural networks (CNN). For the affine shape estimation and orientation assignment, the main contribution of this paper is twofold. First, we define a canonical shape and orientation for each feature. As a consequence, instead of the usual Siamese CNN, only single branch CNNs needs to be employed to learn the affine shape and orientation parameters, which turns the related tasks from supervised to self supervised learning problems, removing the need for known matching relationships between features. Second, the affine shape and orientation are solved simultaneously. To the best of our knowledge, this is the first time these two modules are reported to have been successfully trained together. In addition, for the descriptor learning part, a new weak match finder is suggested to better explore the intra-variance of the appearance of matched features. For any input feature patch, a transformed patch that lies far from the input feature patch in descriptor space is defined as a weak match feature. A weak match finder network is proposed to actively find these weak match features; they are subsequently used in the standard descriptor learning framework. The proposed modules are integrated into an inference pipeline to form the proposed feature matching algorithm. The algorithm is evaluated on standard benchmarks and is used to solve for the parameters of image orientation of aerial oblique images. It is shown that deep learning feature based image matching leads to more registered images, more reconstructed 3D points and a more stable block geometry than conventional methods. The code is available at https://github.com/Childhoo/Chen_Matcher.git. Numéro de notice : A2022-502 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.06.003 Date de publication en ligne : 14/06/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.06.003 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101000 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2022081	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2022083	DEP-RECP	Revue	LaSTIG	Dépôt en unité	Exclu du prêt
081-2022082	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Adversarial defenses for object detectors based on Gabor convolutional layers / Abdollah Amirkhani in The Visual Computer, vol 38 n° 6 (June 2022)  

Public [article]  inThe Visual Computer > vol 38 n° 6 (June 2022) . - pp 1929 - 1944 Titre : Adversarial defenses for object detectors based on Gabor convolutional layers Type de document : Article/Communication Auteurs : Abdollah Amirkhani, Auteur ; Mohammad Karimi, Auteur Année de publication : 2022 Article en page(s) : pp 1929 - 1944 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] détection d'objet [Termes IGN] filtre de Gabor [Termes IGN] reconnaissance de formes [Termes IGN] réseau antagoniste génératif Résumé : (auteur) Despite their many advantages and positive features, the deep neural networks are extremely vulnerable against adversarial attacks. This drawback has substantially reduced the adversarial accuracy of the visual object detectors. To make these object detectors robust to adversarial attacks, a new Gabor filter-based method has been proposed in this paper. This method has then been applied on the YOLOv3 with different backbones, the SSD with different input sizes and on the FRCNN; and thus, six robust object detector models have been presented. In order to evaluate the efficacy of the models, they have been subjected to adversarial training via three types of targeted attacks (TOG-fabrication, TOG-vanishing, and TOG-mislabeling) and three types of untargeted random attacks (DAG, RAP, and UEA). The best average accuracy (49.6%) was achieved by the YOLOv3-d model, and for the PASCAL VOC dataset. This is far superior to the best performance and accuracy and obtained in previous works (25.4%). Empirical results show that, while the presented approach improves the adversarial accuracy of the object detector models, it does not affect the performance of these models on clean data. Numéro de notice : A2022-382 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1007/s00371-021-02256-6 Date de publication en ligne : 24/07/2021 En ligne : https://doi.org/10.1007/s00371-021-02256-6 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100651 [article]

An empirical study on the effects of temporal trends in spatial patterns on animated choropleth maps / Paweł Cybulski in ISPRS International journal of geo-information, vol 11 n° 5 (May 2022)  

Public [article]  inISPRS International journal of geo-information > vol 11 n° 5 (May 2022) . - n° 273 Titre : An empirical study on the effects of temporal trends in spatial patterns on animated choropleth maps Type de document : Article/Communication Auteurs : Paweł Cybulski, Auteur Année de publication : 2022 Article en page(s) : n° 273 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Termes IGN] analyse de groupement [Termes IGN] analyse visuelle [Termes IGN] carte choroplèthe [Termes IGN] cartographie animée [Termes IGN] lecture de carte [Termes IGN] oculométrie [Termes IGN] reconnaissance de formes [Termes IGN] visualisation cartographique [Vedettes matières IGN] Cartologie Résumé : (auteur) Animated cartographic visualization incorporates the concept of geomedia presented in this Special Issue. The presented study aims to examine the effectiveness of spatial pattern and temporal trend recognition on animated choropleth maps. In a controlled laboratory experiment with participants and eye tracking, fifteen animated maps were used to show a different spatial patterns and temporal trends. The participants’ task was to correctly detect the patterns and trends on a choropleth map. The study results show that effective spatial pattern and temporal trend recognition on a choropleth map is related to participants’ visual behavior. Visual attention clustered in the central part of the choropleth map supports effective spatio-temporal relationship recognition. The larger the area covered by the fixation cluster, the higher the probability of correct temporal trend and spatial pattern recognition. However, animated choropleth maps are more suitable for presenting temporal trends than spatial patterns. Understanding the difficulty in the correct recognition of spatio-temporal relationships might be a reason for implementing techniques that support effective visual searches such as highlighting, cartographic redundancy, or interactive tools. For end-users, the presented study reveals the necessity of the application of a specific visual strategy. Focusing on the central part of the map is the most effective strategy for the recognition of spatio-temporal relationships. Numéro de notice : A2022-358 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.3390/ijgi11050273 Date de publication en ligne : 20/04/2022 En ligne : https://doi.org/10.3390/ijgi11050273 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100571 [article]

Linear building pattern recognition in topographical maps combining convex polygon decomposition / Zhiwei Wei in Geocarto international, vol 37 n° inconnu ([30/01/2022])  

Public [article]  inGeocarto international > vol 37 n° inconnu [30/01/2022] Titre : Linear building pattern recognition in topographical maps combining convex polygon decomposition Type de document : Article/Communication Auteurs : Zhiwei Wei, Auteur ; Su Ding, Auteur ; Lu Cheng, Auteur ; et al., Auteur Année de publication : 2022 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Géomatique [Termes IGN] carte topographique [Termes IGN] construction [Termes IGN] décomposition [Termes IGN] détection du bâti [Termes IGN] forme linéaire [Termes IGN] généralisation cartographique automatisée [Termes IGN] Ordnance Survey (UK) [Termes IGN] polygone [Termes IGN] reconnaissance de formes Résumé : (auteur) Building patterns are crucial for urban form understanding, automated map generalization, and 3 D city model visualization. The existing studies have recognized various building patterns based on visual perception rules in which buildings are considered as a whole. However, some visually aware patterns may fail to be recognized with these approaches because human vision is also proved as a part-based system. This paper first proposed an approach for linear building pattern recognition combining convex polygon decomposition. Linear building patterns including collinear patterns and curvilinear patterns are defined according to the proximity, similarity, and continuity between buildings. Linear building patterns are then recognized by combining convex polygon decomposition, in which a building can be decomposed into sub-buildings for pattern recognition. A novel node concavity is developed based on polygon skeletons which is applicable for building polygons with holes or not in the building decomposition. And building’s orthogonal features are also considered in the building decomposition. Two datasets collected from Ordnance Survey (OS) were used in the experiments to verify the effectiveness of the proposed approach. The results indicate that our approach achieves 25.57% higher precision and 32.23% higher recall in collinear pattern recognition and 15.67% higher precision and 18.52% higher recall in curvilinear pattern recognition when compared to existing approaches. Recognition of other kinds of building patterns including T-shaped and C-shaped patterns combining convex polygon decomposition are also discussed in this approach. Numéro de notice : A2022-263 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE Nature : Article DOI : 10.1080/10106049.2022.2055794 Date de publication en ligne : 27/03/2022 En ligne : https://doi.org/10.1080/10106049.2022.2055794 Format de la ressource électronique : 27/03/2022 Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100260 [article]

Deep learning for anchor detection in multi-scale maps / Quentin Potié (2022)  

Permalink

Event-driven feature detection and tracking for visual SLAM / Ignacio Alzugaray (2022)  

Permalink

Location retrieval using qualitative place signatures of visible landmarks / Lijun Wei (2022)  

Permalink

Scene understanding and gesture recognition for human-machine interaction / Naina Dhingra (2022)  

Permalink

Searching for an optimal hexagonal shaped enumeration unit size for effective spatial pattern recognition in choropleth maps / Izabela Karsznia in ISPRS International journal of geo-information, vol 10 n° 9 (September 2021)  

Permalink

A typification method for linear building groups based on stroke simplification / Xiao Wang in Geocarto international, vol 36 n° 15 ([15/08/2021])  

Permalink

The point-descriptor-precedence representation for point configurations and movements / Amna Qayyum in International journal of geographical information science IJGIS, vol 35 n° 7 (July 2021)  

Permalink

Trajectory and image-based detection and identification of UAV / Yicheng Liu in The Visual Computer, vol 37 n° 7 (July 2021)  

Permalink

Reconnaissance automatique d’objets pour le jumeau numérique ferroviaire à partir d’imagerie aérienne / Valentin Desbiolles in XYZ, n° 167 (juin 2021)

Permalink

Multiple convolutional features in Siamese networks for object tracking / Zhenxi Li in Machine Vision and Applications, vol 32 n° 3 (May 2021)  

Permalink