Centre de documentation
scientifique

Dépouillements

Deep learning feature representation for image matching under large viewpoint and viewing direction change / Lin Chen in ISPRS Journal of photogrammetry and remote sensing, vol 190 (August 2022)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 190 (August 2022) . - pp 94 -112 Titre : Deep learning feature representation for image matching under large viewpoint and viewing direction change Type de document : Article/Communication Auteurs : Lin Chen, Auteur ; Christian Heipke, Auteur Année de publication : 2022 Article en page(s) : pp 94 -112 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] extraction de traits caractéristiques [Termes IGN] image aérienne oblique [Termes IGN] orientation d'image [Termes IGN] reconnaissance de formes [Termes IGN] réseau neuronal siamois [Termes IGN] SIFT (algorithme) Résumé : (auteur) Feature based image matching has been a research focus in photogrammetry and computer vision for decades, as it is the basis for many applications where multi-view geometry is needed. A typical feature based image matching algorithm contains five steps: feature detection, affine shape estimation, orientation assignment, description and descriptor matching. This paper contains innovative work in different steps of feature matching based on convolutional neural networks (CNN). For the affine shape estimation and orientation assignment, the main contribution of this paper is twofold. First, we define a canonical shape and orientation for each feature. As a consequence, instead of the usual Siamese CNN, only single branch CNNs needs to be employed to learn the affine shape and orientation parameters, which turns the related tasks from supervised to self supervised learning problems, removing the need for known matching relationships between features. Second, the affine shape and orientation are solved simultaneously. To the best of our knowledge, this is the first time these two modules are reported to have been successfully trained together. In addition, for the descriptor learning part, a new weak match finder is suggested to better explore the intra-variance of the appearance of matched features. For any input feature patch, a transformed patch that lies far from the input feature patch in descriptor space is defined as a weak match feature. A weak match finder network is proposed to actively find these weak match features; they are subsequently used in the standard descriptor learning framework. The proposed modules are integrated into an inference pipeline to form the proposed feature matching algorithm. The algorithm is evaluated on standard benchmarks and is used to solve for the parameters of image orientation of aerial oblique images. It is shown that deep learning feature based image matching leads to more registered images, more reconstructed 3D points and a more stable block geometry than conventional methods. The code is available at https://github.com/Childhoo/Chen_Matcher.git. Numéro de notice : A2022-502 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.06.003 Date de publication en ligne : 14/06/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.06.003 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101000 [article]

Exemplaires(3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2022081	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2022083	DEP-RECP	Revue	LASTIG	Dépôt en unité	Exclu du prêt
081-2022082	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

An automatic approach for tree species detection and profile estimation of urban street trees using deep learning and Google street view images / Kwanghun Choi in ISPRS Journal of photogrammetry and remote sensing, vol 190 (August 2022)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 190 (August 2022) . - pp 165 - 180 Titre : An automatic approach for tree species detection and profile estimation of urban street trees using deep learning and Google street view images Type de document : Article/Communication Auteurs : Kwanghun Choi, Auteur ; Wontaek LIM, Auteur ; Byungwoo Chang, Auteur ; et al., Auteur Année de publication : 2022 Article en page(s) : pp 165 - 180 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] arbre urbain [Termes IGN] détection automatique [Termes IGN] détection d'arbres [Termes IGN] diamètre à hauteur de poitrine [Termes IGN] gestion forestière durable [Termes IGN] image Streetview [Termes IGN] inventaire de la végétation [Termes IGN] segmentation sémantique [Termes IGN] Séoul Résumé : (auteur) Tree species and canopy structural profile (‘tree profile’) are among the most critical environmental factors in determining urban ecosystem services such as climate and air quality control from urban trees. To accurately characterize a tree profile, the tree diameter, height, crown width, and height to the lowest live branch must be all measured, which is an expensive and time-consuming procedure. Recent advances in artificial intelligence aids to efficiently and accurately measure the aforementioned tree profile parameters. This can be particularly helpful if spatially extensive and accurate street-level images provided by Google (‘streetview’) or Kakao (‘roadview’) are utilized. We focused on street trees in Seoul, the capital city of South Korea, and suggested a novel approach to create a tree profile and inventory based on deep learning algorithms. We classified urban tree species using the YOLO (You Only Look Once), one of the most popular deep learning object detection algorithms, which provides an uncomplicated method of creating datasets with custom classes. We further utilized semantic segmentation algorithm and graphical analysis to estimate tree profile parameters by determining the relative location of the interface of tree and ground surface. We evaluated the performance of the model by comparing the estimated tree heights, diameters, and locations from the model with the field measurements as ground truth. The results are promising and demonstrate the potential of the method for creating urban street tree profile inventory. In terms of tree species classification, the method showed the mean average precision (mAP) of 0.564. When we used the ideal tree images, the method also reported the normalized root mean squared error (NRMSE) for the tree height, diameter at breast height (DBH), and distances from the camera to the trees as 0.24, 0.44, and 0.41. Numéro de notice : A2022-503 Affiliation des auteurs : non IGN Thématique : FORET/IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.06.004 Date de publication en ligne : 22/06/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.06.004 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101001 [article]

Exemplaires(3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2022081	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2022083	DEP-RECP	Revue	LASTIG	Dépôt en unité	Exclu du prêt
081-2022082	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt