Centre dedocumentation
scientifique

Deep learning feature representation for image matching under large viewpoint and viewing direction change / Lin Chen in ISPRS Journal of photogrammetry and remote sensing, vol 190 (August 2022)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 190 (August 2022) . - pp 94 -112 Titre : Deep learning feature representation for image matching under large viewpoint and viewing direction change Type de document : Article/Communication Auteurs : Lin Chen, Auteur ; Christian Heipke, Auteur Année de publication : 2022 Article en page(s) : pp 94 -112 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] extraction de traits caractéristiques [Termes IGN] image aérienne oblique [Termes IGN] orientation d'image [Termes IGN] reconnaissance de formes [Termes IGN] réseau neuronal siamois [Termes IGN] SIFT (algorithme) Résumé : (auteur) Feature based image matching has been a research focus in photogrammetry and computer vision for decades, as it is the basis for many applications where multi-view geometry is needed. A typical feature based image matching algorithm contains five steps: feature detection, affine shape estimation, orientation assignment, description and descriptor matching. This paper contains innovative work in different steps of feature matching based on convolutional neural networks (CNN). For the affine shape estimation and orientation assignment, the main contribution of this paper is twofold. First, we define a canonical shape and orientation for each feature. As a consequence, instead of the usual Siamese CNN, only single branch CNNs needs to be employed to learn the affine shape and orientation parameters, which turns the related tasks from supervised to self supervised learning problems, removing the need for known matching relationships between features. Second, the affine shape and orientation are solved simultaneously. To the best of our knowledge, this is the first time these two modules are reported to have been successfully trained together. In addition, for the descriptor learning part, a new weak match finder is suggested to better explore the intra-variance of the appearance of matched features. For any input feature patch, a transformed patch that lies far from the input feature patch in descriptor space is defined as a weak match feature. A weak match finder network is proposed to actively find these weak match features; they are subsequently used in the standard descriptor learning framework. The proposed modules are integrated into an inference pipeline to form the proposed feature matching algorithm. The algorithm is evaluated on standard benchmarks and is used to solve for the parameters of image orientation of aerial oblique images. It is shown that deep learning feature based image matching leads to more registered images, more reconstructed 3D points and a more stable block geometry than conventional methods. The code is available at https://github.com/Childhoo/Chen_Matcher.git. Numéro de notice : A2022-502 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2022.06.003 Date de publication en ligne : 14/06/2022 En ligne : https://doi.org/10.1016/j.isprsjprs.2022.06.003 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101000 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2022081	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2022083	DEP-RECP	Revue	LaSTIG	Dépôt en unité	Exclu du prêt
081-2022082	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Robust registration of aerial images and LiDAR data using spatial constraints and Gabor structural features / Bai Zhu in ISPRS Journal of photogrammetry and remote sensing, Vol 181 (November 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > Vol 181 (November 2021) . - pp 129 - 147 Titre : Robust registration of aerial images and LiDAR data using spatial constraints and Gabor structural features Type de document : Article/Communication Auteurs : Bai Zhu, Auteur ; Yuanxin Ye, Auteur ; Liang Zhou, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 129 - 147 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes IGN] algorithme ICP [Termes IGN] correction géométrique [Termes IGN] données lidar [Termes IGN] données localisées 3D [Termes IGN] élément d'orientation externe [Termes IGN] enregistrement de données [Termes IGN] filtre de Gabor [Termes IGN] image aérienne [Termes IGN] recalage d'image [Termes IGN] semis de points [Termes IGN] SIFT (algorithme) [Termes IGN] structure-from-motion Résumé : (auteur) Co-registration of aerial imagery and Light Detection and Ranging (LiDAR) data is quite challenging because the different imaging mechanisms produce significant geometric and radiometric distortions between the two multimodal data sources. To address this problem, we propose a robust and effective coarse-to-fine registration method that is conducted in two stages utilizing spatial constraints and Gabor structural features. In the first stage, the LiDAR point cloud data is transformed into an intensity map that is used as the reference image. Then, coarse registration is completed by designing a partition-based Features from Accelerated Segment Test (FAST) operator to extract the uniformly distributed interest points in the aerial images and thereafter performing a local geometric correction based on the collinearity equations using the exterior orientation parameters (EoPs). The coarse registration aims to provide a reliable spatial geometry relationship for the subsequent fine registration and is designed to eliminate rotation and scale changes, as well as making only a few translation differences exist between the images. In the second stage, a novel feature descriptor called multi-Scale and multi-Directional Features of odd Gabor (SDFG) is first built to capture the multi-scale and multi-directional structural properties of the images. Then, the three-dimensional (3D) phase correlation (PC) of the SDFG descriptor is established to detect the control points (CPs) between the aerial and LiDAR intensity image in the frequency domain, where the image matching is accelerated by the 3D Fast Fourier Transform (FFT) technique. Finally, the obtained CPs not only are employed to refine the EoPs, but also are used to achieve the fine registration of the aerial images and LiDAR data. We conduct experiments to verify the robustness of the proposed registration method using three sets of aerial images and LiDAR data with different scene coverage. Experimental results show that the proposed method is robust to geometric distortions and radiometric changes. Moreover, it achieves the registration accuracy of less than 2 pixels for all cases, which outperforms the current four state-of-the-art methods, demonstrating its superior registration performance. Numéro de notice : A2021-773 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.09.010 Date de publication en ligne : 21/09/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.09.010 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98830 [article]

An automatic workflow for orientation of historical images with large radiometric and geometric differences / Ferdinand Maiwald in Photogrammetric record, vol 36 n° 174 (June 2021)  

Public [article]  inPhotogrammetric record > vol 36 n° 174 (June 2021) . - pp 77 - 103 Titre : An automatic workflow for orientation of historical images with large radiometric and geometric differences Type de document : Article/Communication Auteurs : Ferdinand Maiwald, Auteur ; Hans-Gerd Maas, Auteur Année de publication : 2021 Article en page(s) : pp 77 - 103 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement de formes [Termes IGN] artefact [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] extraction de traits caractéristiques [Termes IGN] image ancienne [Termes IGN] plus proche voisin, algorithme du [Termes IGN] réalité augmentée [Termes IGN] réalité virtuelle [Termes IGN] reconstruction 3D [Termes IGN] scène urbaine [Termes IGN] SIFT (algorithme) [Termes IGN] structure-from-motion Résumé : (auteur) This contribution proposes a workflow for a completely automatic orientation of historical terrestrial urban images. Automatic structure from motion (SfM) software packages often fail when applied to historical image pairs due to large radiometric and geometric differences causing challenges with feature extraction and reliable matching. As an innovative initialising step, the proposed method uses the neural network D2-Net for feature extraction and Lowe’s mutual nearest neighbour matcher. The principal distance for every camera is estimated using vanishing point detection. The results were compared to three state-of-the-art SfM workflows (Agisoft Metashape, Meshroom and COLMAP) with the proposed workflow outperforming the other SfM tools. The resulting camera orientation data are planned to be imported into a web and virtual/augmented reality (VR/AR) application for the purpose of knowledge transfer in cultural heritage. Numéro de notice : A2021-471 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1111/phor.12363 Date de publication en ligne : 06/06/2021 En ligne : https://doi.org/10.1111/phor.12363 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97925 [article]

Research on feature extraction method of indoor visual positioning image based on area division of foreground and background / Ping Zheng in ISPRS International journal of geo-information, vol 10 n° 6 (June 2021)  

Public [article]  inISPRS International journal of geo-information > vol 10 n° 6 (June 2021) . - n° 402 Titre : Research on feature extraction method of indoor visual positioning image based on area division of foreground and background Type de document : Article/Communication Auteurs : Ping Zheng, Auteur ; Danyang Qin, Auteur ; Bing Han, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : n° 402 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] corrélation à l'aide de traits caractéristiques [Termes IGN] extraction de traits caractéristiques [Termes IGN] logiciel libre [Termes IGN] positionnement en intérieur [Termes IGN] Ransac (algorithme) [Termes IGN] SIFT (algorithme) [Termes IGN] SURF (algorithme) Résumé : (auteur) In the process of indoor visual positioning and navigation, difficult points often exist in corridors, stairwells, and other scenes that contain large areas of white walls, strong consistent background, and sparse feature points. Aiming at the problem of positioning and navigation in the real physical world where the walls with sparse feature points are difficult to be filled with pictures, this paper designs a feature extraction method, ARAC (Adaptive Region Adjustment based on Consistency) using Free and Open-Source Software and tools. It divides the image into foreground and background and extracts their features respectively, to achieve not only retain positioning information but also focus more energy on the foreground area which is favourable for navigation. In the test phase, under the combined conditions of illumination, scale and affine changes, the feature matching maps by the feature extraction algorithm proposed in this paper are compared with those by SIFT and SURF. Experiments show that the number of correctly matched feature pairs obtained by ARAC is better than SIFT and SURF, and whose time of feature extraction and matching is comparable to SURF, which verifies the accuracy and efficiency of the ARAC feature extraction method. Numéro de notice : A2021-518 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.3390/ijgi10060402 Date de publication en ligne : 11/06/2021 En ligne : https://doi.org/10.3390/ijgi10060402 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97940 [article]

Visual positioning in indoor environments using RGB-D images and improved vector of local aggregated descriptors / Longyu Zhang in ISPRS International journal of geo-information, vol 10 n° 4 (April 2021)  

Public [article]  inISPRS International journal of geo-information > vol 10 n° 4 (April 2021) . - n° 195 Titre : Visual positioning in indoor environments using RGB-D images and improved vector of local aggregated descriptors Type de document : Article/Communication Auteurs : Longyu Zhang, Auteur ; Hao Xia, Auteur ; Qingjun Liu, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : n° 195 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification par nuées dynamiques [Termes IGN] estimation de pose [Termes IGN] extraction de traits caractéristiques [Termes IGN] image RVB [Termes IGN] modélisation 3D [Termes IGN] positionnement en intérieur [Termes IGN] Ransac (algorithme) [Termes IGN] scène intérieure [Termes IGN] semis de points [Termes IGN] SIFT (algorithme) [Termes IGN] SURF (algorithme) [Termes IGN] téléphone intelligent [Termes IGN] vision par ordinateur Résumé : (auteur) Positioning information has become one of the most important information for processing and displaying on smart mobile devices. In this paper, we propose a visual positioning method using RGB-D image on smart mobile devices. Firstly, the pose of each image in the training set is calculated through feature extraction and description, image registration, and pose map optimization. Then, in the image retrieval stage, the training set and the query set are clustered to generate the vector of local aggregated descriptors (VLAD) description vector. In order to overcome the problem that the description vector loses the image color information and improve the retrieval accuracy under different lighting conditions, the opponent color information and depth information are added to the description vector for retrieval. Finally, using the point cloud corresponding to the retrieval result image and its pose, the pose of the retrieved image is calculated by perspective-n-point (PnP) method. The results of indoor scene positioning under different illumination conditions show that the proposed method not only improves the positioning accuracy compared with the original VLAD and ORB-SLAM2, but also has high computational efficiency. Numéro de notice : A2021-481 Affiliation des auteurs : non IGN Thématique : IMAGERIE/POSITIONNEMENT Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.3390/ijgi10040195 Date de publication en ligne : 24/03/2021 En ligne : https://doi.org/10.3390/ijgi10040195 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97425 [article]

Automated registration of SfM‐MVS multitemporal datasets using terrestrial and oblique aerial images / Luigi Parente in Photogrammetric record, vol 36 n° 173 (March 2021)  

Permalink

Feature detection and description for image matching: from hand-crafted design to deep learning / Lin Chen in Geo-spatial Information Science, vol 24 n° 1 (March 2021)  

Permalink

Improving traffic sign recognition results in urban areas by overcoming the impact of scale and rotation / Roholah Yazdan in ISPRS Journal of photogrammetry and remote sensing, vol 171 (January 2021)  

Permalink

Guided feature matching for multi-epoch historical image blocks pose estimation / Lulin Zhang in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, V-2 (August 2020)  

Permalink

Structure from motion for complex image sets / Mario Michelini in ISPRS Journal of photogrammetry and remote sensing, vol 166 (August 2020)  

Permalink

An Illumination Insensitive descriptor combining the CSLBP features for street view images in augmented reality: experimental studies / Zejun Xiang in ISPRS International journal of geo-information, vol 9 n° 6 (June 2020)  

Permalink

Indoor positioning using PnP problem on mobile phone images / Hana Kubickova in ISPRS International journal of geo-information, vol 9 n° 6 (June 2020)  

Permalink

Reducing shadow effects on the co-registration of aerial image pairs / Matthew Plummer in Photogrammetric Engineering & Remote Sensing, PERS, vol 86 n° 3 (March 2020)  

Permalink

Pré-localisation des données pour la modélisation 3D de tunnels : développements et évaluations / Christophe Heinkelé in Revue Française de Photogrammétrie et de Télédétection, n° 221 (novembre 2019)  

Permalink

Fusion of thermal imagery with point clouds for building façade thermal attribute mapping / Dong Lin in ISPRS Journal of photogrammetry and remote sensing, vol 151 (May 2019)  

Permalink