Centre dedocumentation
scientifique

Structure-aware completion of photogrammetric meshes in urban road environment / Qing Zhu in ISPRS Journal of photogrammetry and remote sensing, vol 175 (May 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 175 (May 2021) . - pp 56 - 70 Titre : Structure-aware completion of photogrammetric meshes in urban road environment Type de document : Article/Communication Auteurs : Qing Zhu, Auteur ; Qisen Shang, Auteur ; Han Hu, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 56 - 70 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] détection d'objet [Termes IGN] détection de partie cachée [Termes IGN] espace urbain [Termes IGN] image aérienne oblique [Termes IGN] maillage [Termes IGN] modélisation 3D [Termes IGN] reconstruction de route [Termes IGN] réseau routier [Termes IGN] texture Résumé : (auteur) Photogrammetric mesh models obtained from aerial oblique images have been widely used for urban reconstruction. However, photogrammetric meshes suffer from severe texture problems, particularly in typical road areas, owing to occlusion. This paper proposes a structure-aware completion approach to improve mesh quality by seamlessly removing undesired vehicles. Specifically, a discontinuous texture atlas is first integrated into a continuous screen space by rendering trough a graphics pipeline. The rendering also records the necessary mapping for deintegration to the original texture atlas after editing. Vehicle regions are masked by a standard object detection approach, namely, Faster RCNN. Subsequently, the masked regions are completed, guided by the linear structures and regularities in the road region; this is implemented based on PatchMatch. Finally, the completed rendered image is deintegrated to the original texture atlas, and the triangles for the vehicles are also flattened so that improved meshes can be obtained. Experimental evaluation and analysis are conducted on three datasets, which were captured with different sensors and ground sample distances. The results demonstrate that the proposed method can produce quite realistic meshes after removing the vehicles. The structure-aware completion approach for road regions outperforms popular image completion methods, and an ablation study further confirms the effectiveness of the linear guidance. It should be noted that the proposed method can also handle tiled mesh models for large-scale scenes. Code and datasets are available at the project website. Numéro de notice : A2021-263 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2021.02.010 date de publication en ligne : 11/03/2021 En ligne : https://doi.org/10.1016/j.isprsjprs.2021.02.010 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97312 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2021051	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2021052	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt
081-2021053	DEP-RECP	Revue	Saint-Mandé	Dépôt en unité	Exclu du prêt

Automated registration of SfM‐MVS multitemporal datasets using terrestrial and oblique aerial images / Luigi Parente in Photogrammetric record, vol 36 n° 173 (March 2021)  

Public [article]  inPhotogrammetric record > vol 36 n° 173 (March 2021) . - pp 12 - 35 Titre : Automated registration of SfM‐MVS multitemporal datasets using terrestrial and oblique aerial images Type de document : Article/Communication Auteurs : Luigi Parente, Auteur ; Jim H. Chandler, Auteur ; Neil Dixon, Auteur Année de publication : 2021 Article en page(s) : pp 12 - 35 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Photogrammétrie numérique [Termes IGN] algorithme ICP [Termes IGN] alignement [Termes IGN] Angleterre [Termes IGN] détection de changement [Termes IGN] données multisources [Termes IGN] données multitemporelles [Termes IGN] géoréférencement direct [Termes IGN] image aérienne oblique [Termes IGN] image captée par drone [Termes IGN] image oblique [Termes IGN] image terrestre [Termes IGN] modèle stéréoscopique [Termes IGN] modélisation 3D [Termes IGN] point d'appui [Termes IGN] semis de points [Termes IGN] SIFT (algorithme) [Termes IGN] structure-from-motion Résumé : (auteur) Accurate alignment of 3D models is critical for valid change‐detection analysis from multitemporal photogrammetric datasets. This paper assesses an automated registration strategy which uses the scale‐invariant feature transform (SIFT) algorithm implemented in modern photogrammetric software. This registration solution, also known as “Time‐SIFT”, was tested at two study sites featuring vertical surfaces, including a sea cliff (~500 m2) and a quarry face (~50 000 m2). Tests demonstrated that the investigated registration strategy can achieve accurate alignments between multitemporal point clouds even when using multisource and multi‐perspective data, captured across widely varying spatial and temporal scales and under a range of weather and illumination conditions. The combination of the Time‐SIFT approach with an ICP algorithm produced moderate improvements in the alignment. Furthermore, the use of an innovative direct georeferencing technique, which used the tracking feature of a robotic total station, allowed for accurate georectification of 3D models. Numéro de notice : A2021-280 Affiliation des auteurs : non IGN Thématique : IMAGERIE/INFORMATIQUE Nature : Article DOI : 10.1111/phor.12346 date de publication en ligne : 06/01/2021 En ligne : https://doi.org/10.1111/phor.12346 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97377 [article]

Feature detection and description for image matching: from hand-crafted design to deep learning / Lin Chen in Geo-spatial Information Science, vol 24 n° 1 (March 2021)  

Public [article]  inGeo-spatial Information Science > vol 24 n° 1 (March 2021) . - pp 58 - 74 Titre : Feature detection and description for image matching: from hand-crafted design to deep learning Type de document : Article/Communication Auteurs : Lin Chen, Auteur ; Franz Rottensteiner, Auteur ; Christian Heipke, Auteur Année de publication : 2021 Article en page(s) : pp 58 - 74 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement automatique [Termes IGN] appariement d'images [Termes IGN] appariement de formes [Termes IGN] apprentissage automatique [Termes IGN] apprentissage profond [Termes IGN] extraction de traits caractéristiques [Termes IGN] image aérienne oblique [Termes IGN] orientation d'image [Termes IGN] SIFT (algorithme) Résumé : (Auteur) In feature based image matching, distinctive features in images are detected and represented by feature descriptors. Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate points. In this paper, we first shortly discuss the general framework. Then, we review feature detection as well as the determination of affine shape and orientation of local features, before analyzing feature description in more detail. In the feature description review, the general framework of local feature description is presented first. Then, the review discusses the evolution from hand-crafted feature descriptors, e.g. SIFT (Scale Invariant Feature Transform), to machine learning and deep learning based descriptors. The machine learning models, the training loss and the respective training data of learning-based algorithms are looked at in more detail; subsequently the various advantages and challenges of the different approaches are discussed. Finally, we present and assess some current research directions before concluding the paper. Numéro de notice : A2021-297 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1080/10095020.2020.1843376 date de publication en ligne : 17/11/2020 En ligne : https://doi.org/10.1080/10095020.2020.1843376 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97379 [article]

Deep learning for feature based image matching / Lin Chen (2021)  

Public Titre : Deep learning for feature based image matching Type de document : Thèse/HDR Auteurs : Lin Chen, Auteur ; Christian Heipke, Directeur de thèse Editeur : Munich : Bayerische Akademie der Wissenschaften Année de publication : 2021 Collection : DGK - C, ISSN 0065-5325 num. 867 Importance : 159 p. Format : 21 x 30 cm Note générale : bibliographie Diese Arbeit ist gleichzeitig veröffentlicht in: Wissenschaftliche Arbeiten der Fachrichtung Geodäsie und Geoinformatik der Leibniz UniversitätHannoverISSN 0174-1454, Nr. 369, Hannover 2021 Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Photogrammétrie numérique [Termes IGN] appariement d'images [Termes IGN] chaîne de traitement [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] descripteur [Termes IGN] image aérienne oblique [Termes IGN] orientation d'image [Termes IGN] orthoimage Résumé : (auteur) Feature based image matching aims at finding matched features between two or more images. It is one of the most fundamental research topics in photogrammetry and computer vision. The matching features area prerequisite for applications such as image orientation, Simultaneous Localization and Mapping (SLAM) and robot vision. A typical feature based matching algorithm is composed of five steps: feature detection, affine shape estimation, orientation, description and descriptor matching. Today, the employment of deep neural network has framed those different steps as machine learning problems and the matching performance has been improved significantly. One of the main reasons why feature based image matching may still prove difficult is the complex change between different images, including geometric and radiometric transformations. If the change between images exceeds a certain level, it will also exceed the tolerance of those aforementioned separate steps and, in turn, cause feature based image matching to fail. This thesis focuses on improving feature based image matching against large viewpoint and viewing direction change between images. In order to improve the feature based image matching performance under these circumstances, affine shape estimation, orientation and description are solved with deep learning architectures. In particular, Convolutional Neural Networks (CNN) are used. For the affine shape and orientation learning, the main contribution of this thesis is two fold. First, instead of a Siamese CNN, only one branch is needed and the loss is built based on the geometric measures calculated from the mean gradient or second moment matrix. Therefore, for each of the input patches, a global minimum, namely the canonical feature, exists. Second, both the affine shape and orientation are solved simultaneously within one network by combining the loss used for affine shape and orientation learning. To the best of the author’s knowledge, this is the first time these two modules are reported to have been successfully trained simultaneously. For the descriptor learning part, a new weak match is defined. For any input feature patch, a slightly transformed patch that lies far from the input feature patch in descriptor space is defined as a weak match feature. A weak match finder network is proposed to actively find these weak match features. In a following step, the found weak matches are used in the standard descriptor learning framework. In this way, the intra-variance of the appearance of matched feature patch pairs is explored in depth and, accordingly, the invariance of feature descriptors against viewpoint and viewing direction change is improved. The proposed feature based image matching method is evaluated on standard benchmarks and is used to solve for the parameters of image orientation. For the image orientation task, aerial oblique images are taken into account. Through analysis of the experiments conducted for small image blocks, it is shown that deep learning feature based image matching leads to more registered images, more reconstructed 3D points and a more stable block connection. Note de contenu : 1- Introduction 2- Basics 3- Related work 4- Deep learning feature representation 5- Experiments and results 6- Discussion 7- Conclusion and outlook Numéro de notice : 17673 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Thèse étrangère Note de thèse : PhD dissertation : Fachrichtung Geodäsie und Geoinformatik : Hanovre : 2021 En ligne : https://dgk.badw.de/fileadmin/user_upload/Files/DGK/docs/c-867.pdf Format de la ressource électronique : URL Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97999

Unifying remote sensing image retrieval and classification with robust fine-tuning / Dimitri Gominski (2021)  

Public Titre : Unifying remote sensing image retrieval and classification with robust fine-tuning Type de document : Article/Communication Auteurs : Dimitri Gominski , Auteur ; Valérie Gouet-Brunet , Auteur ; Liming Chen, Auteur Editeur : Ithaca [New York - Etats-Unis] : ArXiv - Université Cornell Année de publication : 2021 Importance : 7 p. Format : 21 x 30 cm Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] analyse d'image numérique [Termes IGN] apprentissage profond [Termes IGN] base de données d'images [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] image aérienne à axe vertical [Termes IGN] image aérienne oblique [Termes IGN] jeu de données [Termes IGN] précision de la classification [Termes IGN] recherche d'image basée sur le contenu Résumé : (auteur) Advances in high resolution remote sensing image analysisare currently hampered by the difficulty of gathering enoughannotated data for training deep learning methods, giving riseto a variety of small datasets and associated dataset-specificmethods. Moreover, typical tasks such as classification andretrieval lack a systematic evaluation on standard benchmarksand training datasets, which make it hard to identify durableand generalizable scientific contributions. We aim at uni-fying remote sensing image retrieval and classification witha new large-scale training and testing dataset, SF3001, in-cluding both vertical and oblique aerial images and madeavailable to the research community, and an associated fine-tuning method. We additionally propose a new adversarialfine-tuning method for global descriptors. We show that ourframework systematically achieves a boost of retrievalandclassification performance on nine different datasets com-pared to an ImageNet pretrained baseline, with currently noother method to compare to. Numéro de notice : P2021-003 Affiliation des auteurs : UGE-LaSTIG+Ext (2020- ) Thématique : IMAGERIE Nature : Preprint nature-HAL : Préprint DOI : sans En ligne : https://arxiv.org/abs/2102.13392 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97283

Efficient match pair selection for oblique UAV images based on adaptive vocabulary tree / San Jiang in ISPRS Journal of photogrammetry and remote sensing, vol 161 (March 2020)  

Permalink

Co‐registration of panoramic mobile mapping images and oblique aerial images / Phillipp Jende in Photogrammetric record, vol 34 n° 166 (June 2019)  

Permalink

Semantic façade segmentation from airborne oblique images / Yaping Lin in Photogrammetric Engineering & Remote Sensing, PERS, vol 85 n° 6 (June 2019)  

Permalink

Simulation and analysis of photogrammetric UAV image blocks: influence of camera calibration error / Yilin Zhou in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-2/W5 (May 2019)  

Permalink

100% automatic metrology with UAV photogrammetry and embedded GPS, and its application in dike monitoring / Yilin Zhou (2019)  

Permalink

Impact of oblique UAV imagery on canopy models / Anouk Schleich (2019) 

Permalink

Precise DEM extraction from Svalbard using 1936 high oblique imagery / Luc Girod in Geoscientific instrumentation methods and data systems, vol 7 n° 4 ([01/10/2018])    

Permalink

Integration of aerial oblique imagery and terrestrial imagery for optimized 3D modeling in urban areas / Bo Wu in ISPRS Journal of photogrammetry and remote sensing, vol 139 (May 2018)  

Permalink

Generating terrestrial glacier views from historic airphotos for comparison with contemporary ground photographs / Marion Holst (2018) 

Permalink

GNSS-assisted accurate corridor mapping with small UAV / Yilin Zhou (2018)    

Permalink