Centre de documentation
scientifique

DeepSim-Nets: Deep Similarity Networks for stereo image matching / Mohamed Ali Chebbi (2023)  

Public Titre : DeepSim-Nets: Deep Similarity Networks for stereo image matching Type de document : Article/Communication Auteurs : Mohamed Ali Chebbi, Auteur ; Ewelina Rupnik , Auteur ; Marc Pierrot-Deseilligny , Auteur ; Paul Lopes, Auteur Editeur : Computer vision foundation CVF Année de publication : 2023 Conférence : CVPR 2023, IEEE Conference on Computer Vision and Pattern Recognition 18/06/2023 22/06/2023 Vancouver Colombie britannique - Canada OA Proceedings Importance : pp 2096 - 2104 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] chaîne de traitement [Termes IGN] géométrie de l'image [Termes IGN] géométrie épipolaire [Termes IGN] réseau neuronal profond Index. décimale : 35.20 Traitement d'image Résumé : (auteur) We present three multi-scale similarity learning architectures, or DeepSim networks. These models learn pixel-level matching with a contrastive loss and are agnostic to the geometry of the considered scene. We establish a middle ground between hybrid and end-to-end approaches by learning to densely allocate all corresponding pixels of an epipolar pair at once. Our features are learnt on large image tiles to be expressive and capture the scene's wider context. We also demonstrate that curated sample mining can enhance the overall robustness of the predicted similarities and improve the performance on radiometrically homogeneous areas. We run experiments on aerial and satellite datasets. Our DeepSim-Nets outperform the baseline hybrid approaches and generalize better to unseen scene geometries than end-to-end methods. Our flexible architecture can be readily adopted in standard multi-resolution image matching pipelines. The code is available at https://github.com/DaliCHEBBI/DeepSimNets. Numéro de notice : C2023-007 Affiliation des auteurs : UGE-LASTIG+Ext (2020- ) Thématique : IMAGERIE/INFORMATIQUE Nature : Communication nature-HAL : ComAvecCL&ActesPubliésIntl DOI : sans En ligne : https://openaccess.thecvf.com/content/CVPR2023W/EarthVision/html/Chebbi_DeepSim- [...] Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=103281

A pipeline for automated processing of Corona KH-4 (1962-1972) stereo imagery / Sajid Ghuffar in IEEE Transactions on geoscience and remote sensing, vol 60 n° 8 (August 2022)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 60 n° 8 (August 2022) . - pp Titre : A pipeline for automated processing of Corona KH-4 (1962-1972) stereo imagery Type de document : Article/Communication Auteurs : Sajid Ghuffar, Auteur ; Tobias Bolch, Auteur ; Ewelina Rupnik , Auteur ; Atanu Bhattacharya, Auteur Année de publication : 2022 Article en page(s) : pp Note générale : bibliographie voir aussi https://research-repository.st-andrews.ac.uk/bitstream/10023/26124/1/Ghuffar_2022_IEEE_TGRS_Pipeline_automated_processing_AAM.pdf Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] apprentissage profond [Termes IGN] chaîne de traitement [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] compensation par faisceaux [Termes IGN] géométrie de l'image [Termes IGN] géométrie épipolaire [Termes IGN] glacier [Termes IGN] Himalaya [Termes IGN] image Corona [Termes IGN] image panoramique [Termes IGN] MNS SRTM [Termes IGN] modèle numérique de surface [Termes IGN] modèle stéréoscopique [Termes IGN] point d'appui Résumé : (auteur) The Corona KH-4 reconnaissance satellite missions from 1962-1972 acquired panoramic stereo imagery with high spatial resolution of 1.8-7.5 m. The potential of 800,000+ declassified Corona images has not been leveraged due to the complexities arising from handling of panoramic imaging geometry, film distortions and limited availability of the metadata required for georeferencing of the Corona imagery. This paper presents Corona Stereo Pipeline (CoSP): A pipeline for processing of Corona KH-4 stereo panoramic imagery. CoSP utlizes a deep learning based feature matcher SuperGlue to automatically match features point between Corona KH-4 images and recent satellite imagery to generate Ground Control Points (GCPs). To model the imaging geometry and the scanning motion of the panoramic KH-4 cameras, a rigorous camera model consisting of modified collinearity equations with time dependent exterior orientation parameters is employed. The results show that using the entire frame of the Corona image, bundle adjustment using well-distributed GCPs results in an average standard deviation (SD) of less than 2 pixels. We evaluate fiducial marks on the Corona films and show that pre-processing the Corona images to compensate for film bending improves the accuracy. We further assess a polynomial epipolar resampling method for rectification of Corona stereo images. The distortion pattern of image residuals of GCPs and y-parallax in epipolar resampled images suggest that film distortions due to long term storage as likely cause of systematic deviations. Compared to the SRTM DEM, the Corona DEM computed using CoSP achieved a Normalized Median Absolute Deviation (NMAD) of elevation differences of ? 4m over an area of approx. 4000km2. We show that the proposed pipeline can be applied to sequence of complex scenes involving high relief and glacierized terrain and that the resulting DEMs can be used to compute long term glacier elevation changes over large areas. Numéro de notice : A2022-952 Affiliation des auteurs : UGE-LASTIG+Ext (2020- ) Autre URL associée : vers ArXiv Thématique : IMAGERIE/INFORMATIQUE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2022.3200151 Date de publication en ligne : 19/08/2022 En ligne : https://doi.org/10.1109/TGRS.2022.3200151 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=103286 [article]

Deep learning based 3D reconstruction: supervision and representation / François Darmon (2022)  

Public Titre : Deep learning based 3D reconstruction: supervision and representation Type de document : Thèse/HDR Auteurs : François Darmon, Auteur ; Pascal Monasse, Directeur de thèse ; Mathieu Aubry, Directeur de thèse Editeur : Champs-sur-Marne : Ecole des Ponts ParisTech Année de publication : 2022 Importance : 115 p. Format : 21 x 30 cm Note générale : Bibliographie Thèse de doctorat de l'Ecole des Ponts ParisTech, spécialité informatique Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] carte de profondeur [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] extraction [Termes IGN] géométrie épipolaire [Termes IGN] maillage [Termes IGN] modèle stéréoscopique [Termes IGN] point d'intérêt [Termes IGN] Ransac (algorithme) [Termes IGN] reconstruction 3D [Termes IGN] reconstruction d'objet [Termes IGN] semis de points [Termes IGN] SIFT (algorithme) [Termes IGN] structure-from-motion [Termes IGN] voxel Index. décimale : THESE Thèses et HDR Résumé : (auteur) 3D reconstruction is a long standing problem in computer vision. Yet, state-of-the-art methods still struggle when the images used have large illumination changes, many occlusions or limited textures. Deep Learning holds promises of improving 3D reconstruction in such setups, but classical methods still produce the best results. In this thesis we analyse the specificity of deep learning applied to multiview 3D reconstruction and introduce new deep learning based methods.The first contribution of this thesis is an analysis of the possible supervision for training Deep Learning models for sparse image matching. We introduce a two-step algorithm that first computes low resolution matches using deep learning and then matches classical local features inside the matches regions. We analyze several levels of supervision and show that our new epipolar supervision leads to the best results.The second contribution is also a study of supervision for Deep Learning but applied to another scenario: calibrated 3D reconstruction in the wild. We show that existing unsupervised methods do not work on such data and we introduce a new training technique that solves this issue. We then exhaustively compare unsupervised approach and supervised approaches with different network architectures and training data.Finally, our third contribution is about data representation. Neural implicit representation were recently used for image rendering. We adapt this representation to the multiview reconstruction problem and we introduce a new method that, similar to classical 3D reconstruction techniques, optimizes photo-consistency between projections of multiple images. Our approach outperforms state-of-the-art by a large margin. Note de contenu : 1- Introduction 2- Background 3- Deep learning for guiding keypoint matching 4- Deep Learning based Multi-View Stereo in the wild 5- Multi-view reconstruction with implicit surfaces and patch warping 6- Conclusion Numéro de notice : 24085 Affiliation des auteurs : non IGN Thématique : IMAGERIE/INFORMATIQUE Nature : Thèse française Note de thèse : Thèse de Doctorat : Informatique : Ponts ParisTech : 2022 Organisme de stage : Laboratoire d'Informatique Gaspard-Monge LIGM DOI : sans En ligne : https://www.theses.fr/2022ENPC0024 Format de la ressource électronique : URL Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102473

The polar epipolar rectification / François Darmon in IPOL Journal, Image Processing On Line, vol 11 (2021)  

Public [article]  inIPOL Journal, Image Processing On Line > vol 11 (2021) . - pp 56 - 75 Titre : The polar epipolar rectification Type de document : Article/Communication Auteurs : François Darmon, Auteur ; Pascal Monasse, Auteur Année de publication : 2021 Article en page(s) : pp 56 - 75 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] couple stéréoscopique [Termes IGN] disparité [Termes IGN] géométrie épipolaire [Termes IGN] orthorectification [Termes IGN] points homologues Résumé : (auteur) Epipolar rectification of a stereo pair is the process of resampling a pair of stereo images so that the apparent motion of corresponding points is horizontal. This is an important preliminary step in depth estimation, substituting depth by disparity estimation. Most methods rely on a perspective transform of both images, which has the advantage to simulate a different attitude of the pinhole cameras. A limitation is that when an epipole is inside the image domain, it has to be sent to infinity by the perspective transform, producing a strong distortion. On the contrary, relying on a polar transform centered at the epipole provides a method applicable universally to a pair of pinhole camera views. We present in detail the algorithm, filling in the information important for its implementation and missing in published articles. Numéro de notice : A2021-782 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.5201/ipol.2021.328 Date de publication en ligne : 02/03/2021 En ligne : https://doi.org/10.5201/ipol.2021.328 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98937 [article]

Spherically optimized RANSAC aided by an IMU for Fisheye Image Matching / Anbang Liang in Remote sensing, vol 13 n°10 (May-2 2021)  

Public [article]  inRemote sensing > vol 13 n°10 (May-2 2021) . - n° 2017 Titre : Spherically optimized RANSAC aided by an IMU for Fisheye Image Matching Type de document : Article/Communication Auteurs : Anbang Liang, Auteur ; Qingquan Li, Auteur ; Zhipeng Chen, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : n° 2017 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] centrale inertielle [Termes IGN] coordonnées sphériques [Termes IGN] distorsion d'image [Termes IGN] estimation de pose [Termes IGN] étalonnage de chambre métrique [Termes IGN] géométrie épipolaire [Termes IGN] image hémisphérique [Termes IGN] Ransac (algorithme) Résumé : (auteur) Fisheye cameras are widely used in visual localization due to the advantage of the wide field of view. However, the severe distortion in fisheye images lead to feature matching difficulties. This paper proposes an IMU-assisted fisheye image matching method called spherically optimized random sample consensus (So-RANSAC). We converted the putative correspondences into fisheye spherical coordinates and then used an inertial measurement unit (IMU) to provide relative rotation angles to assist fisheye image epipolar constraints and improve the accuracy of pose estimation and mismatch removal. To verify the performance of So-RANSAC, experiments were performed on fisheye images of urban drainage pipes and public data sets. The experimental results showed that So-RANSAC can effectively improve the mismatch removal accuracy, and its performance was superior to the commonly used fisheye image matching methods in various experimental scenarios. Numéro de notice : A2021-416 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.3390/rs13102017 Date de publication en ligne : 20/05/2021 En ligne : https://doi.org/10.3390/rs13102017 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97757 [article]

Indoor positioning using PnP problem on mobile phone images / Hana Kubickova in ISPRS International journal of geo-information, vol 9 n° 6 (June 2020)  

Permalink

Epipolar rectification of a generic camera / Marc Pierrot-Deseilligny (2020)    

Permalink

Digital surface model generation from high resolution multi-view stereo satellite imagery / Ke Gong in Photogrammetric Engineering & Remote Sensing, PERS, vol 85 n° 5 (May 2019)  

Permalink

Patch-based detection of dynamic objects in CrowdCam images / Gagan Kanojia in The Visual Computer, vol 35 n° 4 (April 2019)  

Permalink

Towards automatic SAR-optical stereogrammetry over urban areas using very high resolution imagery / Chunping Qiu in ISPRS Journal of photogrammetry and remote sensing, vol 138 (April 2018)  

Permalink

Structure from motion with line segments under relaxed endpoint constraints / Branislav Micusik in International journal of computer vision, vol 124 n° 1 (August 2017)  

Permalink

Geolocation error tracking of ZY-3 three line cameras / Hongbo Pan in ISPRS Journal of photogrammetry and remote sensing, vol 123 (January 2017)  

Permalink

SGM-based seamline determination for urban orthophoto mosaicking / Shiyan Pang in ISPRS Journal of photogrammetry and remote sensing, vol 112 (February 2016)  

Permalink

Construction de modèles 3D à partir de données vidéo fisheye / Julien Moreau (2016)  

Permalink

Photogrammetric processing of spherical panoramas / Gabrielle Fangi in Photogrammetric record, vol 28 n° 143 (September - November 2013)  

Permalink