Centre dedocumentation
scientifique

Deep learning based 3D reconstruction: supervision and representation / François Darmon (2022)  

Public Titre : Deep learning based 3D reconstruction: supervision and representation Type de document : Thèse/HDR Auteurs : François Darmon, Auteur ; Pascal Monasse, Directeur de thèse ; Mathieu Aubry, Directeur de thèse Editeur : Champs-sur-Marne : Ecole des Ponts ParisTech Année de publication : 2022 Importance : 115 p. Format : 21 x 30 cm Note générale : Bibliographie Thèse de doctorat de l'Ecole des Ponts ParisTech, spécialité informatique Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] carte de profondeur [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] extraction [Termes IGN] géométrie épipolaire [Termes IGN] maillage [Termes IGN] modèle stéréoscopique [Termes IGN] point d'intérêt [Termes IGN] Ransac (algorithme) [Termes IGN] reconstruction 3D [Termes IGN] reconstruction d'objet [Termes IGN] semis de points [Termes IGN] SIFT (algorithme) [Termes IGN] structure-from-motion [Termes IGN] voxel Index. décimale : THESE Thèses et HDR Résumé : (auteur) 3D reconstruction is a long standing problem in computer vision. Yet, state-of-the-art methods still struggle when the images used have large illumination changes, many occlusions or limited textures. Deep Learning holds promises of improving 3D reconstruction in such setups, but classical methods still produce the best results. In this thesis we analyse the specificity of deep learning applied to multiview 3D reconstruction and introduce new deep learning based methods.The first contribution of this thesis is an analysis of the possible supervision for training Deep Learning models for sparse image matching. We introduce a two-step algorithm that first computes low resolution matches using deep learning and then matches classical local features inside the matches regions. We analyze several levels of supervision and show that our new epipolar supervision leads to the best results.The second contribution is also a study of supervision for Deep Learning but applied to another scenario: calibrated 3D reconstruction in the wild. We show that existing unsupervised methods do not work on such data and we introduce a new training technique that solves this issue. We then exhaustively compare unsupervised approach and supervised approaches with different network architectures and training data.Finally, our third contribution is about data representation. Neural implicit representation were recently used for image rendering. We adapt this representation to the multiview reconstruction problem and we introduce a new method that, similar to classical 3D reconstruction techniques, optimizes photo-consistency between projections of multiple images. Our approach outperforms state-of-the-art by a large margin. Note de contenu : 1- Introduction 2- Background 3- Deep learning for guiding keypoint matching 4- Deep Learning based Multi-View Stereo in the wild 5- Multi-view reconstruction with implicit surfaces and patch warping 6- Conclusion Numéro de notice : 24085 Affiliation des auteurs : non IGN Thématique : IMAGERIE/INFORMATIQUE Nature : Thèse française Note de thèse : Thèse de Doctorat : Informatique : Ponts ParisTech : 2022 Organisme de stage : Laboratoire d'Informatique Gaspard-Monge LIGM DOI : sans En ligne : https://www.theses.fr/2022ENPC0024 Format de la ressource électronique : URL Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102473

A pipeline for automated processing of Corona KH-4 (1962-1972) stereo imagery / Sajid Ghuffar (2022)  

Public contenu dans ArXiv / Université Cornell (Etats-Unis) (1991)   Titre : A pipeline for automated processing of Corona KH-4 (1962-1972) stereo imagery Type de document : Article/Communication Auteurs : Sajid Ghuffar, Auteur ; Tobias Bolch, Auteur ; Ewelina Rupnik , Auteur ; Atanu Bhattacharya, Auteur Editeur : Ithaca [New York - Etats-Unis] : ArXiv - Université Cornell Année de publication : 2022 Projets : 1-Pas de projet / Importance : pp 1 - 24 Format : 21 x 30 cm Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] apprentissage profond [Termes IGN] chaîne de traitement [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] compensation par faisceaux [Termes IGN] géométrie de l'image [Termes IGN] géométrie épipolaire [Termes IGN] glacier [Termes IGN] Himalaya [Termes IGN] image Corona [Termes IGN] image panoramique [Termes IGN] MNS SRTM [Termes IGN] modèle numérique de surface [Termes IGN] modèle stéréoscopique [Termes IGN] point d'appui Résumé : (auteur) The Corona KH-4 reconnaissance satellite missions from 1962-1972 acquired panoramic stereo imagery with high spatial resolution of 1.8-7.5 m. The potential of 800,000+ declassified Corona images has not been leveraged due to the complexities arising from handling of panoramic imaging geometry, film distortions and limited availability of the metadata required for georeferencing of the Corona imagery. This paper presents Corona Stereo Pipeline (CoSP): A pipeline for processing of Corona KH-4 stereo panoramic imagery. CoSP utlizes a deep learning based feature matcher SuperGlue to automatically match features point between Corona KH-4 images and recent satellite imagery to generate Ground Control Points (GCPs). To model the imaging geometry and the scanning motion of the panoramic KH-4 cameras, a rigorous camera model consisting of modified collinearity equations with time dependent exterior orientation parameters is employed. The results show that using the entire frame of the Corona image, bundle adjustment using well-distributed GCPs results in an average standard deviation (SD) of less than 2 pixels. We evaluate fiducial marks on the Corona films and show that pre-processing the Corona images to compensate for film bending improves the accuracy. We further assess a polynomial epipolar resampling method for rectification of Corona stereo images. The distortion pattern of image residuals of GCPs and y-parallax in epipolar resampled images suggest that film distortions due to long term storage as likely cause of systematic deviations. Compared to the SRTM DEM, the Corona DEM computed using CoSP achieved a Normalized Median Absolute Deviation (NMAD) of elevation differences of ? 4m over an area of approx. 4000km2. We show that the proposed pipeline can be applied to sequence of complex scenes involving high relief and glacierized terrain and that the resulting DEMs can be used to compute long term glacier elevation changes over large areas. Numéro de notice : P2022-001 Affiliation des auteurs : UGE-LASTIG+Ext (2020- ) Thématique : IMAGERIE Nature : Article nature-HAL : Préprint DOI : 10.48550/arXiv.2201.07756 Date de publication en ligne : 09/01/2022 En ligne : https://doi.org/10.48550/arXiv.2201.07756 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=99614

The polar epipolar rectification / François Darmon in IPOL Journal, Image Processing On Line, vol 11 (2021)  

Public [article]  inIPOL Journal, Image Processing On Line > vol 11 (2021) . - pp 56 - 75 Titre : The polar epipolar rectification Type de document : Article/Communication Auteurs : François Darmon, Auteur ; Pascal Monasse, Auteur Année de publication : 2021 Article en page(s) : pp 56 - 75 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] couple stéréoscopique [Termes IGN] disparité [Termes IGN] géométrie épipolaire [Termes IGN] orthorectification [Termes IGN] points homologues Résumé : (auteur) Epipolar rectification of a stereo pair is the process of resampling a pair of stereo images so that the apparent motion of corresponding points is horizontal. This is an important preliminary step in depth estimation, substituting depth by disparity estimation. Most methods rely on a perspective transform of both images, which has the advantage to simulate a different attitude of the pinhole cameras. A limitation is that when an epipole is inside the image domain, it has to be sent to infinity by the perspective transform, producing a strong distortion. On the contrary, relying on a polar transform centered at the epipole provides a method applicable universally to a pair of pinhole camera views. We present in detail the algorithm, filling in the information important for its implementation and missing in published articles. Numéro de notice : A2021-782 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.5201/ipol.2021.328 Date de publication en ligne : 02/03/2021 En ligne : https://doi.org/10.5201/ipol.2021.328 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=98937 [article]

Spherically optimized RANSAC aided by an IMU for Fisheye Image Matching / Anbang Liang in Remote sensing, vol 13 n°10 (May-2 2021)  

Public [article]  inRemote sensing > vol 13 n°10 (May-2 2021) . - n° 2017 Titre : Spherically optimized RANSAC aided by an IMU for Fisheye Image Matching Type de document : Article/Communication Auteurs : Anbang Liang, Auteur ; Qingquan Li, Auteur ; Zhipeng Chen, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : n° 2017 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] centrale inertielle [Termes IGN] coordonnées sphériques [Termes IGN] distorsion d'image [Termes IGN] estimation de pose [Termes IGN] étalonnage de chambre métrique [Termes IGN] géométrie épipolaire [Termes IGN] image hémisphérique [Termes IGN] Ransac (algorithme) Résumé : (auteur) Fisheye cameras are widely used in visual localization due to the advantage of the wide field of view. However, the severe distortion in fisheye images lead to feature matching difficulties. This paper proposes an IMU-assisted fisheye image matching method called spherically optimized random sample consensus (So-RANSAC). We converted the putative correspondences into fisheye spherical coordinates and then used an inertial measurement unit (IMU) to provide relative rotation angles to assist fisheye image epipolar constraints and improve the accuracy of pose estimation and mismatch removal. To verify the performance of So-RANSAC, experiments were performed on fisheye images of urban drainage pipes and public data sets. The experimental results showed that So-RANSAC can effectively improve the mismatch removal accuracy, and its performance was superior to the commonly used fisheye image matching methods in various experimental scenarios. Numéro de notice : A2021-416 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.3390/rs13102017 Date de publication en ligne : 20/05/2021 En ligne : https://doi.org/10.3390/rs13102017 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97757 [article]

Indoor positioning using PnP problem on mobile phone images / Hana Kubickova in ISPRS International journal of geo-information, vol 9 n° 6 (June 2020)  

Public [article]  inISPRS International journal of geo-information > vol 9 n° 6 (June 2020) . - 19 p. Titre : Indoor positioning using PnP problem on mobile phone images Type de document : Article/Communication Auteurs : Hana Kubickova, Auteur ; Karel Jedlička, Auteur ; Radek Fiala, Auteur ; Daniel Beran, Auteur Année de publication : 2020 Article en page(s) : 19 p. Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] appariement d'images [Termes IGN] base de données d'images [Termes IGN] couplage GNSS-INS [Termes IGN] décomposition d'image [Termes IGN] extraction de traits caractéristiques [Termes IGN] géométrie épipolaire [Termes IGN] point d'appui [Termes IGN] positionnement en intérieur [Termes IGN] recherche d'image basée sur le contenu [Termes IGN] SIFT (algorithme) [Termes IGN] téléphone intelligent [Termes IGN] vision par ordinateur Résumé : (auteur) As people grow accustomed to effortless outdoor navigation, there is a rising demand for similar possibilities indoors as well. Unfortunately, indoor localization, being one of the requirements for navigation, continues to be a problem without a clear solution. In this article, we are proposing a method for an indoor positioning system using a single image. This is made possible using a small preprocessed database of images with known control points as the only preprocessing needed. Using feature detection with the SIFT (Scale Invariant Feature Transform) algorithm, we can look through the database and find an image that is the most similar to the image taken by a user. Such a pair of images is then used to find coordinates of a database of images using the PnP problem. Furthermore, projection and essential matrices are determined to calculate the user image localization—determining the position of the user in the indoor environment. The benefits of this approach lie in the single image being the only input from a user and the lack of requirements for new onsite infrastructure. Thus, our approach enables a more straightforward realization for building management. Numéro de notice : A2020-309 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.3390/ijgi9060368 Date de publication en ligne : 02/06/2020 En ligne : https://doi.org/10.3390/ijgi9060368 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=95156 [article]

Epipolar rectification of a generic camera / Marc Pierrot-Deseilligny (2020)    

Permalink

Digital surface model generation from high resolution multi-view stereo satellite imagery / Ke Gong in Photogrammetric Engineering & Remote Sensing, PERS, vol 85 n° 5 (May 2019)  

Permalink

Patch-based detection of dynamic objects in CrowdCam images / Gagan Kanojia in The Visual Computer, vol 35 n° 4 (April 2019)  

Permalink

Towards automatic SAR-optical stereogrammetry over urban areas using very high resolution imagery / Chunping Qiu in ISPRS Journal of photogrammetry and remote sensing, vol 138 (April 2018)  

Permalink

Structure from motion with line segments under relaxed endpoint constraints / Branislav Micusik in International journal of computer vision, vol 124 n° 1 (August 2017)  

Permalink

Geolocation error tracking of ZY-3 three line cameras / Hongbo Pan in ISPRS Journal of photogrammetry and remote sensing, vol 123 (January 2017)  

Permalink

SGM-based seamline determination for urban orthophoto mosaicking / Shiyan Pang in ISPRS Journal of photogrammetry and remote sensing, vol 112 (February 2016)  

Permalink

Construction de modèles 3D à partir de données vidéo fisheye / Julien Moreau (2016)  

Permalink

Photogrammetric processing of spherical panoramas / Gabrielle Fangi in Photogrammetric record, vol 28 n° 143 (September - November 2013)  

Permalink

Detection and 3D reconstruction of traffic signs from multiple view color images / Bahman Soheilian in ISPRS Journal of photogrammetry and remote sensing, vol 77 (March 2013)  

Permalink