Centre dedocumentation
scientifique

Multi-view performance capture of surface details / Nadia Robertini in International journal of computer vision, vol 124 n° 1 (August 2017)  

Public [article]  inInternational journal of computer vision > vol 124 n° 1 (August 2017) . - pp 96 – 113 Titre : Multi-view performance capture of surface details Type de document : Article/Communication Auteurs : Nadia Robertini, Auteur ; Dan Casas, Auteur ; Edilson De Aguiar, Auteur ; Christian Theobalt, Auteur Année de publication : 2017 Article en page(s) : pp 96 – 113 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes descripteurs IGN] courbe de Gauss [Termes descripteurs IGN] échelle d'intensité [Termes descripteurs IGN] image numérique [Termes descripteurs IGN] image vidéo [Termes descripteurs IGN] maille triangulaire [Termes descripteurs IGN] modèle de déformation des images [Termes descripteurs IGN] niveau de détail [Termes descripteurs IGN] noeud [Termes descripteurs IGN] optimisation (mathématiques) [Termes descripteurs IGN] reconstruction d'objet Résumé : (auteur) This paper presents a novel approach to recover true fine surface detail of deforming meshes reconstructed from multi-view video. Template-based methods for performance capture usually produce a coarse-to-medium scale detail 4D surface reconstruction which does not contain the real high-frequency geometric detail present in the original video footage. Fine scale deformation is often incorporated in a second pass by using stereo constraints, features, or shading-based refinement. In this paper, we propose an alternative solution to this second stage by formulating dense dynamic surface reconstruction as a global optimization problem of the densely deforming surface. Our main contribution is an implicit representation of a deformable mesh that uses a set of Gaussian functions on the surface to represent the initial coarse mesh, and a set of Gaussians for the images to represent the original captured multi-view images. We effectively find the fine scale deformations for all mesh vertices, which maximize photo-temporal-consistency, by densely optimizing our model-to-image consistency energy on all vertex positions. Our formulation yields a smooth closed form energy with implicit occlusion handling and analytic derivatives. Furthermore, it does not require error-prone correspondence finding or discrete sampling of surface displacement values. We demonstrate our approach on a variety of datasets of human subjects wearing loose clothing and performing different motions. We qualitatively and quantitatively demonstrate that our technique successfully reproduces finer detail than the input baseline geometry. Numéro de notice : A2017-401 Thématique : IMAGERIE Nature : Article En ligne : https://doi.org/10.1007/s11263-016-0979-1 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=85943 [article]

Refining geometry from depth sensors using IR shading images / Gyeongmin Choe in International journal of computer vision, vol 122 n° 1 (March 2017)  

Public [article]  inInternational journal of computer vision > vol 122 n° 1 (March 2017) . - pp 1 – 16 Titre : Refining geometry from depth sensors using IR shading images Type de document : Article/Communication Auteurs : Gyeongmin Choe, Auteur ; Jaesik Park, Auteur ; Yu-Wing Tai, Auteur ; In So Kweon, Auteur Année de publication : 2017 Article en page(s) : pp 1 – 16 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes descripteurs IGN] albedo [Termes descripteurs IGN] bande infrarouge [Termes descripteurs IGN] décomposition d'image [Termes descripteurs IGN] géométrie affine [Termes descripteurs IGN] image optique [Termes descripteurs IGN] Kinect [Termes descripteurs IGN] maille triangulaire [Termes descripteurs IGN] ombre Résumé : (auteur) We propose a method to refine geometry of 3D meshes from a consumer level depth camera, e.g. Kinect, by exploiting shading cues captured from an infrared (IR) camera. A major benefit to using an IR camera instead of an RGB camera is that the IR images captured are narrow band images that filter out most undesired ambient light, which makes our system robust against natural indoor illumination. Moreover, for many natural objects with colorful textures in the visible spectrum, the subjects appear to have a uniform albedo in the IR spectrum. Based on our analyses on the IR projector light of the Kinect, we define a near light source IR shading model that describes the captured intensity as a function of surface normals, albedo, lighting direction, and distance between light source and surface points. To resolve the ambiguity in our model between the normals and distances, we utilize an initial 3D mesh from the Kinect fusion and multi-view information to reliably estimate surface details that were not captured and reconstructed by the Kinect fusion. Our approach directly operates on the mesh model for geometry refinement. We ran experiments on our algorithm for geometries captured by both the Kinect I and Kinect II, as the depth acquisition in Kinect I is based on a structured-light technique and that of the Kinect II is based on a time-of-flight technology. The effectiveness of our approach is demonstrated through several challenging real-world examples. We have also performed a user study to evaluate the quality of the mesh models before and after our refinements. Numéro de notice : A2017-174 Thématique : IMAGERIE Nature : Article En ligne : https://doi.org/10.1007/s11263-016-0937-y Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=85921 [article]

Une deuxième itération du processus photogrammétrique pour améliorer la précision de mise en place des images / Truong Giang Nguyen (2017)  

Public Titre : Une deuxième itération du processus photogrammétrique pour améliorer la précision de mise en place des images Type de document : Article/Communication Auteurs : Truong Giang Nguyen, Auteur ; Marc Pierrot-Deseilligny , Auteur ; Jean-Michaël Muller, Auteur ; Christian Thom , Auteur Congrès : Congrès: SFPT 2017, colloque Photogrammétrie et télédétection : vers la convergence ? (mars 2017; Champs/Marne, France), Commanditaire Editeur : Saint-Mandé : Institut national de l'information géographique et forestière - IGN Année de publication : 2017 Note générale : lien vers le ppt Langues : Français (fre) Descripteur : [Vedettes matières IGN] Photogrammétrie [Termes descripteurs IGN] données localisées 3D [Termes descripteurs IGN] image numérique [Termes descripteurs IGN] itération [Termes descripteurs IGN] maille triangulaire [Termes descripteurs IGN] MicMac [Termes descripteurs IGN] point d'intérêt [Termes descripteurs IGN] points homologues Numéro de notice : C2017-023 Thématique : IMAGERIE/INFORMATIQUE Nature : Communication nature-HAL : ComSansActesPubliés-Unpublished DOI : sans En ligne : https://www.sfpt.fr/wp-content/uploads/2017/04/nguyen-truong-giang_colloque_SFPT [...] Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=89284

Automatic registration of MLS point clouds and SfM meshes of urban area / Reiji Yoshimura in Geo-spatial Information Science, vol 19 n° 3 (October 2016)  

Public [article]  inGeo-spatial Information Science > vol 19 n° 3 (October 2016) . - pp Titre : Automatic registration of MLS point clouds and SfM meshes of urban area Type de document : Article/Communication Auteurs : Reiji Yoshimura, Auteur ; Hiroaki Date, Auteur ; Satoshi Kanai, Auteur ; Ryohei Honma, Auteur ; Kazuo Oda, Auteur ; Tatsuya Ikeda, Auteur Année de publication : 2016 Article en page(s) : pp Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications photogrammétriques [Termes descripteurs IGN] algorithme ICP [Termes descripteurs IGN] données lidar [Termes descripteurs IGN] données localisées 3D [Termes descripteurs IGN] extraction de traits caractéristiques [Termes descripteurs IGN] maille triangulaire [Termes descripteurs IGN] méthode des moindres carrés [Termes descripteurs IGN] modèle 3D de l'espace urbain [Termes descripteurs IGN] Ransac (algorithme) [Termes descripteurs IGN] similitude [Termes descripteurs IGN] structure-from-motion [Termes descripteurs IGN] zone urbaine Résumé : (auteur) Recent advances in 3D scanning technologies allow us to acquire accurate and dense 3D scan data of large-scale environments efficiently. Currently, there are various methods for acquiring large-scale 3D scan data, such as Mobile Laser Scanning (MLS), Airborne Laser Scanning, Terrestrial Laser Scanning, photogrammetry and Structure from Motion (SfM). Especially, MLS is useful to acquire dense point clouds of road and road-side objects, and SfM is a powerful technique to reconstruct meshes with textures from a set of digital images. In this research, a registration method of point clouds from vehicle-based MLS (MLS point cloud), and textured meshes from the SfM of aerial photographs (SfM mesh), is proposed for creating high-quality surface models of urban areas by combining them. In general, SfM mesh has non-scale information; therefore, scale, position, and orientation of the SfM mesh are adjusted in the registration process. In our method, first, 2D feature points are extracted from both SfM mesh and MLS point cloud. This process consists of ground- and building-plane extraction by region growing, random sample consensus and least square method, vertical edge extraction by detecting intersections between the planes, and feature point extraction by intersection tests between the ground plane and the edges. Then, the corresponding feature points between the MLS point cloud and the SfM mesh are searched efficiently, using similarity invariant features and hashing. Next, the coordinate transformation is applied to the SfM mesh so that the ground planes and corresponding feature points are adjusted. Finally, scaling Iterative Closest Point algorithm is applied for accurate registration. Experimental results for three data-sets show that our method is effective for the registration of SfM mesh and MLS point cloud of urban areas including buildings. Numéro de notice : A2016--116 Thématique : IMAGERIE Nature : Article En ligne : http://dx.doi.org/10.1080/10095020.2016.1212517 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=84774 [article]

3D watertight mesh generation with uncertainties from ubiquitous data / Laurent Caraffa (2016)  

Public Titre : 3D watertight mesh generation with uncertainties from ubiquitous data Type de document : Article/Communication Auteurs : Laurent Caraffa , Auteur ; Mathieu Brédif , Auteur ; Bruno Vallet , Auteur Congrès : ACCV 2016, 13th Asian Conference on Computer Vision (20 - 24 novembre 2016; Taipei, Taiwan), Commanditaire Editeur : Springer International Publishing Année de publication : 2016 Collection : Lecture Notes in Computer Science num. 10114 Projets : IQmulus / Brédif, Mathieu Importance : pp 377 - 391 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications photogrammétriques [Termes descripteurs IGN] algorithme Graph-Cut [Termes descripteurs IGN] carte de confiance [Termes descripteurs IGN] distance de Hausdorff [Termes descripteurs IGN] incertitude géométrique [Termes descripteurs IGN] maille triangulaire [Termes descripteurs IGN] reconstruction d'objet [Termes descripteurs IGN] seuillage [Termes descripteurs IGN] surface imperméable [Termes descripteurs IGN] théorie de Dempster-Shafer Résumé : (auteur) In this paper, we propose a generic framework for watertight mesh generation with uncertainties that provides a confidence measure on each reconstructed mesh triangle. Its input is a set of vision-based or Lidar-based 3D measurements which are converted to a set of mass functions that characterize the level of confidence on the occupancy of the scene as occupied, empty or unknown based on Dempster-Shafer Theory. The output is a multi-label segmentation of the ambient 3D space expressing the confidence for each resulting volume element to be occupied or empty. While existing methods either sacrifice watertightness (local methods) or need to introduce a smoothness prior (global methods), we derive a per-triangle confidence measure that is able to gradually characterize when the resulting surface patches are certain due to dense and coherent measurements and when these patches are more uncertain and are mainly present to ensure smoothness and/or watertightness. The surface mesh reconstruction is formulated as a global energy minimization problem efficiently optimized with the α-expansion algorithm. We claim that the resulting confidence measure is a good estimate of the local lack of sufficiently dense and coherent input measurements, which would be a valuable input for the next-best-view scheduling of a complementary acquisition. Beside the new formulation, the proposed approach achieves state-of-the-art results on surface reconstruction benchmark. It is robust to noise, manages high scale disparity and produces a watertight surface with a small Hausdorff distance in uncertainty area thanks to the multi-label formulation. By simply thresholding the result, the method shows a good reconstruction quality compared to local algorithms on high density data. This is demonstrated on a large scale reconstruction combining real-world datasets from airborne and terrestrial Lidar and on an indoor scene reconstructed from images. Numéro de notice : C2016-024 Thématique : IMAGERIE Nature : Communication nature-HAL : ComAvecCL&ActesPubliésIntl DOI : 10.1007/978-3-319-54190-7_23 date de publication en ligne : 12/03/2017 En ligne : http://doi.org/10.1007/978-3-319-54190-7_23 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=84627

A triangular form-based multiple flow algorithm to estimate overland flow distribution and accumulation on a digital elevation model / Petter Pilesjö in Transactions in GIS, vol 18 n° 1 (February 2014)  

Permalink

Shared earth modeling / Michel Perrin (2013)

Permalink

Insertion of 3-D-primitives in mesh-based representations: Towards compact models preserving the details / Florent Lafarge in IEEE Transactions on image processing, vol 19 n° 7 (July 2010)  

Permalink

Accuracy of quantized Voronoi diagrams / Yukio Sadahiro in International journal of geographical information science IJGIS, vol 20 n° 10 (november 2006)

Permalink

An algorithm for the generation of Voronoi diagrams on the sphere based on QTM [quaternary triangular mesh] / J. Chen in Photogrammetric Engineering & Remote Sensing, PERS, vol 69 n° 1 (January 2003)

Permalink

Determination of grid size for digital terrain modelling in landscape investigations: exemplified by soil moisture distribution at a micro-scale / I.V. Florinsky in International journal of geographical information science IJGIS, vol 14 n° 8 (december 2000)

Permalink

Travaux sur modèles numériques de terrain, travaux sur la représentation du champ de pesanteur / H.M. Dufour (1983)

Permalink

Triangular matrices for adjustment of triangular networks (Bulletin de Transactions of the Royal Institute of technology) / A. Bjerhammar

Permalink