Centre dedocumentation
scientifique

3D hand mesh reconstruction from a monocular RGB image / Hao Peng in The Visual Computer, vol 36 n° 10 - 12 (October 2020)  

Public [article]  inThe Visual Computer > vol 36 n° 10 - 12 (October 2020) . - pp pages2227 - 2239 Titre : 3D hand mesh reconstruction from a monocular RGB image Type de document : Article/Communication Auteurs : Hao Peng, Auteur ; Chuhua Xian, Auteur ; Yunbo Zhang, Auteur Année de publication : 2020 Article en page(s) : pp pages2227 - 2239 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] estimation de pose [Termes descripteurs IGN] image de synthèse [Termes descripteurs IGN] image RVB [Termes descripteurs IGN] maillage [Termes descripteurs IGN] modélisation 3D [Termes descripteurs IGN] réalité augmentée [Termes descripteurs IGN] réalité virtuelle [Termes descripteurs IGN] reconstruction 3D [Termes descripteurs IGN] reconstruction d'objet [Termes descripteurs IGN] vision monoculaire Résumé : (auteur) Most of the existing methods for 3D hand analysis based on RGB images mainly focus on estimating hand keypoints or poses, which cannot capture geometric details of the 3D hand shape. In this work, we propose a novel method to reconstruct a 3D hand mesh from a single monocular RGB image. Different from current parameter-based or pose-based methods, our proposed method directly estimates the 3D hand mesh based on graph convolution neural network (GCN). Our network consists of two modules: the hand localization and mask generation module, and the 3D hand mesh reconstruction module. The first module, which is a VGG16-based network, is applied to localize the hand region in the input image and generate the binary mask of the hand. The second module takes the high-order features from the first and uses a GCN-based network to estimate the coordinates of each vertex of the hand mesh and reconstruct the 3D hand shape. To achieve better accuracy, a novel loss based on the differential properties of the discrete mesh is proposed. We also use professional software to create a large synthetic dataset that contains both ground truth 3D hand meshes and poses for training. To handle the real-world data, we use the CycleGAN network to transform the data domain of real-world images to that of our synthesis dataset. We demonstrate that our method can produce accurate 3D hand mesh and achieve an efficient performance for real-time applications. Numéro de notice : A2020-596 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1007/s00371-020-01908-3 date de publication en ligne : 14/07/2020 En ligne : https://doi.org/10.1007/s00371-020-01908-3 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=95936 [article]

Leveraging photogrammetric mesh models for aerial-ground feature point matching toward integrated 3D reconstruction / Qing Zhu in ISPRS Journal of photogrammetry and remote sensing, vol 166 (August 2020)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 166 (August 2020) . - pp 26 - 40 Titre : Leveraging photogrammetric mesh models for aerial-ground feature point matching toward integrated 3D reconstruction Type de document : Article/Communication Auteurs : Qing Zhu, Auteur ; Zhendong Wang, Auteur ; Han Hu, Auteur ; et al., Auteur Année de publication : 2020 Article en page(s) : pp 26 - 40 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Photogrammétrie numérique [Termes descripteurs IGN] appariement d'images [Termes descripteurs IGN] appariement de points [Termes descripteurs IGN] éclairage [Termes descripteurs IGN] image aérienne [Termes descripteurs IGN] image terrestre [Termes descripteurs IGN] maillage [Termes descripteurs IGN] milieu urbain [Termes descripteurs IGN] modèle stéréoscopique [Termes descripteurs IGN] séparateur à vaste marge [Termes descripteurs IGN] valeur aberrante Résumé : (auteur) Integration of aerial and ground images has been proved as an efficient approach to enhance the surface reconstruction in urban environments. However, as the first step, the feature point matching between aerial and ground images is remarkably difficult, due to the large differences in viewpoint and illumination conditions. Previous studies based on geometry-aware image rectification have alleviated this problem, but the performance and convenience of this strategy are still limited by several flaws, e.g. quadratic image pairs, segregated extraction of descriptors and occlusions. To address these problems, we propose a novel approach: leveraging photogrammetric mesh models for aerial-ground image matching. The methods have linear time complexity with regard to the number of images. It explicitly handles low overlap using multi-view images. The proposed methods can be directly injected into off-the-shelf structure-from-motion (SFM) and multi-view stereo (MVS) solutions. First, aerial and ground images are reconstructed separately and initially co-registered through weak georeferencing data. Second, aerial models are rendered to the initial ground views, in which color, depth and normal images are obtained. Then, feature matching between synthesized and ground images are conducted through descriptor searching and geometry-constrained outlier removal. Finally, oriented 3D patches are formulated using the synthesized depth and normal images and the correspondences are propagated to the aerial views through patch-based matching. Experimental evaluations using five datasets reveal satisfactory performance of the proposed methods in aerial-ground image matching, which succeeds in all of the ten challenging pairs compared to only three for the second best. In addition, incorporation of existing SFM and MVS solutions enables more complete reconstruction results, with better internal stability. Numéro de notice : A2020-351 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2020.05.024 date de publication en ligne : 10/06/2020 En ligne : https://doi.org/10.1016/j.isprsjprs.2020.05.024 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=95234 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2020081	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2020083	DEP-RECP	Revue	MATIS	Dépôt en unité	Exclu du prêt
081-2020082	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Land-cover change in the Wulagai grassland, Inner Mongolia of China between 1986 and 2014 analysed using multi-temporal Landsat images / Temulun Tangud in Geocarto international, vol 34 n° 11 ([15/08/2019])  

Public [article]  inGeocarto international > vol 34 n° 11 [15/08/2019] . - pp 1237 - 1251 Titre : Land-cover change in the Wulagai grassland, Inner Mongolia of China between 1986 and 2014 analysed using multi-temporal Landsat images Type de document : Article/Communication Auteurs : Temulun Tangud, Auteur ; Kenlo Nasahara, Auteur ; Habura Borjigin, Auteur ; Hasi Bagan, Auteur Année de publication : 2019 Article en page(s) : pp 1237 - 1251 Note générale : Bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications de télédétection [Termes descripteurs IGN] analyse diachronique [Termes descripteurs IGN] analyse spatio-temporelle [Termes descripteurs IGN] carte d'occupation du sol [Termes descripteurs IGN] changement d'occupation du sol [Termes descripteurs IGN] classification par séparateurs à vaste marge [Termes descripteurs IGN] détection de changement [Termes descripteurs IGN] image Landsat [Termes descripteurs IGN] maillage [Termes descripteurs IGN] Mongolie intérieure (Chine) [Termes descripteurs IGN] prairie [Termes descripteurs IGN] série temporelle [Termes descripteurs IGN] steppe [Termes descripteurs IGN] zone aride Résumé : (Auteur) The Inner Mongolian steppe is a vast grassland ecosystem that has long been home to nomadic pastoralists. However, this steppe is experiencing grassland degradation as well as more frequent sand storms. The objective of this study was to detect land-cover changes in the Wulagai grassland of Inner Mongolia using multi-temporal Landsat images from 1986 to 2014, and to determine the factors driving these changes and their impacts. Land-cover maps for 1986, 1995, 2000, 2006 and 2014 were produced using the Support Vector Machine method. Subsequently, 300 m × 300 m grid-cell vector map which covered Wulagai grassland was made to detect land-cover changes and correlations between land-cover classes. The results show degradation trend from 1986 to 2014. Grid-cell-based spatial correlation analysis confirmed a strong negative correlation between grassland and barren, indicating that grassland degradation in this region is due to the regional modernization over the past 28 years. Numéro de notice : A2019-464 Affiliation des auteurs : non IGN Thématique : FORET/IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1080/10106049.2018.1478457 date de publication en ligne : 01/06/2018 En ligne : https://doi.org/10.1080/10106049.2018.1478457 Format de la ressource électronique : URL Article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=93607 [article]

Réservation

Réserver ce document

Exemplaires (1)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
059-2019111	SL	Revue	Centre de documentation	Revues en salle	Disponible

Piecewise-planar approximation of large 3D data as graph-structured optimization / Stéphane Guinard in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-2/W5 (May 2019)  

Public [article]  inISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences > IV-2/W5 (May 2019) . - pp 365 - 372 Titre : Piecewise-planar approximation of large 3D data as graph-structured optimization Type de document : Article/Communication Auteurs : Stéphane Guinard , Auteur ; Loïc Landrieu , Auteur ; Laurent Caraffa , Auteur ; Bruno Vallet , Auteur Congrès : ISPRS Geospatial Week 2019 (10 - 14 juin 2019; Enschede, Pays-Bas), Commanditaire Année de publication : 2019 Projets : 1-Pas de projet / Article en page(s) : pp 365 - 372 Note générale : bibliographie The authors would like to acknowledge the DGA for their financial support of this work. Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Lasergrammétrie [Termes descripteurs IGN] algorithme de décalage moyen [Termes descripteurs IGN] analyse de groupement [Termes descripteurs IGN] approximation [Termes descripteurs IGN] données lidar [Termes descripteurs IGN] données localisées 3D [Termes descripteurs IGN] érosion anthropique [Termes descripteurs IGN] erreur d'approximation [Termes descripteurs IGN] extraction de traits caractéristiques [Termes descripteurs IGN] graphe [Termes descripteurs IGN] maillage [Termes descripteurs IGN] Ransac (algorithme) [Termes descripteurs IGN] semis de points [Termes descripteurs IGN] surface plane Résumé : (auteur) We introduce a new method for the piecewise-planar approximation of 3D data, including point clouds and meshes. Our method is designed to operate on large datasets (e.g. millions of vertices) containing planar structures, which are very frequent in anthropic scenes. Our approach is also adaptive to the local geometric complexity of the input data. Our main contribution is the formulation of the piecewise-planar approximation problem as a non-convex optimization problem. In turn, this problem can be efficiently solved with a graph-structured working set approach. We compare our results with a state-of-the-art region-growing-based segmentation method and show a significant improvement both in terms of approximation error and computation efficiency. Numéro de notice : A2019-592 Affiliation des auteurs : LaSTIG (2020- ) Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.5194/isprs-annals-IV-2-W5-365-2019 date de publication en ligne : 29/05/2019 En ligne : https://doi.org/10.5194/isprs-annals-IV-2-W5-365-2019 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=94552 [article]

Large scale textured mesh reconstruction from mobile mapping images and LIDAR scans / Mohamed Boussaha in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-2 ([28/05/2018])  

Public [article]  inISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences > IV-2 [28/05/2018] . - pp 49 - 56 Titre : Large scale textured mesh reconstruction from mobile mapping images and LIDAR scans Type de document : Article/Communication Auteurs : Mohamed Boussaha, Auteur ; Bruno Vallet , Auteur ; Patrick Rives, Auteur Congrès : ISPRS 2018, TC II Mid-term Symposium "Towards Photogrammetry 2020" (4 - 7 juin 2018; Riva del Garda, Italie) , Commanditaire Année de publication : 2018 Projets : PLaTINUM / Gouet-Brunet, Valérie Article en page(s) : pp 49 - 56 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Applications photogrammétriques [Termes descripteurs IGN] architecture pipeline [Termes descripteurs IGN] chaîne de traitement [Termes descripteurs IGN] données lidar [Termes descripteurs IGN] données localisées 3D [Termes descripteurs IGN] grande échelle [Termes descripteurs IGN] maillage [Termes descripteurs IGN] orthoimage [Termes descripteurs IGN] reconstruction d'objet [Termes descripteurs IGN] Rouen [Termes descripteurs IGN] texture d'image Résumé : (auteur) The representation of 3D geometric and photometric information of the real world is one of the most challenging and extensively studied research topics in the photogrammetry and robotics communities. In this paper, we present a fully automatic framework for 3D high quality large scale urban texture mapping using oriented images and LiDAR scans acquired by a terrestrial Mobile Mapping System (MMS). First, the acquired points and images are sliced into temporal chunks ensuring a reasonable size and time consistency between geometry (points) and photometry (images). Then, a simple, fast and scalable 3D surface reconstruction relying on the sensor space topology is performed on each chunk after an isotropic sampling of the point cloud obtained from the raw LiDAR scans. Finally, the algorithm proposed in (Waechter et al., 2014) is adapted to texture the reconstructed surface with the images acquired simultaneously, ensuring a high quality texture with no seams and global color adjustment. We evaluate our full pipeline on a dataset of 17 km of acquisition in Rouen, France resulting in nearly 2 billion points and 40000 full HD images. We are able to reconstruct and texture the whole acquisition in less than 30 computing hours, the entire process being highly parallel as each chunk can be processed independently in a separate thread or computer. Numéro de notice : A2018-329 Affiliation des auteurs : LaSTIG MATIS+Ext (2016-2019) Thématique : IMAGERIE/INFORMATIQUE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.5194/isprs-annals-IV-2-49-2018 date de publication en ligne : 28/05/2018 En ligne : http://dx.doi.org/10.5194/isprs-annals-IV-2-49-2018 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=90471 [article]

An efficient visualization method for polygonal data with dynamic simplification / Mingguang Wu in ISPRS International journal of geo-information, vol 7 n° 4 (April 2018)  

Permalink

Global, dense multiscale reconstruction for a billion points / Benjamin Ummenhofer in International journal of computer vision, vol 125 n° 1-3 (December 2017)  

Permalink

Calibrating a Land Parcel Cellular Automaton (LP-CA) for urban growth simulation based on ensemble learning / Yimin Chen in International journal of geographical information science IJGIS, vol 31 n° 11-12 (November - December 2017)  

Permalink

A parallel scheme for large-scale polygon rasterization on CUDA-enabled GPUs / Chen Zhou in Transactions in GIS, vol 21 n° 3 (June 2017)  

Permalink

New modelling approaches to predict wood properties from its cellular structure: image-based representation and meshless methods / Patrick Perré in Annals of Forest Science [en ligne], vol 73 n° 1 (March 2016)  

Permalink

Analyse temps-frequence et traitement des signaux RSO à haute résolution spatiale pour la surveillance des grands ouvrages d'art / Andrei Anghel (2015)  

Permalink

Road network selection for medium scales using an extended stroke-mesh combination algorithm / Stefan A. Benz in Cartography and Geographic Information Science, vol 41 n° 4 (September 2014)  

Permalink

Données géographiques en 3D sur Iphone (2) / Anonyme in Géomatique expert, n° 96 (01/01/2014)

Permalink

A hybrid multi-view stereo algorithm for modeling urban scenes / Florent Lafarge in IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI, vol 35 n° 1 (January 2013)    

Permalink

Blender 2.6 / R. Ducluzeau (2012)

Permalink