Centre dedocumentation
scientifique

3D hand mesh reconstruction from a monocular RGB image / Hao Peng in The Visual Computer, vol 36 n° 10 - 12 (October 2020)  

Public [article]  inThe Visual Computer > vol 36 n° 10 - 12 (October 2020) . - pp pages2227 - 2239 Titre : 3D hand mesh reconstruction from a monocular RGB image Type de document : Article/Communication Auteurs : Hao Peng, Auteur ; Chuhua Xian, Auteur ; Yunbo Zhang, Auteur Année de publication : 2020 Article en page(s) : pp pages2227 - 2239 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] estimation de pose [Termes descripteurs IGN] image de synthèse [Termes descripteurs IGN] image RVB [Termes descripteurs IGN] maillage [Termes descripteurs IGN] modélisation 3D [Termes descripteurs IGN] réalité augmentée [Termes descripteurs IGN] réalité virtuelle [Termes descripteurs IGN] reconstruction 3D [Termes descripteurs IGN] reconstruction d'objet [Termes descripteurs IGN] vision monoculaire Résumé : (auteur) Most of the existing methods for 3D hand analysis based on RGB images mainly focus on estimating hand keypoints or poses, which cannot capture geometric details of the 3D hand shape. In this work, we propose a novel method to reconstruct a 3D hand mesh from a single monocular RGB image. Different from current parameter-based or pose-based methods, our proposed method directly estimates the 3D hand mesh based on graph convolution neural network (GCN). Our network consists of two modules: the hand localization and mask generation module, and the 3D hand mesh reconstruction module. The first module, which is a VGG16-based network, is applied to localize the hand region in the input image and generate the binary mask of the hand. The second module takes the high-order features from the first and uses a GCN-based network to estimate the coordinates of each vertex of the hand mesh and reconstruct the 3D hand shape. To achieve better accuracy, a novel loss based on the differential properties of the discrete mesh is proposed. We also use professional software to create a large synthetic dataset that contains both ground truth 3D hand meshes and poses for training. To handle the real-world data, we use the CycleGAN network to transform the data domain of real-world images to that of our synthesis dataset. We demonstrate that our method can produce accurate 3D hand mesh and achieve an efficient performance for real-time applications. Numéro de notice : A2020-596 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1007/s00371-020-01908-3 date de publication en ligne : 14/07/2020 En ligne : https://doi.org/10.1007/s00371-020-01908-3 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=95936 [article]

Application of convolutional and recurrent neural networks for buried threat detection using ground penetrating radar data / Mahdi Moalla in IEEE Transactions on geoscience and remote sensing, vol 58 n° 10 (October 2020)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 58 n° 10 (October 2020) . - pp 7022 - 7034 Titre : Application of convolutional and recurrent neural networks for buried threat detection using ground penetrating radar data Type de document : Article/Communication Auteurs : Mahdi Moalla, Auteur ; Hichem Frigui, Auteur ; Andrew Karem, Auteur ; et al., Auteur Année de publication : 2020 Article en page(s) : pp 7022 - 7034 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image radar et applications [Termes descripteurs IGN] cible souterraine [Termes descripteurs IGN] classification barycentrique [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] détection d'objet [Termes descripteurs IGN] données radar [Termes descripteurs IGN] image radar moirée [Termes descripteurs IGN] mine antipersonnel [Termes descripteurs IGN] Radar pénétrant GPR [Termes descripteurs IGN] réseau neuronal récurrent [Termes descripteurs IGN] sous-sol Résumé : (auteur) We propose discrimination algorithms for buried threat detection (BTD) that exploit deep convolutional neural networks (CNNs) and recurrent neural networks (RNN) to analyze 2-D GPR B-scans in the down-track (DT) and cross-track (CT) directions as well as 3-D GPR volumes. Instead of imposing a specific model or handcrafted features, as in most existing detectors, we use large real GPR data collections and data-driven approaches that learn: 1) features characterizing buried explosive objects (BEOs) in 2-D B-scans, both in the DT and CT directions; 2) the variation of the CNN features learned in a fixed 2-D view across the third dimension; and 3) features characterizing BEOs in the original 3-D space. The proposed algorithms were trained and evaluated using large experimental GPR data covering a surface area of 120 000 m 2 from 13 different lanes across two U.S. test sites. These data include a diverse set of BEOs consisting of varying shapes, metal content, and underground burial depths. We provide some qualitative analysis of the proposed algorithms by visually comparing their performance and consistency along different dimensions and visualizing typical features learned by some nodes of the network. We also provide quantitative analysis that compares the receiver operating characteristics (ROCs) obtained using the proposed algorithms with those obtained using existing approaches based on CNN as well as traditional learning. Numéro de notice : A2020-586 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.2978763 date de publication en ligne : 25/03/2020 En ligne : https://doi.org/10.1109/TGRS.2020.2978763 Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=95914 [article]

Exploring multiscale object-based convolutional neural network (multi-OCNN) for remote sensing image classification at high spatial resolution / Vitor Martins in ISPRS Journal of photogrammetry and remote sensing, vol 168 (October 2020)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 168 (October 2020) . - pp 56 - 73 Titre : Exploring multiscale object-based convolutional neural network (multi-OCNN) for remote sensing image classification at high spatial resolution Type de document : Article/Communication Auteurs : Vitor Martins, Auteur ; Amy L. Kaleita, Auteur ; Brian K. Gelder, Auteur ; et al., Auteur Année de publication : 2020 Article en page(s) : pp 56 - 73 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes descripteurs IGN] analyse d'image orientée objet [Termes descripteurs IGN] apprentissage profond [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] données multiéchelles [Termes descripteurs IGN] étiquetage sémantique [Termes descripteurs IGN] hétérogénéité environnementale [Termes descripteurs IGN] image à haute résolution [Termes descripteurs IGN] occupation du sol [Termes descripteurs IGN] reconnaissance d'objets [Termes descripteurs IGN] segmentation d'image [Termes descripteurs IGN] squelettisation Résumé : (auteur) Convolutional Neural Network (CNN) has been increasingly used for land cover mapping of remotely sensed imagery. However, large-area classification using traditional CNN is computationally expensive and produces coarse maps using a sliding window approach. To address this problem, object-based CNN (OCNN) becomes an alternative solution to improve classification performance. However, previous studies were mainly focused on urban areas or small scenes, and implementation of OCNN method is still needed for large-area classification over heterogeneous landscape. Additionally, the massive labeling of segmented objects requires a practical approach for less computation, including object analysis and multiple CNNs. This study presents a new multiscale OCNN (multi-OCNN) framework for large-scale land cover classification at 1-m resolution over 145,740 km2. Our approach consists of three main steps: (i) image segmentation, (ii) object analysis with skeleton-based algorithm, and (iii) application of multiple CNNs for final classification. Also, we developed a large benchmark dataset, called IowaNet, with 1 million labeled images and 10 classes. In our approach, multiscale CNNs were trained to capture the best contextual information during the semantic labeling of objects. Meanwhile, skeletonization algorithm provided morphological representation (“medial axis”) of objects to support the selection of convolutional locations for CNN predictions. In general, proposed multi-OCNN presented better classification accuracy (overall accuracy ~87.2%) compared to traditional patch-based CNN (81.6%) and fixed-input OCNN (82%). In addition, the results showed that this framework is 8.1 and 111.5 times faster than traditional pixel-wise CNN16 or CNN256, respectively. Multiple CNNs and object analysis have proved to be essential for accurate and fast classification. While multi-OCNN produced a high-level of spatial details in the land cover product, misclassification was observed for some classes, such as road versus buildings or shadow versus lake. Despite these minor drawbacks, our results also demonstrated the benefits of IowaNet training dataset in the model performance; overfitting process reduces as the number of samples increases. The limitations of multi-OCNN are partially explained by segmentation quality and limited number of spectral bands in the aerial data. With the advance of deep learning methods, this study supports the claim of multi-OCNN benefits for operational large-scale land cover product at 1-m resolution. Numéro de notice : A2020-634 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2020.08.004 date de publication en ligne : 13/08/2020 En ligne : https://doi.org/10.1016/j.isprsjprs.2020.08.004 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=96057 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2020101	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2020103	DEP-RECP	Revue	MATIS	Dépôt en unité	Exclu du prêt
081-2020102	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Crater detection and registration of planetary images through marked point processes, multiscale decomposition, and region-based analysis / David Solarna in IEEE Transactions on geoscience and remote sensing, vol 58 n° 9 (September 2020)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 58 n° 9 (September 2020) . - pp 6039 - 6058 Titre : Crater detection and registration of planetary images through marked point processes, multiscale decomposition, and region-based analysis Type de document : Article/Communication Auteurs : David Solarna, Auteur ; Alberto Gotelli, Auteur ; Jacqueline Le Moigne, Auteur ; et al., Auteur Année de publication : 2020 Article en page(s) : pp 6039 - 6058 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] cratère [Termes descripteurs IGN] détection de contours [Termes descripteurs IGN] distance de Hausdorff [Termes descripteurs IGN] extraction de traits caractéristiques [Termes descripteurs IGN] image multitemporelle [Termes descripteurs IGN] image thermique [Termes descripteurs IGN] Mars (planète) [Termes descripteurs IGN] ondelette [Termes descripteurs IGN] processus ponctuel marqué [Termes descripteurs IGN] séparateur à vaste marge [Termes descripteurs IGN] transformation de Hough [Termes descripteurs IGN] zone d'intérêt Résumé : (auteur) Because of the large variety of planetary sensors and spacecraft already collecting data and with many new and improved sensors being planned for future missions, planetary science needs to integrate numerous multimodal image sources, and, as a consequence, accurate and robust registration algorithms are required. In this article, we develop a new framework for crater detection based on marked point processes (MPPs) that can be used for planetary image registration. MPPs were found to be effective for various object detection tasks in Earth observation, and a new MPP model is proposed here for detecting craters in planetary data. The resulting spatial features are exploited for registration, together with fitness functions based on the MPP energy, on the mean directed Hausdorff distance, and on the mutual information. Two different methods—one based on birth–death processes and region-of-interest analysis and the other based on graph cuts and decimated wavelets—are developed within the proposed framework. Experiments with a large set of images, including 13 thermal infrared and visible images of the Mars surface, 20 semisimulated multitemporal pairs of images of the Mars surface, and a real multitemporal image pair of the Lunar surface, demonstrate the effectiveness of the proposed framework in terms of crater detection performance as well as for subpixel registration accuracy. Numéro de notice : A2020-526 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.2970908 date de publication en ligne : 18/03/2020 En ligne : https://doi.org/10.1109/TGRS.2020.2970908 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=95704 [article]

CSVM architectures for pixel-wise object detection in high-resolution remote sensing images / Youyou Li in IEEE Transactions on geoscience and remote sensing, vol 58 n° 9 (September 2020)  

Public [article]  inIEEE Transactions on geoscience and remote sensing > vol 58 n° 9 (September 2020) . - pp 6059 - 6070 Titre : CSVM architectures for pixel-wise object detection in high-resolution remote sensing images Type de document : Article/Communication Auteurs : Youyou Li, Auteur ; Farid Melgani, Auteur ; Binbin He, Auteur Année de publication : 2020 Article en page(s) : pp 6059 - 6070 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image [Termes descripteurs IGN] classification par réseau neuronal convolutif [Termes descripteurs IGN] classification par séparateurs à vaste marge [Termes descripteurs IGN] détection d'objet [Termes descripteurs IGN] données d'apprentissage [Termes descripteurs IGN] image de drone [Termes descripteurs IGN] processeur graphique Résumé : (auteur) Detecting objects becomes an increasingly important task in very high resolution (VHR) remote sensing imagery analysis. With the development of GPU-computing capability, a growing number of deep convolutional neural networks (CNNs) have been designed to address the object detection challenge. However, compared with CPU, GPU is much more costly. Therefore, GPU-based methods are less attractive in practical applications. In this article, we propose a CPU-based method that is based on convolutional support vector machines (CSVMs) to address the object detection challenge in VHR images. Experiments are conducted on three VHR and two unmanned aerial vehicle (UAV) data sets with very limited training data. Results show that the proposed CSVM achieves competitive performance compared to U-Net which is an efficient CNN-based model designed for small training data sets. Numéro de notice : A2020-527 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1109/TGRS.2020.2972289 date de publication en ligne : 02/03/2020 En ligne : https://doi.org/10.1109/TGRS.2020.2972289 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=95705 [article]

Multiscale supervised kernel dictionary learning for SAR target recognition / Lei Tao in IEEE Transactions on geoscience and remote sensing, vol 58 n° 9 (September 2020)  

Permalink

A novel deep learning instance segmentation model for automated marine oil spill detection / Shamsudeen Temitope Yekeen in ISPRS Journal of photogrammetry and remote sensing, vol 167 (September 2020)  

Permalink

A novel deep network and aggregation model for saliency detection / Ye Liang in The Visual Computer, vol 36 n° 9 (September 2020)  

Permalink

Recognition of building group patterns using graph convolutional network / Rong Zhao in Cartography and Geographic Information Science, Vol 47 n° 5 (September 2020)  

Permalink

Vehicle detection of multi-source remote sensing data using active fine-tuning network / Xin Wu in ISPRS Journal of photogrammetry and remote sensing, vol 167 (September 2020)  

Permalink

X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing data / Danfeng Hong in ISPRS Journal of photogrammetry and remote sensing, vol 167 (September 2020)  

Permalink

CNN semantic segmentation to retrieve past land cover out of historical orthoimages and DSM: first experiments / Arnaud Le Bris in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, V-2 (August 2020)  

Permalink

Landuse and land cover identification and disaggregating socio-economic data with convolutional neural network / Jingtao Yao in Geocarto international, vol 35 n° 10 ([01/08/2020])  

Permalink

Classification of hyperspectral and LiDAR data using coupled CNNs / Renlong Hang in IEEE Transactions on geoscience and remote sensing, vol 58 n° 7 (July 2020)  

Permalink

Simulating urban land use change by integrating a convolutional neural network with vector-based cellular automata / Yaqian Zhai in International journal of geographical information science IJGIS, vol 34 n° 7 (July 2020)  

Permalink