Centre dedocumentation
scientifique

Multiple convolutional features in Siamese networks for object tracking / Zhenxi Li in Machine Vision and Applications, vol 32 n° 3 (May 2021)  

Public [article]  inMachine Vision and Applications > vol 32 n° 3 (May 2021) . - n° 59 Titre : Multiple convolutional features in Siamese networks for object tracking Type de document : Article/Communication Auteurs : Zhenxi Li, Auteur ; Guillaume-Alexandre Bilodeau, Auteur ; Wassim Bouachir, Auteur Année de publication : 2021 Article en page(s) : n° 59 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image [Termes IGN] approche hiérarchique [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] extraction de traits caractéristiques [Termes IGN] poursuite de cible [Termes IGN] reconnaissance d'objets [Termes IGN] réseau neuronal siamois Résumé : (auteur) Siamese trackers demonstrated high performance in object tracking due to their balance between accuracy and speed. Unlike classification-based CNNs, deep similarity networks are specifically designed to address the image similarity problem and thus are inherently more appropriate for the tracking task. However, Siamese trackers mainly use the last convolutional layers for similarity analysis and target search, which restricts their performance. In this paper, we argue that using a single convolutional layer as feature representation is not an optimal choice in a deep similarity framework. We present a Multiple Features-Siamese Tracker (MFST), a novel tracking algorithm exploiting several hierarchical feature maps for robust tracking. Since convolutional layers provide several abstraction levels in characterizing an object, fusing hierarchical features allows to obtain a richer and more efficient representation of the target. Moreover, we handle the target appearance variations by calibrating the deep features extracted from two different CNN models. Based on this advanced feature representation, our method achieves high tracking accuracy, while outperforming the standard siamese tracker on object tracking benchmarks. The source code and trained models are available at https://github.com/zhenxili96/MFST. Numéro de notice : A2021-470 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1007/s00138-021-01185-7 Date de publication en ligne : 11/03/2021 En ligne : https://doi.org/10.1007/s00138-021-01185-7 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97903 [article]

Activity recognition in residential spaces with Internet of things devices and thermal imaging / Kshirasagar Naik in Sensors, vol 21 n° 3 (February 2021)  

Public [article]  inSensors > vol 21 n° 3 (February 2021) . - n° 988 Titre : Activity recognition in residential spaces with Internet of things devices and thermal imaging Type de document : Article/Communication Auteurs : Kshirasagar Naik, Auteur ; Tejas Pandit, Auteur ; Nitin Naik, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : n° 988 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] compréhension de l'image [Termes IGN] contrôle par télédétection [Termes IGN] détection d'événement [Termes IGN] espace intérieur [Termes IGN] image RVB [Termes IGN] image thermique [Termes IGN] intelligence artificielle [Termes IGN] internet des objets [Termes IGN] itération [Termes IGN] modèle stéréoscopique [Termes IGN] objet mobile [Termes IGN] reconnaissance automatique [Termes IGN] reconnaissance d'objets [Termes IGN] scène 3D Résumé : (auteur) In this paper, we design algorithms for indoor activity recognition and 3D thermal model generation using thermal images, RGB images, captured from external sensors, and the internet of things setup. Indoor activity recognition deals with two sub-problems: Human activity and household activity recognition. Household activity recognition includes the recognition of electrical appliances and their heat radiation with the help of thermal images. A FLIR ONE PRO camera is used to capture RGB-thermal image pairs for a scene. Duration and pattern of activities are also determined using an iterative algorithm, to explore kitchen safety situations. For more accurate monitoring of hazardous events such as stove gas leakage, a 3D reconstruction approach is proposed to determine the temperature of all points in the 3D space of a scene. The 3D thermal model is obtained using the stereo RGB and thermal images for a particular scene. Accurate results are observed for activity detection, and a significant improvement in the temperature estimation is recorded in the 3D thermal model compared to the 2D thermal image. Results from this research can find applications in home automation, heat automation in smart homes, and energy management in residential spaces. Numéro de notice : A2021-159 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.3390/s21030988 Date de publication en ligne : 02/02/2021 En ligne : https://doi.org/10.3390/s21030988 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97075 [article]

Emotional habitat: mapping the global geographic distribution of human emotion with physical environmental factors using a species distribution model / Yizhuo Li in International journal of geographical information science IJGIS, vol 35 n° 2 (February 2021)  

Public [article]  inInternational journal of geographical information science IJGIS > vol 35 n° 2 (February 2021) . - pp 227 - 249 Titre : Emotional habitat: mapping the global geographic distribution of human emotion with physical environmental factors using a species distribution model Type de document : Article/Communication Auteurs : Yizhuo Li, Auteur ; Teng Fei, Auteur ; Yingjing Huang, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 227 - 249 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Cartographie thématique [Termes IGN] comportement [Termes IGN] détection de visage [Termes IGN] distribution spatiale [Termes IGN] données environnementales [Termes IGN] émotion [Termes IGN] entropie [Termes IGN] psychologie [Termes IGN] reconnaissance faciale [Termes IGN] sciences humaines [Termes IGN] vision Résumé : (auteur) Human emotion is an intrinsic psychological state that is influenced by human thoughts and behaviours. Human emotion distribution has been regarded as an important part of emotional geography research. However, it is difficult to form a global scaled map reflecting human emotions at the same sampling density because various emotional sampling data are usually positive occurrences without absence data. In this study, a methodological framework for mapping the global geographic distribution of human emotion is proposed and applied, combining a species distribution model with physical environment factors. State-of-the-art affective computing technology is used to extract human emotions from facial expressions in Flickr photos. Various human emotions are considered as different species to form their ‘habitats’ and predict the suitability, termed as ‘Emotional Habitat’. To our knowledge, this framework is the first method to predict emotional distribution from an ecological perspective. Different geographic distributions of seven dimensional emotions are explored and depicted, and emotional diversity and abnormality are detected at the global scale. These results confirm the effectiveness of our framework and offer new insights to understand the relationship between human emotions and the physical environment. Moreover, our method facilitates further rigorous exploration in emotional geography and enriches its content. Numéro de notice : A2021-037 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1080/13658816.2020.1755040 Date de publication en ligne : 24/04/2020 En ligne : https://doi.org/10.1080/13658816.2020.1755040 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=96746 [article]

Unsupervised deep representation learning for real-time tracking / Ning Wang in International journal of computer vision, vol 129 n° 2 (February 2021)  

Public [article]  inInternational journal of computer vision > vol 129 n° 2 (February 2021) . - pp 400 - 418 Titre : Unsupervised deep representation learning for real-time tracking Type de document : Article/Communication Auteurs : Ning Wang, Auteur ; Wengang Zhou, Auteur ; Yibing Song, Auteur ; et al., Auteur Année de publication : 2021 Article en page(s) : pp 400 - 418 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification non dirigée [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] corrélation d'images [Termes IGN] détection de cible [Termes IGN] filtre [Termes IGN] objet mobile [Termes IGN] oculométrie [Termes IGN] reconnaissance d'objets [Termes IGN] réseau neuronal siamois [Termes IGN] temps réel [Termes IGN] trajectoire [Termes IGN] vision par ordinateur Résumé : (auteur) The advancement of visual tracking has continuously been brought by deep learning models. Typically, supervised learning is employed to train these models with expensive labeled data. In order to reduce the workload of manual annotation and learn to track arbitrary objects, we propose an unsupervised learning method for visual tracking. The motivation of our unsupervised learning is that a robust tracker should be effective in bidirectional tracking. Specifically, the tracker is able to forward localize a target object in successive frames and backtrace to its initial position in the first frame. Based on such a motivation, in the training process, we measure the consistency between forward and backward trajectories to learn a robust tracker from scratch merely using unlabeled videos. We build our framework on a Siamese correlation filter network, and propose a multi-frame validation scheme and a cost-sensitive loss to facilitate unsupervised learning. Without bells and whistles, the proposed unsupervised tracker achieves the baseline accuracy of classic fully supervised trackers while achieving a real-time speed. Furthermore, our unsupervised framework exhibits a potential in leveraging more unlabeled or weakly labeled data to further improve the tracking accuracy. Numéro de notice : A2021-353 Affiliation des auteurs : non IGN Thématique : IMAGERIE/INFORMATIQUE Nature : Article DOI : 10.1007/s11263-020-01357-4 Date de publication en ligne : 21/09/2020 En ligne : https://doi.org/10.1007/s11263-020-01357-4 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=97604 [article]

Improving traffic sign recognition results in urban areas by overcoming the impact of scale and rotation / Roholah Yazdan in ISPRS Journal of photogrammetry and remote sensing, vol 171 (January 2021)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 171 (January 2021) . - pp 18 - 35 Titre : Improving traffic sign recognition results in urban areas by overcoming the impact of scale and rotation Type de document : Article/Communication Auteurs : Roholah Yazdan, Auteur ; Masood Varshosaz, Auteur Année de publication : 2021 Article en page(s) : pp 18 - 35 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] base de données d'images [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] classification par séparateurs à vaste marge [Termes IGN] corrélation à l'aide de traits caractéristiques [Termes IGN] corrélation croisée normalisée [Termes IGN] couple stéréoscopique [Termes IGN] détection automatique [Termes IGN] modèle stéréoscopique [Termes IGN] reconnaissance d'objets [Termes IGN] segmentation d'image [Termes IGN] SIFT (algorithme) [Termes IGN] signalisation routière [Termes IGN] SURF (algorithme) [Termes IGN] Téhéran [Termes IGN] transformation de Hough [Termes IGN] zone urbaine Résumé : (auteur) Automatic detection and recognition of traffic signs have many applications. However, some problems can affect the accuracy of the existing algorithms, such as changes in environmental light conditions, shadows, the presence of objects of the same colour, significant changes in scale and rotation, as well as obstacles in front of the traffic signs. To overcome these difficulties, a reference image database is usually used that includes different modes of appearing the traffic signs in the images. In order to overcome the effects of scale and rotation, in this paper a new method is presented in which only one reference image is needed for each sign to recognise the traffic sign in an image. In the proposed method, imaging is done in stereo. Using the captured image pair, a virtual image is generated which is then used to recognise the sign. As a result, the recognition is carried out with a minimum number of reference images. Experiments show that the proposed algorithm significantly improves recognition results. The traffic signs are recognised with 93.1% accuracy that enjoys a 4.9% improvement over traditional methods. Numéro de notice : A2021-010 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2020.10.003 Date de publication en ligne : 06/11/2020 En ligne : https://doi.org/10.1016/j.isprsjprs.2020.10.003 Format de la ressource électronique : url article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=96304 [article]

Réservation

Réserver ce document

Exemplaires (3)

Code-barres	Cote	Support	Localisation	Section	Disponibilité
081-2021011	SL	Revue	Centre de documentation	Revues en salle	Disponible
081-2021013	DEP-RECP	Revue	LaSTIG	Dépôt en unité	Exclu du prêt
081-2021012	DEP-RECF	Revue	Nancy	Dépôt en unité	Exclu du prêt

Exploring multiscale object-based convolutional neural network (multi-OCNN) for remote sensing image classification at high spatial resolution / Vitor Martins in ISPRS Journal of photogrammetry and remote sensing, vol 168 (October 2020)  

Permalink

Hierarchical instance recognition of individual roadside trees in environmentally complex urban areas from UAV laser scanning point clouds / Yongjun Wang in ISPRS International journal of geo-information, vol 9 n° 10 (October 2020)  

Permalink

Deep learning for enrichment of vector spatial databases: Application to highway interchange / Guillaume Touya in ACM Transactions on spatial algorithms and systems, TOSAS, vol 6 n° 3 (May 2020)    

Permalink

Classification and segmentation of mining area objects in large-scale spares Lidar point cloud using a novel rotated density network / Yueguan Yan in ISPRS International journal of geo-information, vol 9 n° 3 (March 2020)  

Permalink

Développement de la photogrammétrie et d'analyses d'images pour l'étude et le suivi d'habitats marins / Guilhem Marre (2020)  

Permalink

Interactions between hierarchical learning and visual system modeling : image classification on small datasets / Thalita Firmo Drumond (2020)  

Permalink

Exploring semantic elements for urban scene recognition: Deep integration of high-resolution imagery and OpenStreetMap (OSM) / Wenzhi Zhao in ISPRS Journal of photogrammetry and remote sensing, vol 151 (May 2019)  

Permalink

Learning high-level features by fusing multi-view representation of MLS point clouds for 3D object recognition in road environments / Zhipeng Luo in ISPRS Journal of photogrammetry and remote sensing, vol 150 (April 2019)  

Permalink

Learning to segment moving objects / Pavel Tokmakov in International journal of computer vision, vol 127 n° 3 (March 2019)  

Permalink

Do semantic parts emerge in convolutional neural networks? / Abel Gonzalez-Garcia in International journal of computer vision, vol 126 n° 5 (May 2018)  

Permalink