Centre dedocumentation
scientifique

Domain adaptation in segmenting historical maps: A weakly supervised approach through spatial co-occurrence / Sidi Wu in ISPRS Journal of photogrammetry and remote sensing, vol 197 (March 2023)  

Public [article]  inISPRS Journal of photogrammetry and remote sensing > vol 197 (March 2023) . - pp 199 - 211 Titre : Domain adaptation in segmenting historical maps: A weakly supervised approach through spatial co-occurrence Type de document : Article/Communication Auteurs : Sidi Wu, Auteur ; Konrad Schindler, Auteur ; Magnus Heitzler, Auteur ; et al., Auteur Année de publication : 2023 Article en page(s) : pp 199 - 211 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] carte ancienne [Termes IGN] cartographie historique [Termes IGN] classification dirigée [Termes IGN] détection de changement [Termes IGN] données anciennes [Termes IGN] matrice de co-occurrence [Termes IGN] réseau antagoniste génératif [Termes IGN] segmentation d'image [Termes IGN] vision par ordinateur Résumé : (auteur) Historical maps depict past states of the Earth’s surface and make it possible to trace the natural or anthropogenic evolution of geographic objects back through time. However, the state of the depicted reality is not the only source of change: maps of varying age can differ in terms of graphical design, and also in terms of storage conditions, physical ageing of pigments, and the scanning process for digitization. Consequently, a computer vision system learned from a specific (source) map series will often not generalize well to older or newer (target) maps, calling for domain adaptation. In the present paper we examine – to our knowledge for the first time – domain adaptation for segmenting historical maps. We argue that for geo-spatial data like maps, which are geo-localized by definition, the spatial co-occurrence of geographical objects provides a supervision signal for domain adaptation. Since only a subset of all mapped objects co-occur, and even those are not perfectly aligned due to both real topographic changes and variations in map generalization/production, they only provide weak supervision — still they can bring a substantial benefit over completely unsupervised domain adaptation methods. The core of our proposed method is a novel self-supervised co-occurrence network that detects co-occurring objects across maps (specifically, domains) with a novel loss function that allows for object changes and spatial misalignment. Experiments show that, for the task of segmenting hydrological objects such as rivers, lakes and wetlands, our system significantly outperforms two state-of-art baselines, even with limited supervision (e.g., 5%). The source code is publicly available at https://github.com/sian-wusidi/spatialcooccurrence. Numéro de notice : A2023-146 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1016/j.isprsjprs.2023.01.021 Date de publication en ligne : 14/02/2023 En ligne : https://doi.org/10.1016/j.isprsjprs.2023.01.021 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=102804 [article]