Centre de documentation
scientifique

Reproducible research and GIScience: An evaluation using GIScience conference papers / Franck O. Ostermann (2021)  

Public Titre : Reproducible research and GIScience: An evaluation using GIScience conference papers Type de document : Article/Communication Auteurs : Franck O. Ostermann, Auteur ; Daniel Nüst, Auteur ; Carlos Granell, Auteur ; Barbara Hofer, Auteur ; Markus Konkol, Auteur Editeur : Leibniz [Allemagne] : Schloss Dagstuhl – Leibniz-Zentrum für Informatik Année de publication : 2021 Conférence : GIScience 2021, 11th International Conference on Geographic Information Science 27/09/2021 30/09/2021 Poznań Pologne Open Access Proceedings Importance : 16 p. Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Société de l'information [Termes IGN] code source libre [Termes IGN] données ouvertes [Termes IGN] information géographique [Termes IGN] recherche scientifique [Termes IGN] reproductibilité Résumé : (auteur) GIScience conference authors and researchers face the same computational reproducibility challenges as authors and researchers from other disciplines who use computers to analyse data. Here, to assess the reproducibility of GIScience research, we apply a rubric for assessing the reproducibility of 75 conference papers published at the GIScience conference series in the years 2012-2018. Since the rubric and process were previously applied to the publications of the AGILE conference series, this paper itself is an attempt to replicate that analysis, however going beyond the previous work by evaluating and discussing proposed measures to improve reproducibility in the specific context of the GIScience conference series. The results of the GIScience paper assessment are in line with previous findings: although descriptions of workflows and the inclusion of the data and software suffice to explain the presented work, in most published papers they do not allow a third party to reproduce the results and findings with a reasonable effort. We summarise and adapt previous recommendations for improving this situation and propose the GIScience community to start a broad discussion on the reusability, quality, and openness of its research. Further, we critically reflect on the process of assessing paper reproducibility, and provide suggestions for improving future assessments. The code and data for this article are published at https://doi.org/10.5281/zenodo.4032875. Numéro de notice : C2021-080 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE/IMAGERIE/INFORMATIQUE/SOCIETE NUMERIQUE Nature : Communication DOI : 10.4230/LIPIcs.GIScience.2021.II.2 Date de publication en ligne : 14/09/2021 En ligne : https://doi.org/10.4230/LIPIcs.GIScience.2021.II.2 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=100938

Advancing science with VGI: Reproducibility and replicability of recent studies / Franck O. Ostermann in Transactions in GIS, vol 21 n° 2 (April 2017)  

Public [article]  inTransactions in GIS > vol 21 n° 2 (April 2017) . - pp 224 – 237 Titre : Advancing science with VGI: Reproducibility and replicability of recent studies Type de document : Article/Communication Auteurs : Franck O. Ostermann, Auteur ; Carlos Granell, Auteur Année de publication : 2017 Article en page(s) : pp 224 – 237 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Bases de données localisées [Termes IGN] diffusion de données [Termes IGN] données localisées des bénévoles [Termes IGN] gestion de crise [Termes IGN] réplication [Termes IGN] source de données [Termes IGN] test de performance Résumé : (auteur) In scientific research, reproducibility and replicability are requirements to ensure the advancement of our body of knowledge. This holds true also for VGI-related research and studies. However, the characteristics of VGI suggest particular difficulties in ensuring reproducibility and replicability. In this article, we aim to examine the current situation in VGI-related research, and identify strategies to ensure realization of its full potential. To do so, we first investigate the different aspects of reproducibility and replicability and their impact on VGI-related research. These impacts are different depending on the objectives of the study. Therefore, we examine the study focus of VGI-related research to assess the current body of research and structure our assessment. This work is based on a rigorous review of the elements of reproducibility and a systematic mapping and analysis of 58 papers on the use of VGI in the crisis management field. Results of our investigation show that reproducibility issues related to data are a serious concern, while reproducibility issues related to analysis methods and processes face fewer challenges. However, since most studies still focus on analyzing the source data, reproducibility and replicability are still an unsolved problem in VGI-related research. Therefore, we show initiatives tackling the problem, and finally formulate strategies to improve the situation. Numéro de notice : A2017-164 Affiliation des auteurs : non IGN Thématique : GEOMATIQUE Nature : Article nature-HAL : ArtAvecCL-RevueIntern DOI : 10.1111/tgis.12195 En ligne : http://dx.doi.org/10.1111/tgis.12195 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=84698 [article]