Centre de documentation
scientifique

3D building reconstruction from single street view images using deep learning / Hui En Pang in International journal of applied Earth observation and geoinformation, vol 112 (August 2022)  

Public [article]  inInternational journal of applied Earth observation and geoinformation > vol 112 (August 2022) . - n° 102859 Titre : 3D building reconstruction from single street view images using deep learning Type de document : Article/Communication Auteurs : Hui En Pang, Auteur ; Filip Biljecki, Auteur Année de publication : 2022 Article en page(s) : n° 102859 Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Traitement d'image optique [Termes IGN] apprentissage profond [Termes IGN] classification par réseau neuronal convolutif [Termes IGN] empreinte [Termes IGN] Helsinki [Termes IGN] image Streetview [Termes IGN] maillage [Termes IGN] morphologie urbaine [Termes IGN] précision géométrique (imagerie) [Termes IGN] reconstruction 3D du bâti [Termes IGN] segmentation d'image [Termes IGN] semis de points Résumé : (auteur) 3D building models are an established instance of geospatial information in the built environment, but their acquisition remains complex and topical. Approaches to reconstruct 3D building models often require existing building information (e.g. their footprints) and data such as point clouds, which are scarce and laborious to acquire, limiting their expansion. In parallel, street view imagery (SVI) has been gaining currency, driven by the rapid expansion in coverage and advances in computer vision (CV), but it has not been used much for generating 3D city models. Traditional approaches that can use SVI for reconstruction require multiple images, while in practice, often only few street-level images provide an unobstructed view of a building. We develop the reconstruction of 3D building models from a single street view image using image-to-mesh reconstruction techniques modified from the CV domain. We regard three scenarios: (1) standalone single-view reconstruction; (2) reconstruction aided by a top view delineating the footprint; and (3) refinement of existing 3D models, i.e. we examine the use of SVI to enhance the level of detail of block (LoD1) models, which are common. The results suggest that trained models supporting (2) and (3) are able to reconstruct the overall geometry of a building, while the first scenario may derive the approximate mass of the building, useful to infer the urban form of cities. We evaluate the results by demonstrating their usefulness for volume estimation, with mean errors of less than 10% for the last two scenarios. As SVI is now available in most countries worldwide, including many regions that do not have existing footprint and/or 3D building data, our method can derive rapidly and cost-effectively the 3D urban form from SVI without requiring any existing building information. Obtaining 3D building models in regions that hitherto did not have any, may enable a number of 3D geospatial analyses locally for the first time. Numéro de notice : A2022-544 Affiliation des auteurs : non IGN Thématique : IMAGERIE Nature : Article DOI : 10.1016/j.jag.2022.102859 Date de publication en ligne : 17/06/2022 En ligne : https://doi.org/10.1016/j.jag.2022.102859 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=101160 [article]