Centre dedocumentation
scientifique

Implementation of an IMU aided image stacking algorithm in a digital camera for Unmanned Aerial Vehicles / Ahmad Audi in Sensors, Vol 17 n°7 (july 2017)  

Public [article]  inSensors > Vol 17 n°7 (july 2017) . - 21 p. Titre : Implementation of an IMU aided image stacking algorithm in a digital camera for Unmanned Aerial Vehicles Type de document : Article/Communication Auteurs : Ahmad Audi, Auteur ; Marc Pierrot-Deseilligny , Auteur ; Christophe Meynard , Auteur ; Christian Thom , Auteur Année de publication : 2017 Article en page(s) : 21 p. Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Acquisition d'image(s) et de donnée(s) [Termes descripteurs IGN] centrale inertielle [Termes descripteurs IGN] chambre de prise de vue numérique [Termes descripteurs IGN] drone [Termes descripteurs IGN] image captée par drone [Termes descripteurs IGN] puce Résumé : (auteur) Images acquired with a long exposure time using a camera embedded on UAVs (Unmanned Aerial Vehicles) exhibit motion blur due to the erratic movements of the UAV. The aim of the present work is to be able to acquire several images with a short exposure time and use an image processing algorithm to produce a stacked image with an equivalent long exposure time. Our method is based on the feature point image registration technique. The algorithm is implemented on the light-weight IGN (Institut national de l'information géographique) camera, which has an IMU (Inertial Measurement Unit) sensor and an SoC (System on Chip)/FPGA (Field-Programmable Gate Array). To obtain the correct parameters for the resampling of the images, the proposed method accurately estimates the geometrical transformation between the first and the N-th images. Feature points are detected in the first image using the FAST (Features from Accelerated Segment Test) detector, then homologous points on other images are obtained by template matching using an initial position benefiting greatly from the presence of the IMU sensor. The SoC/FPGA in the camera is used to speed up some parts of the algorithm in order to achieve real-time performance as our ultimate objective is to exclusively write the resulting image to save bandwidth on the storage device. The paper includes a detailed description of the implemented algorithm, resource usage summary, resulting processing time, resulting images and block diagrams of the described architecture. The resulting stacked image obtained for real surveys does not seem visually impaired. An interesting by-product of this algorithm is the 3D rotation estimated by a photogrammetric method between poses, which can be used to recalibrate in real time the gyrometers of the IMU. Timing results demonstrate that the image resampling part of this algorithm is the most demanding processing task and should also be accelerated in the FPGA in future work. Numéro de notice : A2017-892 Affiliation des auteurs : LaSTIG LOEMI (2012-2019) Thématique : IMAGERIE Nature : Article nature-HAL : ArtAvecCL-RevueNat DOI : 10.3390/s17071646 date de publication en ligne : 18/07/2017 En ligne : https://doi.org/10.3390/s17071646 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=91885 [article]

Implementation of a real-time stacking algorithm in a photogrammetric digital camera for UAVs / Ahmad Audi (2017)  

Public Titre : Implementation of a real-time stacking algorithm in a photogrammetric digital camera for UAVs Type de document : Article/Communication Auteurs : Ahmad Audi, Auteur ; Marc Pierrot-Deseilligny , Auteur ; Christophe Meynard , Auteur ; Christian Thom , Auteur Congrès : ISPRS 2017, Volume XLII-2/W6, 2017 Volumes International Conference on Unmanned Aerial Vehicles in Geomatics (4 - 7 septembre 2017; Bonn, Allemagne), Auteur Editeur : International Society for Photogrammetry and Remote Sensing ISPRS Année de publication : 2017 Collection : International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, ISSN 1682-1750 num. XLII-2/W6 Importance : pp 13 - 19 Format : 21 x 30 cm Note générale : bibliographie Langues : Anglais (eng) Descripteur : [Vedettes matières IGN] Acquisition d'image(s) et de donnée(s) [Termes descripteurs IGN] chambre métrique [Termes descripteurs IGN] drone [Termes descripteurs IGN] flou [Termes descripteurs IGN] GPS-INS [Termes descripteurs IGN] implémentation (informatique) [Termes descripteurs IGN] points homologues [Termes descripteurs IGN] rééchantillonnage [Termes descripteurs IGN] rotation d'objet Résumé : (auteur) In the recent years, unmanned aerial vehicles (UAVs) have become an interesting tool in aerial photography and photogrammetry activities. In this context, some applications (like cloudy sky surveys, narrow-spectral imagery and night-vision imagery) need a longexposure time where one of the main problems is the motion blur caused by the erratic camera movements during image acquisition. This paper describes an automatic real-time stacking algorithm which produces a high photogrammetric quality final composite image with an equivalent long-exposure time using several images acquired with short-exposure times. Our method is inspired by feature-based image registration technique. The algorithm is implemented on the light-weight IGN camera, which has an IMU sensor and a SoC/FPGA. To obtain the correct parameters for the resampling of images, the presented method accurately estimates the geometrical relation between the first and the Nth image, taking into account the internal parameters and the distortion of the camera. Features are detected in the first image by the FAST detector, than homologous points on other images are obtained by template matching aided by the IMU sensors. The SoC/FPGA in the camera is used to speed up time-consuming parts of the algorithm such as features detection and images resampling in order to achieve a real-time performance as we want to write only the resulting final image to save bandwidth on the storage device. The paper includes a detailed description of the implemented algorithm, resource usage summary, resulting processing time, resulting images, as well as block diagrams of the described architecture. The resulting stacked image obtained on real surveys doesn’t seem visually impaired. Timing results demonstrate that our algorithm can be used in real-time since its processing time is less than the writing time of an image in the storage device. An interesting by-product of this algorithm is the 3D rotation estimated by a photogrammetric method between poses, which can be used to recalibrate in real-time the gyrometers of the IMU. Numéro de notice : C2017-037 Affiliation des auteurs : LaSTIG LOEMI (2012-2019) Thématique : IMAGERIE Nature : Communication nature-HAL : ComAvecCL&ActesPubliésIntl DOI : 10.5194/isprs-archives-XLII-2-W6-13-2017 date de publication en ligne : 23/08/2017 En ligne : https://doi.org/10.5194/isprs-archives-XLII-2-W6-13-2017 Format de la ressource électronique : URL article Permalink : https://documentation.ensg.eu/index.php?lvl=notice_display&id=91886