Deep Generative AI Based on Denoising Diffusion Probabilistic Models for Applications in Image Processing

• Autores: Bezerra, Emili Silva, Leher, Quefren Oliveira, Alves, Uendel Diego da Silva, Paixão, Thuanne, Alvarez, Ana Beatriz
• Formato: artículo
• Fecha de Publicación: 2024
• Institución: Universidad de Lima
• Repositorio: Revistas - Universidad de Lima
• Lenguaje: inglés; español
• OAI Identifier: oai:revistas.ulima.edu.pe:article/7389
• Enlace del recurso: https://revistas.ulima.edu.pe/index.php/Interfases/article/view/7389
• Nivel de acceso: acceso abierto
• Materia: machine learning; reconstruction; segmentation; face and gesture recognition; remote sensing; aprendizaje automático; reconstrucción; segmentación; reconocimiento facial y gestual; teledetección

Denoising diffusion probabilistic models (DDPMs) have demonstrated significant potential in addressing complex image processing challenges. This paper explores the application of DDPMs in three different areas: reconstruction of remote sensing imagery affected by cloud cover, reconstruction of facial images with occluded areas, and segmentation of bodies of water from remote sensing imagery. Inpainting involves filling in missing regions in images, while DDPMs act as data generators capable of synthesizing information that alings coherently with the context of the original data. Inspired by the inpainting technique, the RePaint approach was adapted and applied to reconstruction tasks. The WaterSegDiff approach, which uses a diffusion model as a backbone, was employed for the segmentation task. To illustrate the model’s behavior and provide examples of the tasks, experiments were carried out with both qualitative and quantitative evaluations. The qualitative results show the model’s ability to generate data for reconstruction and segmentation. Quantitatively, metrics such as MSE, PSNR, SSIM, IoU, PA and F1 score highlight the model’s proficient performance in image processing tasks. In this scenario, DDPMs have proved to be a promising tool for high-quality data reconstruction, enabling the hallucination of image regions with high visual coherence and facilitating applications in various areas, such as environmental monitoring, facial recognition, water resource mapping, among others.