多阶段渐进处理的图像去雨方法

廉继红; 王平; 李英; 李云红

doi:10.16152/j.cnki.xdxbzr.2025-02-007

您当前的位置：

首页 >

文章列表页 >

多阶段渐进处理的图像去雨方法

人工智能图像处理 | 更新时间：2025-04-21

- 多阶段渐进处理的图像去雨方法
- The image rain removal method based on multi-stage progressive processing
- 西北大学学报（自然科学版） 2025年55卷第2期页码：297-308
- 作者机构：
  
  西安工程大学　电子信息学院，陕西　西安　 710048
- 作者简介：
  
  廉继红，男，副教授，从事工业信号信息处理、计算机控制系统研究，lianjihong@163.com。
- 基金信息：
  
  陕西省科技计划项目(2022GY-053);陕西省科技厅自然科学基础研究重点项目(2022JZ-35)
- DOI：10.16152/j.cnki.xdxbzr.2025-02-007
  中图分类号： TP391.4
- 收稿日期：2024-10-25，
  
  纸质出版日期：2025-04-25
- 稿件说明：
移动端阅览
廉继红, 王平, 李英, 等. 多阶段渐进处理的图像去雨方法[J]. 西北大学学报（自然科学版）, 2025,55(2):297-308.

LIAN Jihong, WANG Ping, LI Ying, et al. The image rain removal method based on multi-stage progressive processing[J]. Journal of northwest university (natural science edition), 2025, 55(2): 297-308.
廉继红, 王平, 李英, 等. 多阶段渐进处理的图像去雨方法[J]. 西北大学学报（自然科学版）, 2025,55(2):297-308. DOI： 10.16152/j.cnki.xdxbzr.2025-02-007.

LIAN Jihong, WANG Ping, LI Ying, et al. The image rain removal method based on multi-stage progressive processing[J]. Journal of northwest university (natural science edition), 2025, 55(2): 297-308. DOI： 10.16152/j.cnki.xdxbzr.2025-02-007.

摘要

针对现有图像去雨方法中存在雨纹去除不彻底、纹理信息丢失等问题，提出一种多阶段渐进式处理的图像去雨算法，可以同时将上下阶段的特征融合，使去雨算法的性能有很大的提高。该去雨网络模型由3个阶段构成。前2个阶段采用改进后的U-Net编码器解码器结构学习多尺度上下文特征信息，特征提取部分采用有效通道注意力机制（efficient channel attention network，ECANet），使网络模型参数变小，更加轻量级；第3阶段加入并行注意力机制（parallel attention subnetwork，PASNet），在学习上下文信息和空间细节特征的同时还能生成高分辨率特征，更好地保留图像的输出细节。此外，还引入监督注意力模块（supervised attention module，SAM）以加强特征学习。实验结果表明，在数据集Rain100H上PSNR达到29.37 dB，SSIM为0.88；在Test1200上PSNR达到32.50 dB，SSIM为0.93，验证了所提方法在图像去雨任务上的有效性。

Abstract

Aiming at the problems of incomplete rain pattern removal and texture information loss in the existing image rain removal methods

this paper proposes a multi-stage progressive image rain removal algorithm

which can simultaneously fuse the features of the upper and lower stages and greatly improve the performance of the rain removal algorithm. The rain removal network model consists of three stages. In the first two stages

the improved U-Net coder-decoder structure is used to learn multi-scale context information

and the efficient channel attention network (ECANet) is used for feature extraction

which can reduce the parameters of the network model. In the third stage of becoming lighter

parallel attention subnet (PASNet) is added

which can generate high-resolution features while learning contextual information and spatial details

and can better preserve the output details of images. At the same time

supervised attention module (SAM) is introduced to strengthen feature learning. The experimental results show that the PSNR is 29.37 dB and SSIM is 0.88 on the data set Rain100H; The PSNR is 32.50 dB and SSIM is 0.93 on Test1200

which verifies the effectiveness of the proposed method in the task of image rain removal.

关键词

Keywords

references

彭进业 , 余喆 , 屈书毅 , 等 . 基于深度学习的图像修复方法研究综述 [J ] . 西北大学学报(自然科学版) , 2023 , 53 ( 6 ): 943 - 963 .

PENG J Y , YU Z , QU S Y , et al . A review of image restoration methods based on deep learning [J ] . Journal of Northwest University (Natural Science Edition) , 2023 , 53 ( 6 ): 943 - 963 .

陈舒曼 , 陈玮 , 尹钟 . 单幅图像去雨算法研究现状及展望 [J ] . 计算机应用研究 , 2022 , 39 ( 1 ): 9 - 17 .

CHEN S M , CHEN W , YIN Z , Research status and prospect of single image ram removal algorithm [J ] . Application Research of Computers , 2022 , 39 ( 1 ): 9 - 17 .

SUN P Z , ZHANG R F , JIANG Y , et al . Sparse R-CNN: End-to-end object detection with learnable proposals [C ] // 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Nashville, TN : IEEE , 2021 : 14449 - 14458 .

CARION N , MASSA F , SYNNAEVE G , et al . End-to-end object detection with transformers [M ] //Computer Vision-ECCV 2020 . Cham : Springer International Publishing , 2020 : 213 - 229 .

FU Zhihong , FU Zehua , LIU Q J , et al . SparseTT: Visual tracking with sparse transformers [EB/OL ] . ( 2022-05-08 )[ 2024-09-20 ] . https://arxiv.org/abs/2205.03776 https://arxiv.org/abs/2205.03776 .

SONG Z K , YU J Q , CHEN Y P , et al . Transformer tracking with cyclic shifting window attention [C ] // 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . New Orleans, LA : IEEE , 2022 : 8781 - 8790 .

YAN W D , TAN R T , YANG W H , et al . Self-aligned video deraining with transmission-depth consistency [C ] // 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Nashville, TN : IEEE , 2021 : 11966 - 11976 .

YUE Z S , XIE J W , ZHAO Q , et al . Semi-supervised video deraining with dynamical rain generator [C ] // 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Nashville, TN : IEEE , 2021 : 642 - 652 .

JIANG T X , HUANG T Z , ZHAO X L , et al . A novel tensor-based video rain streaks removal approach via utilizing discriminatively intrinsic priors [C ] // 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Honolulu, HI : IEEE , 2017 : 2818 - 2827 .

ZHANG H , PATEL V M . Density-aware single image de-raining using a multi-stream dense network [C ] // 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City, UT : IEEE , 2018 : 695 - 704 .

QIAN R , TAN R T , YANG W H , et al . Attentive generative adversarial network for raindrop removal from a single image [C ] // 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City, UT : IEEE , 2018 : 2482 - 2491 .

WEI Y Y , ZHANG Z , WANG Y , et al . DerainCycleGAN: Rain attentive CycleGAN for single image deraining and rainmaking [J ] . IEEE Transactions on Image Processing , 2021 , 30 : 4788 - 4801 .

FU X Y , HUANG J B , ZENG D L , et al . Removing rain from single images via a deep detail network [C ] // 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Honolulu, HI : IEEE , 2017 : 1715 - 1723 .

ZHENG X H , LIAO Y H , GUO W , et al . Single-image-based rain and snow removal using multi-guided filter [M ] //Neural Information Processing . Berlin, Heidelberg : Springer Berlin Heidelberg , 2013 : 258 - 265 .

FU X Y , LIANG B R , HUANG Y , et al . Lightweight pyramid networks for image deraining [J ] . IEEE Transactions on Neural Networks and Learning Systems , 2020 , 31 ( 6 ): 1794 - 1807 .

YANG W H , TAN R T , FENG J S , et al . Deep joint rain detection and removal from a single image [C ] // 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Honolulu, HI : IEEE , 2017 : 1685 - 1694 .

REN D W , ZUO W M , HU Q H , et al . Progressive image deraining networks: A better and simpler baseline [C ] // 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Long Beach, CA : IEEE , 2019 : 3937 - 3946 .

WANG Q L , WU B G , ZHU P F , et al . ECA-Net: Efficient channel attention for deep convolutional neural networks [C ] // 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Seattle, WA : IEEE , 2020 : 11531 - 11539 .

RONNEBERGER O , FISCHER P , BROX T . U-Net: Convolutional networks for biomedical image segmentation [EB/OL ] . ( 2015-05-18 )[ 2024-09-20 ] . https://arxiv.org/abs/1505.04597 https://arxiv.org/abs/1505.04597 .

LAI W S , HUANG J B , AHUJA N , et al . Deep Laplacian pyramid networks for fast and accurate super-resolution [C ] // 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Honolulu, HI : IEEE , 2017 : 5835 - 5843 .

JIANG K , WANG Z Y , YI P , et al . Multi-scale progressive fusion network for single image deraining [C ] // 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Seattle, WA : IEEE , 2020 : 8343 - 8352 .

YI Z L , ZHANG H , TAN P , et al . DualGAN: Unsupervised dual learning for image-to-image translation [C ] // 2017 IEEE International Conference on Computer Vision (ICCV) . Venice : IEEE , 2017 : 2868 - 2876 .

YASARLA R , PATEL V M . Uncertainty guided multi-scale residual learning-using a cycle spinning CNN for single image de-raining [C ] // 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Long Beach, CA : IEEE , 2019 : 8397 - 8406 .

LI X , WU J L , LIN Z C , et al . Recurrent squeeze-and-excitation context aggregation net for single image deraining [C ] // Computer Vision-ECCV 2018 . Cham : Springer International Publishing , 2018 : 262 - 277 .

WANG Z D , CUN X D , BAO J M , et al . Uformer: A general U-shaped transformer for image restoration [C ] // 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . New Orleans, LA : IEEE , 2022 : 17662 - 17672 .

ZAMIR S W , ARORA A , KHAN S , et al . Multi-stage progressive image restoration [C ] // 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Nashville, TN : IEEE , 2021 : 14821 - 14831 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于糊集的陶质文物碎片点云特征提取算法

基于弱监督深度学习的图像检索技术研究

基于小波相干分析的阵发性房颤自动检测方法

一种新的房颤心电特征提取方法

癫痫脑电的特征提取方法综述