|
|
论文:2022,Vol:40,Issue(6):1327-1334 |
|
|
引用本文： |
|
|
李亮亮, 任佳, 王鹏, 吕志刚, 孙梦宇, 李晓艳, 高武奇. 基于曝光融合的无人机航拍图像增强算法[J]. 西北工业大学学报 |
|
|
LI Liangliang, REN Jia, WANG Peng, LYU Zhigang, SUN Mengyu, LI Xiaoyan, GAO Wuqi. Image enhancement method based on exposure fusion for UAV aerial photography[J]. Journal of Northwestern Polytechnical University |
|
|
|
|
|
|
|
| 基于曝光融合的无人机航拍图像增强算法 |
|
| 李亮亮1, 任佳1,2, 王鹏3, 吕志刚1,3, 孙梦宇4, 李晓艳3, 高武奇5 |
|
1. 西安工业大学 机电工程学院, 陕西 西安 710021;
2. 海南大学 信息与通信工程学院, 海南 海口 570228;
3. 西安工业大学 电子信息工程学院, 陕西 西安 710021;
4. 西安工业大学 光电工程学院, 陕西 西安 710021;
5. 西安工业大学 计算机科学与工程学院, 陕西 西安 710021 |
| 摘要: |
| 针对无人机航拍图像光照不均匀及自然雾导致影像质量退化问题,提出了一种无人机航拍图像增强算法。利用改进的低照度图像增强算法均衡亮度对比度;为了解决均衡后图像过增强问题,提出了联合去雾及曝光融合的色彩矫正增强方法;为了保留增强图像的边缘纹理信息,设计了一种效果更佳的细节增强算法,处理后统计直方图更为平滑,可在一定程度上抑制部分噪声,细节纹理信息更强。实验结果表明,所提的航拍图像增强算法,能够有效解决因光照不均或自然雾引起的影像退化现象,提高了无人机航拍图像的质量,主客观图像质量评价指标优于现有绝大多数主流算法,性能更佳。 |
| 关键词:
无人机航拍图像增强
影像退化
曝光融合
多尺度细节增强
|
|
| Image enhancement method based on exposure fusion for UAV aerial photography |
|
| LI Liangliang1, REN Jia1,2, WANG Peng3, LYU Zhigang1,3, SUN Mengyu4, LI Xiaoyan3, GAO Wuqi5 |
|
1. School of Mechatronic Engineering, Xi'an Technological University, Xi'an 710021, China;
2. School of Information and Communication Engineering, Hainan University, Haikou 570228, China;
3. School of Electronics and Information Engineering, Xi'an Technological University, Xi'an 710021, China;
4. School of Optoelectronic Engineering, Xi'an Technological University, Xi'an 710021, China;
5. School of Computer Science and Engineering, Xi'an Technological University, Xi'an 710021, China |
| Abstract: |
| Aiming at the problem of image quality degradation caused by uneven illumination of UAV aerial images and natural fog, a UAV aerial image enhancement algorithm was proposed. Firstly, an improved low-illumination image enhancement algorithm is used to balance the brightness and contrast; secondly, in order to solve the image over-enhancement after equalization, a color correction enhancement method combining dehazing and exposure fusion is proposed; finally, in order to preserve the edge texture information of the enhanced image, a detail enhancement algorithm with better effect is designed. After processing, the statistical histogram is smoother, some noise can be suppressed to a certain extent, and the detailed texture information is stronger. The experimental results show that the present aerial image enhancement algorithm can effectively solve the image degradation caused by uneven illumination or natural fog. The quality of UAV aerial images is improved, and the subjective and objective image quality evaluation indicators are better than most of the existing mainstream algorithms, and the performance is better. |
| Key words:
UAV aerial photography image enhancement
image degradation
exposure fusion
multi-scale detail enhancement
|
|
| 收稿日期: 2022-03-22
修回日期:
|
| DOI: 10.1051/jnwpu/20224061327 |
| 基金项目: 国家自然科学基金(62171360、61961160706)、西安市智能兵器重点实验室(2019220514SYS020CG042)、2022年度陕西高校青年创新团队项目、海南省自然科学基金创新研究团队项目(620CXTD434)、海南省自然科学基金高层次人才项目(620RC557)与澳门科技发展联合基金(0066/2019/AFJ)资助 |
| 通讯作者: 王鹏(1978—),西安工业大学教授,主要从事图像处理、故障诊断及健康管理研究。e-mail:wp_xatu@163.com
Email：wp_xatu@163.com |
| 作者简介: 李亮亮(1996—),西安工业大学博士研究生,主要从事遥感图像处理及工业缺陷检测、故障诊断及寿命预测研究
|
|
| 相关功能 |
|
|
|
|
| 作者相关文章 |
|
| 李亮亮 在本刊中的所有文章 |
| 任佳 在本刊中的所有文章 |
| 王鹏 在本刊中的所有文章 |
| 吕志刚 在本刊中的所有文章 |
| 孙梦宇 在本刊中的所有文章 |
| 李晓艳 在本刊中的所有文章 |
| 高武奇 在本刊中的所有文章 |
|
|
|
|
|
|
|
|
参考文献: |
|
|
[1] 刘卫东, 李吉玉, 张文博, 等. 基于Retinex和ADMM优化的水下光照不均匀图像增强算法[J]. 西北工业大学学报, 2021, 39(4):824-830 LIU Weidong, LI Jiyu, ZHANG Wenbo, et al. Underwater image enhancement method with non-uniform illumination based on Retinex and ADMM[J]. Journal of Northwestern Polytechnical University, 2021, 39(4):824-830 (in Chinese)
[2] 段镖, 李靖, 陈怀民, 等. 一种新的夜间单图像去雾方法[J]. 西北工业大学学报, 2021, 39(3):604-610 DUAN Biao, LI Jing, Chen Huaimin, et al. New approach to dehaze single nighttime image[J]. Journal of Northwestern Polytechnical University, 2021, 39(3):604-610 (in Chinese)
[3] 肖进胜, 庞观林, 唐路敏, 等. 基于轮廓模板和自学习的图像纹理增强超采样算法[J]. 自动化学报, 2016, 42(8):1248-1258 XIAO Jinsheng, PANG Guanlin, TANG Lumin, et al. Image texture enhancement supersampling algorithm based on contour template and self-learning[J]. Acta Automatica Sinica, 2016, 42(8):1248-1258 (in Chinese)
[4] 徐少平, 张贵珍, 林珍玉,等. 一种多图像局部结构化融合的低照度图像增强算法[J]. 自动化学报, 2022, 48(10):1-15 XU Shaoping, ZHANG Guizhen, LIN Zhenyu, et al. A low-light image enhancement algorithm based on local structured fusion of multiple images[J]. Acta Automatica Sinica, 2022, 48(10):1-15 (in Chinese)
[5] XU H T, ZHAI G T, WU X L, et al. Generalized equal-ization model for image enhancement[J]. IEEE Trans on Multimedia, 2014, 16(1):68-82
[6] CELIK T. Spatial entropy-based global and local image con-trast enhancement[J]. IEEE Trans on Image Processing, 2014, 23(12):5298-5308
[7] 刘志成, 王殿伟, 刘颖, 等. 基于二维伽马函数的光照不均匀图像自适应校正算法[J]. 北京理工大学学报, 2016, 36(2):191-196 LIU Zhicheng, WANG Dianwei, LIU Ying, et al. Adaptive correction algorithm for uneven illumination image based on two-dimensional gamma function[J]. Journal of Beijing Institute of Technology, 2016, 36(2):191-196 (in Chinese)
[8] JOBSON D J, RAHMAN Z, WOODELL G A. Properties and performance of a center/surround retinex[J]. IEEE Trans on Image Processing, 1997, 6(3):451-462
[9] JOBSON D J, RAHMAN Z, WOODELL G A. A multiscale retinex for bridging the gap between color images and the human observation of scenes[J]. IEEE Trans on Image Processing, 1997, 6(7):965-976
[10] WANG Y K, HUANG W B. A CUDA-enabled parallel algorithm for accelerating retinex[J]. Journal of Real-Time Image Processing, 2014, 9(3):407-425
[11] 衡宝川, 肖迪, 张翔. 结合MSRCP增强的夜间彩色图像拼接算法[J]. 计算机工程与设计,2019, 40(11):3200-3204 HENG Baochuan, XIAO Di, ZHANG Xiang. Night-time color image stitching algorithm combined with MSRCP enhancement[J]. Computer Engineering and Design, 2019, 40(11):3200-3204 (in Chinese)
[12] JI W, LIU D, MENG Y, et al. Exploring the solutions via Retinex enhancements for fruit recognition impacts of outdoor sunlight:a case study of navel oranges[J]. Evolutionary Intelligence, 2022, 15(3):1875-1911
[13] GUO X J, LI Y, LING H B. LIME:low-light image enhance-ment via illumination map estimation[J]. IEEE Trans on Image Processing, 2017, 26(2):982-993
[14] DABOV K, FOI A, KATKOVNIK V, et al. Image denoising by sparse 3D transform-domain collaborative filtering[J]. IEEE Trans on Image Processing, 2007, 16(8):2080-2095
[15] DONG X, WANG G, Pang T, et al. Fast efficient algorithm for enhancement of low lighting video[C]//Proceedings of IEEE & International Conference on Multimedia and Expo, 2011
[16] HE K, SUN J, TANG X. Single image haze removal using dark channel prior[J]. IEEE Trans on Pattern Analysis and Machine Intelligence, 2010, 33(12):2341-2353
[17] LI Z G, ZHENG J H, RAHARDJA S. Detail-enhanced exposure fusion[J]. IEEE Trans on Image Processing, 2012, 21(11):4672-4676
[18] FU X, ZENG D, HUANG Y, et al. A fusion-based enhancing method for weakly illuminated images[J]. Signal Processing, 2016, 129:82-96
[19] YING Z, GE L, WEN G. A bio-inspired multi-exposure fusion framework for low-light image enhancement[J/OL].(2017-11-02)[2022-01-04]. https://doi.org/10.48550/arXiv.1711.00591
[20] YING Z, GE L, REN Y, et al. A new image contrast enhancement algorithm using exposure fusion framework[C]//International Conference on Computer Analysis of Images and Patterns, 2017
[21] LIU S, ZHANG Y. Detail-preserving underexposed image enhancement via optimal weighted multi-exposure fusion[J]. IEEE Trans on Consumer Electronics, 2019, 65(3):303-311
[22] KIM Y, KOH Y J, LEE C, et al. Dark image enhancement based onpairwise target contrast and multi-scale detail boosting[C]//IEEE International Conference on Image Processing, 2015
[23] ZHANG Q, NIE Y, ZHENG W S. Dual illumination estimation for robust exposure correction[C]//Computer Graphics Forum, 2019
[24] WANG S, ZHENG J, HU H, et al. Naturalness preserved enhancement algorithm for non-uniform illumination images[J]. IEEE Trans on Image Processing, 2013, 22(9):3538-3548
[25] Fu X, Zeng D, Huang Y, et al. A weighted variational model for simultaneous reflectance and illumination estimation[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 2016
[26] WANG W, CHEN Z, YUAN X, et al. Adaptive image enhancement method for correcting low-illumination images[J]. Information Sciences, 2019, 496:25-41
[27] HAO S, HAN X, GUO Y, et al. Low-light image enhancement with semi-decoupled decomposition[J]. IEEE Trans on Multimedia, 2020, 22(12):3025-3038
[28] LI M, LIU J, YANG W, et al. Structure-revealing low-light image enhancement via robust retinex model[J]. IEEE Trans on Image Processing, 2018, 27(6):2828-2841
[29] ZHANG L, ZHANG L, BOVIK A C. A feature-enriched completely blind image quality evaluator[J]. IEEE Trans on Image Processing, 2015, 24(8):2579-2591
[30] MIN X, ZHAI G, GU K, et al. Blind image quality estimation via distortion aggravation[J]. IEEE Trans on Broadcasting, 2018, 64(2):508-517
[31] LIU L, LIU B, HUANG H, et al. No-reference image quality assessment based on spatial and spectral entropies[J]. Signal Processing Image Communication, 2014, 29(8):856-863
[32] VENKATANATH N, PRANEETH D, CHANDRASEKHAR B, et al. Blind image quality evaluation using perception based features[C]//2015 21st National Conference on Communications, 2015
[33] MITTAL A, SOUNDARARAJAN R, BOVIK A C. Making a "completely blind" image quality analyzer[J]. IEEE Trans on Signal Processing Letters, 2012, 20(3):209-212 |
|
|
|
|
|
|
|
