Adaptive Deep Learning Detection Model for Multi-Foggy Images.
DOI:
https://doi.org/10.9781/ijimai.2022.11.008Keywords:
Deep Learning, Fog Computing, Image Defogging, Multi-Class ClassificationAbstract
The fog has different features and effects within every single environment. Detection whether there is fog in the image is considered a challenge and giving the type of fog has a substantial enlightening effect on image defogging. Foggy scenes have different types such as scenes based on fog density level and scenes based on fog type. Machine learning techniques have a significant contribution to the detection of foggy scenes. However, most of the existing detection models are based on traditional machine learning models, and only a few studies have adopted deep learning models. Furthermore, most of the existing machines learning detection models are based on fog density-level scenes. However, to the best of our knowledge, there is no such detection model based on multi-fog type scenes have presented yet. Therefore, the main goal of our study is to propose an adaptive deep learning model for the detection of multi-fog types of images. Moreover, due to the lack of a publicly available dataset for inhomogeneous, homogenous, dark, and sky foggy scenes, a dataset for multi-fog scenes is presented in this study (https://github.com/Karrar-H-Abdulkareem/Multi-Fog-Dataset). Experiments were conducted in three stages. First, the data collection phase is based on eight resources to obtain the multi-fog scene dataset. Second, a classification experiment is conducted based on the ResNet-50 deep learning model to obtain detection results. Third, evaluation phase where the performance of the ResNet-50 detection model has been compared against three different models. Experimental results show that the proposed model has presented a stable classification performance for different foggy images with a 96% score for each of Classification Accuracy Rate (CAR), Recall, Precision, F1-Score which has specific theoretical and practical significance. Our proposed model is suitable as a pre-processing step and might be considered in different real-time applications.
Downloads
References
O. Iparraguirre, A. Amundarain, A. Brazalez, and D. Borro, "Sensors on the move: Onboard camera-based real-time traffic alerts paving the way for cooperative roads," Sensors, vol. 21, no. 4, p. 1254, 2021, doi:10.3390/s21041254.
A. Ronen, E. Agassi, and O. Yaron, "Sensing with polarized lidar in degraded visibility conditions due to fog and low clouds," Sensors, vol. 21, no. 7, p. 2510, 2021, doi:10.3390/s21072510
Z. Liu, Y. He, C. Wang, R. Song, "Analysis of the Influence of Foggy Weather Environment on the Detection Effect of Machine Vision Obstacles," Sensors, vol. 20, no. 2, p. 349, 2020, doi: 10.3390/s20020349
G. Broughton, F. Majer, T. Rouček, Y. Ruichek, Z. Yan, and T. Krajník, "Learning to see through the haze: Multi-sensor learning-fusion system for vulnerable traffic participant detection in fog," Robotics and Autonomous Systems, vol. 136, p. 103687, 2021 doi: 10.1016/j.robot.2020.103687
D. Nair and P. Sankaran, "Color image dehazing using surround filter and dark channel prior," Journal of Visual Communication and Image Representation, vol. 50, pp. 9-15, 2018.
Y. Xu, J. Wen, L. Fei, and Z. Zhang, "Review of Video and Image Defogging Algorithms and Related Studies on Image Restoration and Enhancement," IEEE Access, vol. 4, pp. 165-188, 2016.
S. G. Narasimhan and S. K. Nayar, "Vision and the atmosphere," International Journal of Computer Vision, vol. 48, no. 3, pp. 233-254, 2002.
K. H. Abdulkareem, et al., "A Novel Multi-Perspective Benchmarking Framework for Selecting Image Dehazing Intelligent Algorithms Based on BWM and Group VIKOR Techniques," International Journal of Information Technology & Decision Making, Vol. 19, no. 3, pp. 909-957, 2020.
K. H. Abdulkareem et al., "A new standardisation and selection framework for real-time image dehazing algorithms from multi-foggy scenes based on fuzzy Delphi and hybrid multi-criteria decision analysis methods," Neural Computing and Applications, Vol. 33, no. 4, pp. 1029-1054, 2021.
W. Wang and X. Yuan, "Recent advances in image dehazing," IEEE/CAA Journal of Automatica Sinica, vol. 4, no. 3, pp. 410-436, 2017.
C. Qu, D.-Y. Bi, P. Sui, A.-N. Chao, and Y.-F. Wang, "Robust Dehaze Algorithm for Degraded Image of CMOS Image Sensors," Sensors, vol. 17, no. 10, p. 2175, 2017.
J.-M. Guo, J.-y. Syue, V. R. Radzicki, and H. Lee, "An efficient fusion-based defogging," IEEE Transactions on Image Processing, vol. 26, no. 9, pp. 4217-4228, 2017.
N. Baig, M. M. Riaz, A. Ghafoor, and A. M. Siddiqui, "Image dehazing using quadtree decomposition and entropy-based contextual regularization," IEEE Signal Processing Letters, vol. 23, no. 6, pp. 853-857, 2016.
K. Kim, S. Kim, and K.-S. Kim, "Effective image enhancement techniques for fog-affected indoor and outdoor images," IET Image Processing, vol. 12, no. 4, pp. 465-471, 2017.
Y. Wang and P. Yuen, "Image dehazing based on partitioning reconstruction and entropy-based alternating fast-weighted guided filters," Optical Engineering, vol. 56, no. 5, p. 053111, 2017.
A. Alajarmeh, R. A. Salam, K. Abdulrahim, M. F. Marhusin, A. A. Zaidan, and B. B. Zaidan, "Real-time framework for image dehazing based on linear transmission and constant-time airlight estimation," Information Sciences, vol. 436–437, pp. 108-130, 2018.
K. Tang, J. Yang, and J. Wang, "Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing," in 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 2995-3002.
Y. Shi and X. Jiang, "Deep quality assessment toward defogged aerial images," Signal Processing: Image Communication, vol. 83, p. 115808, 2020.
C. Qing, Y. Hu, X. Xu, and W. Huang, "Image haze removal using depthbased cluster and self-adaptive parameters," in 2017 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), 2017, pp. 1070- 1075: IEEE.
M. Pavlić, H. Belzner, G. Rigoll, and S. Ilić, "Image based fog detection in vehicles," in 2012 IEEE Intelligent Vehicles Symposium, 2012, pp. 1132-1137: IEEE.
Y. Liu, J. Pan, J. Ren, and Z. Su, "Learning deep priors for image dehazing," in Proceedings of the IEEE International Conference on Computer Vision, 2019, pp. 2492-2500.
L. Guo et al., "Haze Image Classification Method Based on Alexnet Network Transfer Model," in Journal of Physics: Conference Series, 2019, vol. 1176, no. 3, p. 032011: IOP Publishing.
H. Zhang, V. Sindagi, and V. M. Patel, "Multi-scale single image dehazing using perceptual pyramid deep network," in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2018, pp. 902-911.
C. Hernandez-Olivan, J. R. Beltran, and D. Diaz-Guerra, "Music Boundary Detection using Convolutional Neural Networks: A comparative analysis of combined input features," International Journal of Interactive Multimedia and Artificial Intelligence, vol. 7, no. 2, pp. 78-88, 2021, https://doi.org/10.9781/ijimai.2021.10.005
M.I. Khattak, et al., "Automated detection of COVID-19 using chest x-ray images and CT scans through multilayer-spatial convolutional neural networks," International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 6, pp. 15-24, 2021. https://doi.org/10.9781/ijimai.2021.04.002
Y. Chen, J. Wang, S. Li, and W. Wang, "Multi-feature based Foggy Image Classification," in IOP Conference Series: Earth and Environmental Science, 2019, vol. 234, no. 1, p. 012089: IOP Publishing.
M. Pavlic, G. Rigoll, and S. Ilic, "Classification of images in fog and fog-free scenes for use in vehicles," in 2013 IEEE Intelligent Vehicles Symposium (IV), 2013, pp. 481-486: IEEE.
Y. Xu, J. Wen, L. K. Fei, and Z. Zhang, "Review of Video and Image Defogging Algorithms and Related Studies on Image Restoration and Enhancement," IEEE Access, vol. 4, pp. 165-188, 2016.
H. Shi, Q. Wang, and L. Xie, "A Method of Automatic Detection of Fog Image Based on SVM Classification," Revista de la Facultad de Ingeniería, vol. 31, no. 9, pp. 211-218, 2016.
X. Yu, C. Xiao, M. Deng, and L. Peng, "A classification algorithm to distinguish image as haze or non-haze," in 2011 Sixth International Conference on Image and Graphics, 2011, pp. 286-289: IEEE.
J.-P. Tarel, N. Hautiere, A. Cord, D. Gruyer, and H. Halmaoui, "Improved visibility of road scene images under heterogeneous fog," in 2010 IEEE Intelligent Vehicles Symposium, 2010, pp. 478-485: IEEE.
Y. Li, R. T. Tan, and M. S. Brown, "Nighttime haze removal with glow and multiple light colors," in Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 226-234.
K. He, J. Sun, and X. Tang, "Single image haze removal using dark channel prior," IEEE transactions on pattern analysis and machine intelligence, vol. 33, no. 12, pp. 2341-2353, 2011.
D. Berman, T. Treibitz, and S. Avidan, "Air-light estimation using haze-lines," in 2017 IEEE International Conference on Computational Photography (ICCP), 2017, pp. 1-9: IEEE.
Y. Zhang, G. Sun, Q. Ren, and D. Zhao, "Foggy images classification based on features extraction and SVM," in 2013 International Conference on Software Engineering and Computer Science, 2013: Atlantis Press.
S. Shrivastava, R. K. Thakur, and P. Tokas, "Classification of hazy and nonhazy images," in 2017 International Conference on Recent Innovations in Signal processing and Embedded Systems (RISE), 2017, pp. 148-152: IEEE.
Y. Liu, H. Li, and M. Wang, "Single image dehazing via large sky region segmentation and multiscale opening dark channel model," IEEE Access, vol. 5, pp. 8890-8903, 2017.
Y. Song, H. Luo, J. Ma, B. Hui, and Z. Chang, "Sky detection in hazy image," Sensors, vol. 18, no. 4, p. 1060, 2018.
K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770-778.
Z. Chen, Z. Xie, W. Zhang, and X. Xu, "ResNet and Model Fusion for Automatic Spoofing Detection," in INTERSPEECH, 2017, pp. 102-106.
R. K. Srivastava, K. Greff, and J. Schmidhuber, "Highway networks," 2015. Arxiv:1505.00387.
R. Fattal, "Dehazing using color-lines," ACM transactions on graphics (TOG), vol. 34, no. 1, p. 13, 2014.
C. O. Ancuti, C. Ancuti, R. Timofte, and C. De Vleeschouwer, "O-haze: a dehazing benchmark with real hazy and haze-free outdoor images," in Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2018, pp. 754-762.
K. D. Ma, W. T. Liu, and Z. Wang, "Perceptual evaluation of single image dehazing algorithms," in 2015 Ieee International Conference on Image Processing, 2015, pp. 3600-3604.
L. K. Choi, J. You, and A. C. Bovik, "Referenceless prediction of perceptual fog density and perceptual image defogging," IEEE Transactions on Image Processing, vol. 24, no. 11, pp. 3888-3901, 2015.
A. Galdran, J. Vazquez-Corral, D. Pardo, and M. Bertalmio, "Fusion-based variational image dehazing," IEEE Signal Processing Letters, vol. 24, no. 2, pp. 151-155, 2016.
B. Li et al., "Benchmarking Single-Image Dehazing and Beyond," IEEE Transactions on Image Processing, vol. 28, no. 1, pp. 492-505, 2019.
J. Li, G. Li, and H. Fan, "Image dehazing using residual-based deep CNN," IEEE Access, vol. 6, pp. 26831-26842, 2018.
Y. Qu, Y. Chen, J. Huang, and Y. Xie, "Enhanced pix2pix dehazing network," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 8160-8168.
J. Zhang and D. Tao, "FAMED-Net: a fast and accurate multi-scale endto-end dehazing network," IEEE Transactions on Image Processing, vol. 29, pp. 72-84, 2019.
X. Zhu, X. Xu, and N. Mu, "Saliency Detection Based on the Combination of High-Level Knowledge and Low-Level Cues in Foggy Images," Entropy, vol. 21, no. 4, p. 374, 2019.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in neural information processing systems, 2012, pp. 1097-1105.
Abayomi-Alli, O. O., Damasevicius, R., Maskeliunas, R., & Abayomi-Alli, A. (2020). "BiLSTM with data augmentation using interpolation methods to improve early detection of parkinson disease," Proceedings of the 2020 Federated Conference on Computer Science and Information Systems, FedCSIS 2020, 371-380. doi: 10.15439/2020F188.
Abayomi-Alli, O. O., Damaševičius, R., Wieczorek, M., & Woźniak, M. (2020). "Data augmentation using principal component resampling for image recognition by deep learning," In Artificial Intelligence and Soft Computing (pp. 39–48). Springer International Publishing. doi: 10.1007/978-3-030-61534-5_4.
Arif, Zainab Hussein, et al. "Comprehensive Review of machine Learning (ML) in Image Defogging: Taxonomy of Concepts, Scenes, Feature Extraction, and Classification techniques," IET Image Processing (2021).
K. H. Abdulkareem, et al., "Mapping and Deep Analysis of Image Dehazing: Coherent Taxonomy, Datasets, Open Challenges, Motivations, and Recommendations," International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 7, no. 2, pp. 172-198, 2021.
Al-Mhiqani, Mohammed Nasser, et al. "New insider threat detection method based on recurrent neural networks," Indonesian Journal of Electrical Engineering and Computer Science, vol. 17, no. 3, pp. 1474-1479, 2020.
M. Hossin, and D. M. Sulaiman, "A review on evaluation metrics for data classification evaluations," International Journal of Data Mining & Knowledge Management Process, vol. 5, no. 2, pp. 1-11, 2015.
Downloads
Published
-
Abstract156
-
PDF33
Submit Article
Information
