An Extreme Learning Machine-Relevance Feedback Framework for Enhancing the Accuracy of a Hybrid Image Retrieval System.

B. Shikha; P. Gitanjali; D. Pawan Kumar

doi:10.9781/ijimai.2020.01.002

Authors

B. Shikha Kurukshetra University
P. Gitanjali Kurukshetra University
D. Pawan Kumar Kurukshetra University

DOI:

https://doi.org/10.9781/ijimai.2020.01.002

Keywords:

Extreme Learning Machine, Gray Level Co-occurrence Matrix, Relevance Feedback, Region Props Procedure

Abstract

The process of searching, indexing and retrieving images from a massive database is a challenging task and the solution to these problems is an efficient image retrieval system. In this paper, a unique hybrid Content-based image retrieval system is proposed where different attributes of an image like texture, color and shape are extracted by using Gray level co-occurrence matrix (GLCM), color moment and various region props procedure respectively. A hybrid feature matrix or vector (HFV) is formed by an integration of feature vectors belonging to three individual visual attributes. This HFV is given as an input to an Extreme learning machine (ELM) classifier which is based on a solitary hidden layer of neurons and also is a type of feed-forward neural system. ELM performs efficient class prediction of the query image based on the pre-trained data. Lastly, to capture the high level human semantic information, Relevance feedback (RF) is utilized to retrain or reformulate the training of ELM. The advantage of the proposed system is that a combination of an ELM-RF framework leads to an evolution of a modified learning and intelligent classification system. To measure the efficiency of the proposed system, various parameters like Precision, Recall and Accuracy are evaluated. Average precision of 93.05%, 81.03%, 75.8% and 90.14% is obtained respectively on Corel-1K, Corel-5K, Corel-10K and GHIM-10 benchmark datasets. The experimental analysis portrays that the implemented technique outmatches many state-of-the-art related approaches depicting varied hybrid CBIR system.

Downloads

Download data is not yet available.

References

[1] J. Pradhan, S. Kumar, A. K. Pal, and H. Banka, “A hierarchical CBIR framework using adaptive tetrolet transform and novel histograms from color and shape features,” Digit. Signal Process. A Rev. J., vol. 82, pp. 258–281, 2018.

[2] S. Fadaei, R. Amirfattahi, and M. R. Ahmadzadeh, “New content-based image retrieval system based on optimised integration of DCD, wavelet and curvelet features,” IET Image Process., vol. 11, no. 2, pp. 89–98, 2017.

[3] A. Alzu’bi, A. Amira, and N. Ramzan, “Semantic content-based image retrieval: A comprehensive study,” J. Vis. Commun. Image Represent., vol. 32, pp. 20-54, 2015.

[4] R. Chaudhari and A. M. Patil, “Content Based Image Retrieval Using Color and Shape Features,” Int. J. Adv. Res. Electr. Electron. Instrum. Eng., vol. 1, no. 5, pp. 386-392, 2012.

[5] L. K. Pavithra and T. S. Sharmila, “An efficient framework for image retrieval using color, texture and edge features,” Comput. Electr. Eng., vol. 0, pp. 1–14, 2017.

[6] M. K. Alsmadi, “An efficient similarity measure for content based image retrieval using memetic algorithm,” Egyptian J. of Basic and Appl. Sci., vol. 4, no. 2, pp. 1-11, 2017.

[7] E. Mehdi, E. Aroussi, and N. El Houssif, “Content-Based Image Retrieval Approach Using Color and Texture Applied to Two Databases (Coil-100 and Wang)”. Springer International Publishing, https://doi.org/10.1007/978-3-319-76357-6_5, pp. 49-59, 2018.

[8] M. A. Ansari, M. Dixit, D. Kurchaniya, and P. K. Johari, “An Effective Approach to an Image Retrieval using SVM Classifier” Int. J. of Computer Sciences and Engineering, vol. 5, no. 6, pp. 64-72, March 2018.

[9] Y. Mistry, D. T. Ingole, and M. D. Ingole, “Content based image retrieval using hybrid features and various distance metric,” J. Electr. Syst. Inf. Technol., no. 2016, pp. 1–15, 2017.

[10] J. M. Guo, H. Prasetyo, and H. Su, “Image indexing using the color and bit pattern feature fusion,” J. Vis. Commun. Image Represent., vol. 24, no. 8, pp. 1360–1379, 2013.

[11] P. Srivastava and A. Khare, “Utilizing multiscale local binary pattern for content-based image retrieval,” Mutimedia Tools and App., DOI 10.1007/ s11042-017-4894-4, pp. 1-27, 2017.

[12] C. Singh and K. Preet Kaur, “A fast and efficient image retrieval system based on color and texture features,” J. Vis. Commun. Image Represent., vol. 41, no. October, pp. 225–238, 2016.

[13] M. V. Lande, P. Bhanodiya, and P. Jain, “An Effective Content-Based Image Retrieval Using Color, Texture and Shape Feature,” Intelligent Computing, Networking, and Informatics, Advances in Intelligent Systems and Computing 243, DOI: 10.1007/978-81-322-1665-0_119, pp. 1163– 1170, 2014.

[14] M. Arevalillo-Herráez, F. J. Ferri, and S. Moreno-Picot, “A hybrid multiobjective optimization algorithm for content based image retrieval,” Appl. Soft Comput., vol. 13, no. 11, pp. 4358–4369, 2013.

[15] M. Mosbah and B. Boucheham, “Distance selection based on relevance feedback in the context of CBIR using the SFS meta-heuristic with one round,” Egypt. Informatics J., vol. 18, no. 1, pp. 1–9, 2017.

[16] E. Walia, S. Vesal, and A. Pal, “An Effective and Fast Hybrid Framework for Color Image Retrieval,” Sens Imaging, vol. 15, no. 1, pp. 1-23, 2014.

[17] A. K. Jain and A. Vailaya, “Image retrieval using color and shape,” Pattern Recognit., vol. 29, no. 8, pp. 1233-1244, 1996.

[18] C.-H. Lin, R.-T. Chen, and Y.-K. Chan, “A smart content-based image retrieval system based on color and texture feature,” Image Vis. Comput., vol. 27, no. 6, pp. 658–665, 2009.

[19] D. Pandey, “An Efficient Low Level Features of CBIR using Wavelet, GLDM and SMOSVM Method,” Int. J. of Signal Processing, Image Processing and Pattern Recog., vol. 10, no. 3, pp. 13–22, 2017.

[20] C. S. Parkhi and A. Gupta, “A comparative implementation of Content Based Image Retrieval techniques in Wavelet and Cosine domains,” IOSR J. Electron. Commun. Eng., vol. 9, no. 2, pp. 25–30, 2014.

[21] N. Neelima, E. Sreenivasa Reddy, and N. Kalpitha, “An Efficient QBIR System Using Adaptive Segmentation and Multiple Features,” Procedia Comput. Sci., vol. 87, pp. 134–139, 2016.

[22] P. Sharma, “Improved shape matching and retrieval using robust histograms of spatially distributed points and angular radial transform,” Opt. - Int. J. Light Electron Opt., vol. 145, pp. 346–364, 2017.

[23] P. Vikhar, R. Scholar, and P. Karde, “Improved CBIR System using Edge Histogram Descriptor (EHD) and Support Vector Machine (SVM).” in Proc. of IEEE Int. Conf. on ICT in Business, Industry and Government (ICTBIG), Indore, India, pp. 1-5, 2016.

[24] R. Usha and K. Perumal, “Content Based Image Retrieval using Combined Features of Color and Texture Features with SVM Classification,” Int. J. of Comp. Science & Comm. Networks vol. 4, no. 5, pp. 169–174.

[25] K. S. Arun, V. K. Govindan, “A Hybrid Deep Learning Architecture for Latent Topic-based Image Retrieval,” Data Sci. Eng., vol. 3, no. 2, pp. 166–195, 2018.

[26] R. R. Saritha, V. Paul, and P. G. Kumar, “Content based image retrieval using deep learning process,” Cluster Comput., no. February, pp. 1–14, 2018.

[27] M. Mansourvar, S. Shamshirband, R. G. Raj, and R. Gunalan, “An Automated System for Skeletal Maturity Assessment by Extreme Learning Machines,” PLOS One, doi:10.1371/journal.pone.0138493, pp. 1–14, 2015.

[28] Y. Kaya, L. Kayci, R. Tekin, and Ö. Faruk, “Evaluation of texture features for automatic detecting butterfly species using extreme learning machine,” J. of Experimental & Theoretical Artificial Intelligence, vol. 26, no. 2, pp. 37–41, 2015.

[29] R. Fu, B. Li, Y. Gao, and P. Wang, “Content-Based Image Retrieval Based on CNN and SVM,” In Proc. of IEEE Int. Conf. on Computer and Comm., Chengdu, 14-17, pp. 1-5, 2016.

[30] K. Hemachandran, A. Paul, and M. Singha, “Content-based image retrieval using the combination of the fast wavelet transformation and the colour histogram,” IET Image Process., vol. 6, no. 9, pp. 1221–1226, 2012.

[31] S. M. Singh and K. Hemachandran, “Content- Content - Based Image Retrieval using Color Moment and Gabor Texture Feature,” Int. J. of Comp. Science Issues, vol. 9, no. 5, pp. 299–309, 2012.

[32] W.D. Carlos, M.C.R. Renata and A. L. B. Candeias, “Texture classification based on co-occurance matrix and self-organizing map,” In Proc. of IEEE Int. Conf. on Systems, Man and Cybernetics, Istanbul, Turkey, 10-13, October, pp. 2487–2491, 2010.

[33] M. P. Kushwaha and R. R. Welekar, “Feature Selection for Image Retrieval based on Genetic Algorithm,” Int. J. of Interactive Multimedia and Artificial Intelligence, vol. 4, pp. 16–21, 2016.

[34] J. Annrose and C. S. Christopher, “An efficient image retrieval system with structured query based feature selection and filtering initial level relevant images using range query,” Optik, vol. 157, pp. 1053–1064, 2018.

[35] J. D. Pujari, R. Yakkundimath, and A. S. Byadgi, “SVM and ANN Based Classification of Plant Diseases Using Feature Reduction Technique,” Int. J. of Interactive Multimedia and Artificial Intelligence, vol. 3, pp. 6–14, 2016.

[36] S. Ding and X. Xu, “Extreme learning machine: algorithm, theory and applications,” Neural comuting and Applications, vol. 25, no. (3-4), pp. 1-11, June, 2013.

[37] A. Suliman and B. S. Omarov, “Applying Bayesian Regularization for Acceleration of Levenberg-Marquardt based Neural Network Training,” Int. J. of Interactive Multimedia and Artificial Intelligence, vol. 5, no. 1, pp. 68-72, 2018.

[38] S. Liu, H. Wang, J. Wu, and L. Feng, “Incorporate Extreme Learning Machine to content-based image retrieval with relevance feedback,” In Proc. of IEEE 11th World Congress on Intelligent Control and Automation, Shenyang, China, 29 june-4 july, pp. 1010-1013, March 2015.

[39] G. Liu, “Content-Based Image Retrieval Based On Visual Attention And The Conditional Probability,” In proc. of Int. Conf. on Chemical, Material and Food Engg., pp. 838–842, 2015.

[40] S. Bhardwaj, G. Pandove, and P. K. Dahiya, “An Intelligent Multiresolution and Co-occuring local pattern generator for Image Retrieval,” EAI Endorsed Transactions on Scalable Information Systems, vol. 4, no. 1, e1, pp. 1–12, 2019.