Automatic Finding Trapezoidal Membership Functions in Mining Fuzzy Association Rules Based on Learning Automata.
DOI:
https://doi.org/10.9781/ijimai.2022.01.001Keywords:
Continuous Action-set Learning Automata (CALA), Data Mining, Fuzzy Rule Base, Fuzzy, Fuzzy Association Rules, Learning AutomataAbstract
Association rule mining is an important data mining technique used for discovering relationships among all data items. Membership functions have a significant impact on the outcome of the mining association rules. An important challenge in fuzzy association rule mining is finding an appropriate membership functions, which is an optimization issue. In the most relevant studies of fuzzy association rule mining, only triangle membership functions are considered. This study, as the first attempt, used a team of continuous action-set learning automata (CALA) to find both the appropriate number and positions of trapezoidal membership functions (TMFs). The spreads and centers of the TMFs were taken into account as parameters for the research space and a new approach for the establishment of a CALA team to optimize these parameters was introduced. Additionally, to increase the convergence speed of the proposed approach and remove bad shapes of membership functions, a new heuristic approach has been proposed. Experiments on two real data sets showed that the proposed algorithm improves the efficiency of the extracted rules by finding optimized membership functions.
Downloads
References
U. Fayyad, G. Piatetsky-Shapiro, and P. Smyth, “From data mining to knowledge discovery in databases,” AI Magazine, vol. 17, no. 3, pp. 37-37, 1996.
M.-S. Chen, J. Han, and P. S. Yu, “Data mining: an overview from a database perspective,” IEEE Transactions on Knowledge and data Engineering, vol. 8, no. 6, pp. 866-883, 1996.
K. Wagstaff, C. Cardie, S. Rogers, and S. Schrödl, “Constrained k-means clustering with background knowledge,” in Proceedings of the 8th International Conference on Machine Learning, 2001, vol. 1, pp. 577-584.
C.-C. Chang and C.-J. Lin, “LIBSVM: A library for support vector machines,” ACM transactions on intelligent systems and technology (TIST), vol. 2, no. 3, p. 27, 2011.
T. Hastie, R. Tibshirani, J. Friedman, and J. Franklin, “The elements of statistical learning: data mining, inference and prediction,” The Mathematical Intelligencer, vol. 27, no. 2, pp. 83-85, 2005.
C. C. Aggarwal and C. Zhai, Mining text data, New York, NY: Springer, 2012.
T.-P. Hong, C.-H. Chen, Y.-C. Lee, and Y.-L. Wu, “Genetic-fuzzy data mining with divide-and-conquer strategy,” IEEE Transactions on Evolutionary Computation, vol. 12, no. 2, pp. 252-265, 2008.
G. Sumathi and J. Akilandeswari, “Improved fuzzy weighted‐iterative association rule-based ontology postprocessing in data mining for query recommendation applications,” Computational Intelligence, vol. 36, no. 2, pp. 773-782, 2020.
C. H. Cheng and C. H. Chen, “Fuzzy time series model based on weighted association rule for financial market forecasting,” Expert Systems, vol. 35, no. 4, p. e12271, 2018.
F. Chiclana, R. Kumar, M. Mittal, M. Khari, J. M. Chatterjee, and S. W. Baik, “ARM–AMO: an efficient association rule mining algorithm based on animal migration optimization,” Knowledge-Based Systems, vol. 154, pp. 68-80, 2018.
R. Agrawal, H. Mannila, R. Srikant, H. Toivonen, and A. I. Verkamo, “Fast discovery of association rules,” Advances in knowledge discovery and data mining, vol. 12, no. 1, pp. 307-328, 1996.
R. Agrawal, T. Imieliński, and A. Swami, “Mining association rules between sets of items in large databases,” in Proceedings of the 1993 ACM SIGMOD international conference on Management of data (SIGMOD’98), New York: ACM Press, 1993, pp. 207-216.
R. Agrawal, “Fast Algorithm for Mining Association Rules in Large Databases,” in Proceedings of International Conference on Very Large Databases (VLDB ‘94), Santiago, Chile,1994, pp.487-499.
J. Chen, A. Mikulcic, and D. H. Kraft, An integrated approach to information retrieval with fuzzy clustering and fuzzy inferencing, in Knowledge Management in Fuzzy Databases (pp. 247-260), Heidelberg, Germany: Physica-Verlag, 2000.
H. Ishibuchi, T. Nakashima, and M. Nii, Classification and modeling with linguistic information granules: Advanced approaches to linguistic Data Mining, Springer Science & Business Media, Berlin, Germany: Springer-Verlag, 2004.
W. Siler and J. J. Buckley, Fuzzy expert systems and fuzzy reasoning. John Wiley & Sons, Hoboken, NJ, USA, p. 424.
H. Zhang and D. Liu, Fuzzy modeling and fuzzy control, Boston, MA, USA: Birkhauser, 2006.
A. Kandel, Fuzzy expert systems, Boca Raton, Florida, USA: CRC Press, 1991.
L. A. Zadeh, “Fuzzy sets,” Information and control, vol. 8, no. 3, pp. 338- 353, 1965.
K. C. Chan and W.-H. Au, “Mining fuzzy association rules,” in Proceedings of the sixth international conference on Information and knowledge management, Las Vegas, NV, 1997, pp. 209-215.
J. S. Yue, E. Tsang, D. Yeung, and D. Shi, “Mining fuzzy association rules with weighted items,” in proceedings of the ieee international conference on systems, man and cybernetics, Nashville, TN, 2000, pp. 1906-1911.
C. M. Kuok, A. Fu, and M. H. Wong, “Mining fuzzy association rules in databases,” ACM Sigmod Record, vol. 27, no. 1, pp. 41-46, 1998.
N. Marín, M. D. Ruiz, and D. Sánchez, “Fuzzy frameworks for mining data associations: fuzzy association rules and beyond,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. 6, no. 2, pp. 50-69, 2016.
R. Pierrard, J.-P. Poli, and C. Hudelot, “A Fuzzy Close Algorithm for Mining Fuzzy Association Rules,” in International Conference on Information Processing and Management of Uncertainty in KnowledgeBased Systems, Springer, Cham, 2018, pp. 88-99.
C. Molina, M. D. Ruiz, and J. M. Serrano, “Representation by levels: An alternative to fuzzy sets for fuzzy data mining,” Fuzzy Sets and Systems, vol. 401, pp. 113-132, 2019.
E. Cuevas, J. Gálvez, and O. Avalos, Fuzzy Logic Based Optimization Algorithm, in Recent Metaheuristics Algorithms for Parameter Identification, pp. 135-181, Springer, Cham, 2020.
S. G. Matthews, M. A. Gongora, A. A. Hopgood, and S. Ahmadi, “Web usage mining with evolutionary extraction of temporal fuzzy association rules,” Knowledge-Based Systems, vol. 54, pp. 66-72, 2013.
R. Wu, “Mining generalized fuzzy association rules from Web logs,” in 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery, 2010, vol. 5, pp. 2474-2477: IEEE.
T.-P. Hong, C.-M. Huang, and S.-J. Horng, “Linguistic object-oriented web-usage mining,” International Journal of Approximate Reasoning, vol. 48, no. 1, pp. 47-61, 2008.
C. Chai and B. Li, “A novel association rules method based on genetic algorithm and fuzzy set strategy for web mining,” Journal of Computers, vol. 5, no. 9, pp. 1448-1455, 2010.
Y.-H. Tao, T.-P. Hong, W.-Y. Lin, and W.-Y. Chiu, “A practical extension of web usage mining with intentional browsing data toward usage,” Expert Systems with Applications, vol. 36, no. 2, pp. 3937-3945, 2009.
C.-H. Chen, G.-C. Lan, T.-P. Hong, and S.-B. Lin, “Mining fuzzy temporal association rules by item lifespans,” Applied Soft Computing, vol. 41, pp. 265-274, 2016.
C.-K. Ting, T.-C. Wang, R.-T. Liaw, and T.-P. Hong, “Genetic algorithm with a structure-based representation for genetic-fuzzy data mining,” Soft Computing, vol. 21, no. 11, pp. 2871-2882, 2017.
T.-P. Hong, Y.-C. Lee, and M.-T. Wu, “An effective parallel approach for genetic-fuzzy data mining,” Expert Systems with Applications, vol. 41, no. 2, pp. 655-662, 2014.
J. C.-W. Lin, T. Li, P. Fournier-Viger, T.-P. Hong, J. M.-T. Wu, and J. Zhan, “Efficient mining of multiple fuzzy frequent itemsets,” International Journal of Fuzzy Systems, vol. 19, no. 4, pp. 1032-1040, 2017.
G. Santharam, P. Sastry, and M. Thathachar, “Continuous action set learning automata for stochastic optimization,” Journal of the Franklin Institute, vol. 331, no. 5, pp. 607-628, 1994.
H. Beigy and M. Meybodi, “A new continuous action-set learning automaton for function optimization,” Journal of the Franklin Institute, vol. 343, no. 1, pp. 27-47, 2006.
K. S. Narendra and M. A. Thathachar, Learning automata: an introduction, Prentice-Hall, Englewood Cliffs, NJ: Prentice Hall, 1989.
M. A. Thathachar and P. S. Sastry, Networks of learning automata: Techniques for online stochastic optimization, Dordrecht, The Netherlands: Kluwer, 2004.
S. Sanyal, M. Bansal, S. Banerjee, and P. Kalra, “On learning shapes from shades,” in Proceedings of 4th Indian Conference on Computer Vision Graphics and Image Processing, Calcutta, India, 2004, pp. 275–282.
H. Beigy and M. R. Meybodi, “An adaptive call admission algorithm for cellular networks,” Computers & Electrical Engineering, vol. 31, no. 2, pp. 132-151, 2005.
B. Anari, J. A. Torkestani, and A. M. Rahmani, “Automatic data clustering using continuous action-set learning automata and its application in segmentation of images,” Applied Soft Computing, vol. 51, pp. 253-265, 2017.
T.-P. Hong, M.-J. Chiang, and S.-L. Wang, “Mining weighted browsing patterns with linguistic minimum supports,” in IEEE International Conference on Systems, Man and Cybernetics, 2002, Yasmine Hammamet, Tunisia, pp. 635-639.
T.-P. Hong, M.-J. Chiang, and S.-L. Wang, “Mining fuzzy weighted browsing patterns from time duration and with linguistic thresholds,” American Journal of Applied Sciences, vol. 5, no. 12, pp. 1611, 2008.
R. Wu, W. Tang, and R. Zhao, “Web mining of preferred traversal patterns in fuzzy environments,” Springer-Verlag, Berlin Heidelberg Lecture Notes in Artificial Intelligence, vol. 3642, 2005, pp. 456-465.
S.-L. Wang, W.-S. Lo, and T.-P. Hong, “Discovery of fuzzy multiple-level Web browsing patterns,” in Proceedings of the international conference on fuzzy systems and knowledge discovery: Springer, Singapore, 2005, pp. 251-266.
W.-S. Lo, T.-P. Hong, and S.-L. Wang, “A top-down fuzzy cross-level Web-mining approach,” in: The 2003 IEEE International Conference on Systems, Man and Cybernetics, 2003, vol. 3, pp. 2684-2689.
T.-P. Hong, K.-Y. Lin, and B.-C. Chien, “Mining fuzzy multiple-level association rules from quantitative data,” Applied Intelligence, vol. 18, no. 1, pp. 79-90, 2003.
T.-P. Hong, C.-H. Chen, Y.-L. Wu, and Y.-C. Lee, “A GA-based fuzzy mining approach to achieve a trade-off between number of rules and suitability of membership functions,” Soft Computing, vol. 10, no. 11, pp. 1091-1101, 2006.
C.-H. Chen, V. S. Tseng, and T.-P. Hong, “Cluster-based evaluation in fuzzy-genetic data mining,” IEEE transactions on fuzzy systems, vol. 16, no. 1, pp. 249-262, 2008.
C.-H. Chen, Y. Li, and T.-P. Hong, “Type-2 genetic-fuzzy mining with tuning mechanism,” in 2015 Conference on Technologies and Applications of Artificial Intelligence (TAAI), 2015, pp. 296-299: IEEE.
J. Alcalá-Fdez, R. Alcalá, M. J. Gacto, and F. Herrera, “Learning the membership function contexts for mining fuzzy association rules by using genetic algorithms,” Fuzzy Sets and Systems, vol. 160, no. 7, pp. 905-921, 2009.
W. Wang and S. Bridges, “Genetic algorithm optimization of membership functions for mining fuzzy association rules,” in: International Joint Conference on information Systems, Fuzzy Theory and Technology Conference, Atlantic City, NY, 2000, pp. 1–4.
C.-H. Chen, Y. Li, T.-P. Hong, Y.-K. Li, and E. H.-C. Lu, “A GA-based approach for mining membership functions and concept-drift patterns,” in 2015 IEEE Congress on Evolutionary Computation (CEC), 2015, pp. 2961- 2965: IEEE.
C.-H. Chen, T.-P. Hong, Y.-C. Lee, and V. S. Tseng, “Finding active membership functions for genetic-fuzzy data mining,” International Journal of Information Technology & Decision Making, vol. 14, no. 06, pp. 1215-1242, 2015.
A. M. Palacios, J. L. Palacios, L. Sánchez, and J. Alcalá-Fdez, “Genetic learning of the membership functions for mining fuzzy association rules from low quality data,” Information Sciences, vol. 295, pp. 358-378, 2015.
M. Kaya and R. Alhajj, “Genetic algorithms-based optimization of membership functions for fuzzy weighted association rules mining,” in Proceedings of International Conference Symposium on Computers and Communications ISCC, 2004, vol. 1, pp. 110-115.
T.-P. Hong, Y.-F. Tung, S.-L. Wang, M.-T. Wu, and Y.-L. Wu, “An ACS-based framework for fuzzy data mining,” Expert Systems with Applications, vol. 36, no. 9, pp. 11844-11852, 2009.
M.-T. Wu, T.-P. Hong, and C.-N. Lee, “A continuous ant colony system framework for fuzzy data mining,” Soft Computing, vol. 16, no. 12, pp. 2071-2082, 2012.
C.-K. Ting, R.-T. Liaw, T.-C. Wang, and T.-P. Hong, “Mining fuzzy association rules using a memetic algorithm based on structure representation,” Memetic Computing, vol. 10, no. 1, pp. 15-28, 2018.
J. Botzheim, C. Cabrita, L. T. Kóczy, and A. Ruano, “Fuzzy rule extraction by bacterial memetic algorithms,” International Journal of Intelligent Systems, vol. 24, no. 3, pp. 312-339, 2009.
A. Song, J. Song, X. Ding, G. Xu, and J. Chen, “Utilizing bat algorithm to optimize membership functions for fuzzy association rules mining,” in International Conference on Database and Expert Systems Applications, 2017, pp. 496-504.
M. A. Chamazi and H. Motameni, “Finding suitable membership functions for fuzzy temporal mining problems using fuzzy temporal bees’ method,” Soft Computing, vol. 23, no. 10, pp. 3501-3518, 2019.
F. Alikhademi and S. Zainudin, “Generating of derivative membership functions for fuzzy association rule mining by Particle Swarm Optimization,” in 2014 International Conference on Computational Science and Technology (ICCST), 2014, pp. 1-6.
F. Rudziński, “A multi-objective genetic optimization of interpretabilityoriented fuzzy rule-based classifiers,” Applied Soft Computing, vol. 38, pp. 118-133, 2016.
B. Minaei-Bidgoli, R. Barmaki, and M. Nasiri, “Mining numerical association rules via multi-objective genetic algorithms,” Information Sciences, vol. 233, pp. 15-24, 2013.
H. R. Qodmanan, M. Nasiri, and B. Minaei-Bidgoli, “Multi objective association rule mining with genetic algorithm without specifying minimum support and minimum confidence,” Expert Systems with applications, vol. 38, no. 1, pp. 288-298, 2011.
U. M. Patil and J. Patil, “Mining fuzzy association rules from web usage quantitative data,” Computer Science & Information Technology, vol. 89, 2016.
M. Ghavipour and M. R. Meybodi, “An adaptive fuzzy recommender system based on learning automata,” Electronic Commerce Research and Applications, vol. 20, pp. 105-115, 2016.
M. A. Thathachar and P. S. Sastry, “Varieties of learning automata: an overview,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 32, no. 6, pp. 711-722, 2002.
K. S. Narendra and M. A. Thathachar, “On the behavior of a learning automaton in a changing environment with application to telephone traffic routing,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 10, no. 5, pp. 262-269, 1980.
N. Kumar, J.-H. Lee, and J. J. Rodrigues, “Intelligent mobile video surveillance system as a Bayesian coalition game in vehicular sensor networks: Learning automata approach,” IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 3, pp. 1148-1161, 2014.
A. Helmzadeh and S. M. Kouhsari, “Calibration of erroneous branch parameters utilising learning automata theory,” IET Generation, Transmission & Distribution, vol. 10, no. 13, pp. 3142-3151, 2016.
B. Anari, J. Akbari Torkestani, and A. M. Rahmani, “A learning automata‐ based clustering algorithm using ant swarm intelligence,” Expert systems, vol. 35, no. 6, p. e12310, 2018.
Downloads
Published
-
Abstract213
-
PDF33
Submit Article
Information
