Falcon Optimization Algorithm for Bayesian Networks Structure Learning

Shahab Wahhab Kareem; Mehmet Cudi Okur

doi:10.7494/csci.2021.22.4.3773

Authors

Shahab Wahhab Kareem Erbil Polytechnic University https://orcid.org/0000-0002-7362-4653
Mehmet Cudi Okur Yasar University https://orcid.org/0000-0002-0096-9087

DOI:

https://doi.org/10.7494/csci.2021.22.4.3773

Keywords:

Bayesian Network, Global Search, Falcon Optimization algorithm, Structure Learning, Search and Score.

Abstract

In machine-learning, one of the useful scientific models for producing the structure of knowledge is Bayesian network, which can draw probabilistic dependency relationships between variables. The score and search is a method used for learning the structure of a Bayesian network. The authors apply the Falcon Optimization Algorithm (FOA) as a new approach to learning the structure of Bayesian networks. This paper uses the Reversing, Deleting, Moving and Inserting operations to adopt the FOA for approaching the optimal solution of Bayesian network structure. Essentially, the falcon prey search strategy is used in the FOA algorithm. The result of the proposed technique is compared with Pigeon Inspired optimization, Greedy Search, and Simulated Annealing using the BDeu score function. The authors have also examined the performances of the confusion matrix of these techniques utilizing several benchmark data sets. As shown by the evaluations, the proposed method has more reliable performance than the other algorithms including producing better scores and accuracy values.

Downloads

Download data is not yet available.

Author Biography

Shahab Wahhab Kareem, Erbil Polytechnic University

Receive a BSc in Control and Computer Engineering from the University of Technology Baghdad in 2001. In 2002 He was hired as Engineer Computer System Department in Technical Institute. In 2009 He Received His MSc in Software Engineering Department from Salahadeen University. He's a Ph.D. in the Computer Engineering Department, Faculty of Engineering from Yaşar University, Izmir Turkey 2020. He starts lecturer at Information System Engineering, Erbil technical Engineering College, Erbil Polytechnic University at 2011 till now.

References

Junzhong Ji, Hongkai Wei , Chunnian Liu, "An artificial bee colony algorithm for learning Bayesian networks," Springer-Verlag Berlin Heidelberg, 2012.

Nathan Fortier, John Sheppard and Karthik Ganesan Pillai, "Abductive Inference using Overlapping Swarm Intelligence," in IEEE Symposium on Swarm Intelligence, 2013.

Junyi Li and Jingyu Chen, "A Hybrid Optimization Algorithm for Bayesian Network Structure Learning Based on Database," Journal of Computers, VOL. 9, 2014.

D. Margaritis, "Learning Bayesian Network Model Structure from Data," Carnegie-Mellon University, Pittsburgh, PA. Available as Technical Report CMU-, 2003.

A. S. Fast, LEARNING THE STRUCTURE OF BAYESIAN NETWORKS WITH CONSTRAINT SATISFACTION, Massachusetts: PHD Thesis , Department of Computer Science,University of Massachusetts,February 2010, 2010.

G. F. Cooper and E. Herskovits, "A Bayesian method for the induction of probabilistic networks from data," in Machine Learning, 9, 1992.

J. Cowie, L. Oteniya, R. Coles , "Particle Swarm Optimisation for learning Bayesian Networks," Engineering and Physical Sciences Research Council., 2007.

Khalid M. Salama and Alex A. Freitas, "ABC-Miner: An Ant-Based Bayesian Classification Algorithm," 2012.

Chu-chao He and Xiao-guang Gao, "Structure Learning of Bayesian Networks Based On the LARS-MMPC Ordering Search Method," Wuhan,China, July 25-27, 2018.

Shun Li, and Biao Wang,, "A Method for Hybrid Bayesian Network Structure Learning from Massive Data Using MapReduce," 2017.

Shahab Kareem and Mehmet C. Okur, "Bayesian Network Structure Learning Using Hybrid Bee Optimization and Greedy Search," Adana / TURKEY, 2018.

A. S. Hesar, "Structure Learning of Bayesian Belief Networks Using Simulated Annealing Algorithm," Middle-East Journal of Scientific Research 18, pp. 1343-1348, 2013.

Cuicui Yang , Junzhong Ji , Jiming Liu , Jinduo Liu and Baocai Yin, "Structural learning of Bayesian networks by bacterial foraging optimization," International Journal of Approximate Reasoning, p. 69, 2016.

P. Larraiiaga , M. Poza, "Structure Learning of Bayesian Networks by Genetic Algorithms," Springer-Verlag Berlin Heidelberg GmbH, 1996.

Kalia Orphanou, Dirk Thierens, and Peter A. N. Bosman, "Learning Bayesian Network Structures with GOMEA," kyoto, Japan, 2018.

Ali Khanteymoori, Mohammad-H. Olyaee, Omid Abbaszadeh and Maryam Valian, "A novel method forBayesian networks structure learning based on Breeding Swarm algorithm," Soft Computing, no. 9, 9 2018.

JingyunWang, and SanyangLiu, "Novel binary encoding water cycle algorithm for solving Bayesian network structures learning problem," Knowledge-Based Systems, vol. 150, 2018.

Shahab Wahhab Kareem, Mehmet Cudi Okur, "Bayesian Network Structure Learning Based On Pigeon Inspired Optimization," International Journal of Advanced Trends in Computer Science and Engineering, vol. 8, no. 1.2, pp. 131-137, 2019.

Xiannian Fan, Changhe Yuan Brandon Malone, "Tightening Bounds for Bayesian Network Structure Learning," in Association for the Advancement of Artificial Intelligence, 2014.

ChangheYuan, Brandon Malonean and Xiaojian Wu, "Learning Optimal Bayesian Networks Using A* Search," in NSF grants IIS-0953723 and EPS-0903787, 21 IJCAI. , Barcelona , 2011.

Patrick O. Djan-Sampson and Ferat Sahin, "Structural Learning; of Bayesian Networks from Complete Data using the Scatter Search Documents," in IEEE International Conference on Systems, Man and Cybernetics, 2004.

Mahbobe Bani Asad Askari and Mostafa Ghazizadeh Ahsaee, "Bayesian network structure learning based on cuckoo search algorithm," in 2018 6th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS), Kerman, Iran, 2018.

Thibaud Rahier, Sylvain Marie, Stephane Girard, Florence Forbes, "Fast Bayesian Network Structure Learning using Quasi-Determinism Screening," HAL, vol. 2, pp. 14-24, 2019.

Safiye Sencer, Ercan Oztemel, Harun Taskin and Orhan Torkul, "Bayesian Structural Learning with Minimum Spanning Tree Algorithm," in The World Congress in Computer Science, Computer Engineering,and Applied Computing, 2013.

Shahab Wahhab Kareem, Mehmet Cudi Okur, "Pigeon Inspired Optimization of Bayesian Network Structure Learning and a Comparative Evaluation," Journal of Cognitive Science, Institute for Cognitive Science, Seoul National University, vol. 20, no. 4, pp. 535-552, 2019.

J. Cowie, L. Oteniya, R. Coles, "Particle Swarm Optimisation for learning Bayesian Networks," in Engineering and Physical Sciences Research Council, 2007.

Shao-Zhong Zhang, Lu Liu, "Mcmc Samples Selecting for Online Bayesian Network Structure Learning," Kunming,, 2008.

D. Heckerman, D. Geiger, and D. M. Chickering,, "Learning Bayesian networks: the combination of knowledge and statistical data," Machine Learning,, pp. 197-243, 1995.

Shahab Wahhab Kareem, Mehmet Cudi Okur, "Evaluation of Bayesian Network Structure Learning Using Elephant Swarm Water Search Algorithm," in Handbook of Research on Advancements of Swarm Intelligence Algorithms for Solving Real-World Problems, United States of America, IGI Global, 2020, pp. 139-159.

Thippa Reddy, G., & Khare, N., "FFBAT-optimized rule based fuzzy logic classifier for diabetes," International Journal of Engineering Research in Africa Trans Tech Publications, pp. 137-152, 2016.

Gadekallu, T. R., & Khare, N., "Cuckoo search optimized reduction and fuzzy logic classifier for heart disease and diabetes prediction," International Journal of Fuzzy System Applications (IJFSA), pp. 25-42, 2017.

Amir Hossein Gandomi, Xin-She Yang, Siamak Talatahari Marand, and Amir Hossein Alavi,, Metaheuristic applications in structures and infrastructures, USA: Elsevier, 2013.

Seyedali Mirjalili, Seyed Mohammad Mirjalili, Andrew Lewis, "A grey wolf optimizer," Advances in Engineering Software, vol. 69, pp. 46-61, 2014.

V. Tucker, "Gliding flight: drag and torque of a hawk and a falcon with straight and turned heads, and a lower value for the parasite drag coefficient," J. Exp. Biol. 203, p. 3733–3744., 2000.

V. Tucker, "Gliding flight: speed and acceleration of ideal falcons during diving and pull out," J. Exp. Biol. 201, p. 403–414., 1998.

Anders Hedenström, Mikael Rosén, Susanne Åkesson, And Fernando Spina, "Flight Performance During Hunting Excursions In Eleonora’s Falcon Falco Eleonorae," The Journal of Experimental Biology, p. 2029–2039, 1999.

D. Dekker, Hunting tactics of Peregrines and other falcons, Wageningen, The Netherlands : Wageningen University, 2009.

Emerson Hochsteiner de Vasconcelos Segundo, Viviana Cocco Mariani, Leandro dos Santos Coelho, "Design of heat exchangers using Falcon Optimization Algorithm," Applied Thermal Engineering, pp. 119-144, 2019.

R. Nagarajan, M. Scutari and S. Lèbre, Bayesian Networks in R with Applications in Systems Biology, New York: Springer, 2013.