|
|
论文:2023,Vol:41,Issue(2):419-427 |
|
|
引用本文： |
|
|
贾柳娜, 董绵绵, 贺楚超, 邸若海, 李晓艳. 一种优化节点序搜索算子的BN结构学习方法[J]. 西北工业大学学报 |
|
|
JIA Liuna, DONG Mianmian, HE Chuchao, DI Ruohai, LI Xiaoyan. A Bayesian network structure learning method for optimizing ordering search operator[J]. Journal of Northwestern Polytechnical University |
|
|
|
|
|
|
|
| 一种优化节点序搜索算子的BN结构学习方法 |
|
| 贾柳娜, 董绵绵, 贺楚超, 邸若海, 李晓艳 |
|
| 西安工业大学 电子信息工程学院, 陕西 西安 710021 |
| 摘要: |
| 节点序空间下的局部搜索算法是一种性能良好的贝叶斯网络结构学习方法,在学习效率上具有极大的优势。然而,现有的该类算法通常存在节点序优化不足、学习精度低等问题,并容易停止在一个局部最优。为解决这些问题,对节点序空间下的局部搜索算法进行了研究,提出了一种新的通过优化节点序搜索算子来提高贝叶斯网络结构学习精度的IWINOBS算法。将迭代局部搜索算法与窗口算子相结合来搜索节点序空间中给定节点序的邻域,减小了算法陷入局部最优值的概率,从而获得质量更高的网络结构。实验结果表明:与网络结构空间下的贝叶斯网络结构学习算法相比,所提算法的学习效率提升了54.12％;与现有节点序空间下的贝叶斯网络结构学习算法相比,所提算法的学习精度提高了2.33％。 |
| 关键词:
贝叶斯网络
结构学习
节点序优化
搜索算子
局部搜索
|
|
| A Bayesian network structure learning method for optimizing ordering search operator |
|
| JIA Liuna, DONG Mianmian, HE Chuchao, DI Ruohai, LI Xiaoyan |
|
| School of Electronic Information Engineering, Xi'an Technological University, Xi'an 710021, China |
| Abstract: |
| Local search algorithm in ordering space is a good method which can effectively improve the efficiency of bayesian network structure learning. However, the existing algorithms usually have problems such as insufficient order optimization, low learning accuracy, and easy stop at a local optimal. In order to solve these problems, the local search algorithm in ordering space is studied, and a new method to improve the accuracy of bayesian network structure learning by optimizing order search operator is proposed. Combining the iterative local search algorithm with the window operator to search the neighborhood of a given order in the ordering space, the probability of the algorithm falling into the local optimal value is reduced, and the network structure with higher quality is obtained. Experimental results show that comparing with the bayesian network structure learning algorithm in network structure space, the learning efficiency of the present algorithm is improved by 54.12％. Comparing with the bayesian network structure learning algorithm in ordering space, the learning accuracy of the present algorithm is improved by 2.33％. |
| Key words:
Bayesian network
structure learning
order optimization
search operator
local search
|
|
| 收稿日期: 2022-06-23
修回日期:
|
| DOI: 10.1051/jnwpu/20234120419 |
| 基金项目: 陕西省自然科学基础研究计划(2022JQ-590)资助 |
| 通讯作者: 董绵绵(1981-),西安工业大学副教授,主要从事无线通信与信息处理研究。e-mail:dong_mm@aliyun.com
Email：dong_mm@aliyun.com |
| 作者简介: 贾柳娜(1997-),西安工业大学硕士研究生,主要从事机器学习及贝叶斯网络结构学习研究。
|
|
|
|
|
|
|
|
参考文献: |
|
|
[1] 张连文, 郭海鹏. 贝叶斯网引论[M]. 北京:科学出版社, 2006 ZHANG Lianwen, GUO Haipeng. Introduction to Bayesian nets[M]. Beijing:Science Press, 2006 (in Chinese)
[2] CAI B, KONG X, LIU Y, et al. Application of Bayesian networks in reliability evaluation[J]. IEEE Trans on Industrial Informatics, 2018, 15(4):2146-2157
[3] SCUTARI M, GRAAFLAND C E, GUTIÉRREZ J M. Who learns better Bayesian network structures:constraint-based, score-based or hybrid algorithms[J]. Procedings of Machine Learning Research, 2018, 72:416-427
[4] LYU Y, MIAO J, LIANG J, et al. BIC-based node order learning for improving Bayesian network structure learning[J]. Frontiers of Computer Science, 2021, 15(6):1-14
[5] KALTENPOTH D, VREEKEN J. We are not your real parents:telling causal from confounded using mdl[C]//Proceedings of the 2019 SIAM International Conference on Data Mining, 2019:199-207
[6] SCUTARI M. Dirichlet Bayesian network scores and the maximum relative entropy principle[J]. Behaviormetrika, 2018, 45(2):337-362
[7] SCUTARI M, VITOLO C, TUCKER A. Learning Bayesian networks from big data with greedy search:computational complexity and efficient implementation[J]. Statistics and Computing, 2019, 29(5):1095-1108
[8] TEYSSIER M, KOLLER D. Ordering-based search:a simple and effective algorithm for learning bayesian networks[C]//Conference on Uncertainty in Artificial Intelligence, 2005:584-590
[9] BEHJATI S, BEIGY H. Improved K2 algorithm for Bayesian network structure learning[J]. Engineering Applications of Artificial Intelligence, 2020, 91:103617
[10] WANG Y. Analysis of the max-min hill-climbing algorithm[C]//2018 International Conference on Transportation & Logistics, Information & Communication, Smart City, 2018:509-511
[11] LIU X, GAO X, WANG Z, et al. Improved local search with momentum for Bayesian networks structure learning[J]. Entropy, 2021, 23(6):750
[12] HE C, GAO X, GUO Z. Structure learning of Bayesian networks by finding the optimal ordering[C]//2018 24th International Conference on Pattern Recognition, 2018:177-182
[13] WANG Z, GAO X, TAN X, et al. Determining the direction of the local search in topological ordering space for Bayesian network structure learning[J]. Knowledge-Based Systems, 2021, 234:107566
[14] LEE C, BEEK P. Metaheuristics for score-and-search Bayesian network structure learning[C]//Canadian Conference on Artificial Intelligence, 2017:129-141
[15] ALONSO-BARBA J I, DELAOSSA L, PUERTA J M. Structural learning of Bayesian networks using local algorithms based on the space of orderings[J]. Soft Computing, 2011, 15(10):1881-1895
[16] SCANAGATTA M, CORANI G, ZAFFALON M. Improved local search in Bayesian networks structure learning[J]. Procedings of Machine Learning Research, 2017, 73:45-56
[17] JIANG M, LU J. The analysis of maritime piracy occurred in Southeast Asia by using Bayesian network[J]. Transportation Research Part E:Logistics and Transportation Review, 2020, 139:101965
[18] Bayesian network software.[CP/OL]. (2008-03-17)[2022-06-23]. http://www.bayesia.com
[19] BEINLICH I A, SUERMONDT H J, CHAVEZ R M, et al. The ALARM monitoring system:a case study with two probabilistic inference techniques for belief networks[C]//Second European Conference on Artificial Intelligence in Medicine, London, 1989 |
|
|
|
|
|
|
|
