|
|
论文:2021,Vol:39,Issue(6):1356-1367 |
|
|
引用本文： |
|
|
邸若海, 李叶, 万开方, 吕志刚, 王鹏. 基于改进QMAP的贝叶斯网络参数学习算法[J]. 西北工业大学学报 |
|
|
DI Ruohai, LI Ye, WAN Kaifang, LYU Zhigang, WANG Peng. Bayesian network parameter learning algorithm based on improved QMAP[J]. Northwestern polytechnical university |
|
|
|
|
|
|
|
| 基于改进QMAP的贝叶斯网络参数学习算法 |
|
| 邸若海1, 李叶1, 万开方2, 吕志刚1, 王鹏1 |
|
1. 西安工业大学 电子信息工程学院, 陕西 西安 710021;
2. 西北工业大学 电子信息学院, 陕西 西安 710072 |
| 摘要: |
| 小数据集使得贝叶斯网络参数学习中的统计信息不准确，导致只依靠数据难以得到准确的贝叶斯网络参数。定性最大后验估计（QMAP）方法是目前小数据集条件下贝叶斯网络参数学习精度最高的算法。然而，当参数约束数量较多或参数可行域较小时，QMAP算法中的拒绝-接受采样过程会变得极为耗时甚至难以完成。为了提高QMAP算法的学习效率同时又尽量不影响其学习精度，设计了一种约束区域中心点的解析计算方法来替代原有的拒绝-接受采样计算方法。结合参数约束构建一个求解约束区域边界点的目标优化模型；利用凸优化引擎来求解该目标优化模型，获得约束区域的边界点和中心点；通过获得的约束区域中心点改进现有的QMAP算法。仿真实验证明，所提出的CMAP算法的参数学习精度稍差于QMAP算法，但计算效率比QMAP算法提高了2~5倍。 |
| 关键词:
贝叶斯网络
参数学习
定性最大后验估计
参数约束
目标优化
|
|
| Bayesian network parameter learning algorithm based on improved QMAP |
|
| DI Ruohai1, LI Ye1, WAN Kaifang2, LYU Zhigang1, WANG Peng1 |
|
1. School of Electronic and Information Engineering, Xi'an Technological University, Xi'an 710021, China;
2. School of Electronic and Information, Northwestern Polytechnical University, Xi'an 710072, China |
| Abstract: |
| Small data sets make the statistical information in Bayesian network parameter learning inaccurate, which makes it difficult to get accurate Bayesian network parameters based on data. Qualitative maximum a posteriori estimation (QMAP) is the most accurate algorithm for Bayesian network parameter learning under the condition of small data sets. However, when the number of parameter constraints is large or the parameter feasible region is small, the rejection-acceptance sampling process in QMAP algorithm will become extremely time-consuming. In order to improve the learning efficiency of QMAP algorithm and not affect its learning accuracy as much as possible, a new analytical calculation method of the center point of constrained region is designed to replace the original rejection-acceptance sampling calculation method. Firstly, a new objective function is designed, and a constrained objective optimization problem for solving the boundary points of the constrained region is constructed. Secondly, a new optimization engine is used to solve the objective optimization problem, and the boundary points and center points of the constrained region are obtained. Finally, the existing QMAP algorithm is improved by the obtained center points. The simulation results show that the CMAP algorithm proposed in this paper has a slightly worse parameter learning accuracy than the QMAP algorithm, but its computational efficiency is 2-5 times higher than that of the QMAP algorithm. |
| Key words:
Bayesian network
parameter learning
qualitative maximum a posteriori estimation
parameter constraints
objective optimization
|
|
| 收稿日期: 2021-04-14
修回日期:
|
| DOI: 10.1051/jnwpu/20213961356 |
| 基金项目: 国家自然科学基金面上项目（62171360）、电子信息系统复杂电磁环境效应国家重点实验室基金（CEMEE2020Z0202B）、陕西省自然科学基础研究计划（2020JQ-816）、陕西省教育厅专项科研计划项目（20JK0680）与西安市科技计划项目（2020KJRC0033）资助 |
| 通讯作者: 王鹏(1978-),西安工业大学教授,主要从事复杂系统建模、图像处理研究。e-mail:wp_xatu@163.com
Email：wp_xatu@163.com |
| 作者简介: 邸若海(1986-),西安工业大学讲师,主要从事复杂系统建模、贝叶斯网络学习研究。
|
|
| 相关功能 |
|
|
|
|
| 作者相关文章 |
|
| 邸若海 在本刊中的所有文章 |
| 李叶 在本刊中的所有文章 |
| 万开方 在本刊中的所有文章 |
| 吕志刚 在本刊中的所有文章 |
| 王鹏 在本刊中的所有文章 |
|
|
|
|
|
|
|
|
参考文献: |
|
|
[1] WITTIG F, JAMESON A. Exploiting qualitative knowledge in the learning of conditional probabilities of Bayesian networks[C]//Proceedings of the Sixteenth International Conference on Uncertainty in Artificial Intelligence, California, 2000
[2] FEELDERS A, GAAG L. Learning Bayesian network parameters under order constraints[J]. International Journal of Approximate Reasoning, 2006, 42(1/2):37-53
[3] MASEGOSA A R, FEELDERS A J, GAAG L C V D. Learning from incomplete data in Bayesian networks with qualitative influences[J]. International Journal of Approximate Reasoning, 2016, 69:18-34
[4] MARTIN Plajner, JIRÍVomlel. Learning bipartite Bayesian networks under monotonicity restrictions[J]. International Journal of General Systems, 2020, 49(1):88-111
[5] ZHOU Y, FENTON N, ZHU C. An empirical study of Bayesian network parameter learning with monotonic influence constraints[J]. Decision Support Systems, 2016, 87:69-79
[6] 邸若海, 高晓光, 郭志高. 基于单调性约束的离散贝叶斯网络参数学习[J]. 系统工程与电子技术,2014,18(5):272-277 DI Ruohai, GAO Xiaoguang, GUO Zhigao. Parameter learning of discrete Bayesian networks based on monotonicity constraints[J]. Systems Engineering and Electronics, 2014, 18(5):272-277(in Chinese)
[7] DI Ruohai, GAO Xiaoguang, GUO Zhigao. Learning Bayesian networks parameters under new monotonic constraints[J]. Journal of Systems Engineering and Electronics, 2017, 28(6):1248-1255
[8] 任佳, 高晓光, 白勇. 信息不完备小样本条件下离散DBN参数学习[J]. 系统工程与电子技术, 2012, 34(8):1723-1728 REN Jia, GAO Xiaoguang, BAI Yong. Discrete DBN parameter learning under the condition of incomplete information with small samples[J]. Systems Engineering and Electronics, 2012, 34(8):1723-1728(in Chinese)
[9] 曾强, 黄政, 魏曙寰. 融合专家先验知识和单调性约束的贝叶斯网络参数学习方法[J]. 系统工程与电子技术, 2020, 42(3):642-656 ZENG Qiang, HUANG Zheng, WEI Shuhuan. Bayesian network parameter learning method based on expert prior knowledge and monotonicity constraint[J]. Systems Engineering and Electronics, 2020, 42(3):642-656(in Chinese)
[10] NICULESCU R, MITCHELL T, RAO B. Bayesian network learning with parameter constraints[J]. Journal of Machine Learning Research, 2006, 7(1):1357-1383
[11] CAMPOS C, JI Q. Improving Bayesian network parameter learning using constraints[C]//Proceedings of the Nineteenth International Conference on Pattern Recognition in Florida, 2008
[12] LIAO Wenhui, JI Qiang. Learning Bayesian network parameters under incomplete data with domain knowledge[J]. Pattern Recognition, 2009, 42(11):3046-3056
[13] ZHOU Y, FENTON F, NEIL M. Bayesian network approach to multinomial parameter learning using data and expert judgments[J]. International Journal of Approximate Reasoning, 2014, 55(5):1252-1268
[14] ZHOU Y, FENTON N, HOSPADALES T, et al. Probabilistic graphical models parameter learning with transferred prior and constraints[C]//Proceedings of the Thirty First International Conference on Uncertainty in Artificial Intelligence, 2015
[15] 郭志高, 高晓光, 邸若海. 小数据集条件下基于双重约束的BN参数学习[J]. 自动化学报, 2014, 40(7):1509-1516 GUO Zhigao, GAO Xiaoguang, DI Ruohai. BN parameter learning based on double constraints under the condition of small dataset[J]. Acta Automatica Sinica, 2014, 40(7):1509-1516(in Chinese)
[16] RUI Chang, Shoemaker R, WEI Wang. A novel knowledge-driven systems biology approach for phenotype prediction upon genetic intervention[J]. IEEE/ACM Transactions on Computational Bioinformatics,2011, 3(8):683-697
[17] GUO Z G, GAO X G, REN H, et al. Learning Bayesian network parameters from small data sets:a further constrained qualitatively maximum a posteriori method[J]. International Journal of Approximate Reasoning, 2017, 91(12):22-35
[18] HECKERMAN D, WELLMAN M P. Bayesian networks[J]. Communications of ACM, 1995, 38(3):27-30 |
|
|
|
|
|
|
|
