|
|
论文:2020,Vol:38,Issue(6):1225-1234 |
|
|
引用本文： |
|
|
李常青, 谷建华. 一种用于跨数据库联接操作的分页预取模型[J]. 西北工业大学学报 |
|
|
LI Changqing, GU Jianhua. A Paged Prefetching Model for Join Operations of Cross-Databases[J]. Northwestern polytechnical university |
|
|
|
|
|
|
|
| 一种用于跨数据库联接操作的分页预取模型 |
|
| 李常青, 谷建华 |
|
| 西北工业大学 计算机学院, 陕西 西安 710072 |
| 摘要: |
| 随着大数据应用日益增多，NoSQL（not only structured query language）数据库管理系统得到了快速发展。如何对NoSQL数据库和关系型数据库进行有效集成成为研究热点之一。在现有研究成果中，在这些异构的多数据库之间进行联接（join）操作时，所采用的分页查询方法产生的延迟较大。针对这一问题，提出了一种分页预取的模型，并重点研究了其基本构成、预取方式以及运行机制。基于该模型，设计开发了原型系统，对其效果进行了验证，达到了预期目标。与无预取的分页查询方法相比，所建模型可以减少分页查询延迟，从而提升跨数据库联接操作的效率。 |
| 关键词:
大数据
NoSQL
SQL
数据库集成
跨数据库联接
分页预取模型
时延
分页查询
|
|
| A Paged Prefetching Model for Join Operations of Cross-Databases |
|
| LI Changqing, GU Jianhua |
|
| School of Computer Science and Engineering, Northwestern Polytechnical University, Xi'an 710072, China |
| Abstract: |
| As the applications of big data are increasing, the NoSQL (Not only Structured Query Language) database management systems have been developed rapidly. How to integrate NoSQL database and relational database effectively has become one of the research hotspots. In the existing research results, the paged query method used for join operations of these heterogeneous multi-databases can produce a large delay. In view of this deficiency, this paper presents a paged prefetching model, and focuses on its basic composition, prefetching mode and operation mechanism. A prototype system is designed and developed. The effect of this model is verified, and the expected targets are achieved. Compared with the non-prefetched paging query method, the outstanding contribution of this research result is that it can reduce the delay of paging query and thus improve the efficiency of the join operations of cross-databases. |
| Key words:
big data
NoSQL
SQL
database integration
cross-databases join
paged prefetching model
time delay
paging query
|
|
| 收稿日期: 2020-04-16
修回日期:
|
| DOI: 10.1051/jnwpu/20203861225 |
| 基金项目: 陕西省重点研发计划（2019ZDLGY17-04）资助 |
| 通讯作者:
Email： |
| 作者简介: 李常青(1969-),西北工业大学博士研究生,主要从事分布式与可信计算研究。
|
|
|
|
|
|
|
|
参考文献: |
|
|
[1] 孟小峰,慈祥. 大数据管理:概念、技术与挑战[J]. 计算机研究与发展,2013,50(1):146-169 MENG Xiaofeng, CI Xiang. Big Data Management:Concepts, Techniques and Challenges[J]. Journal of Computer Research and Development, 2013, 50(1):146-169(in Chinese)
[2] RAMON Lawrence. Integration and Virtualization of Relational SQL and NoSQL Systems Including MySQL and MongoDB[C]//2014 International Conference on Computational Science and Computational Intelligence, USA, 2014:285-290
[3] ALEJANDRO Corbellini, CRISTIAN Mateos, ALEJANDRO Zunino, et al. Persisting Big Data:The NoSQL Landscape[J]. Information Systems, 2017, 63(1):1-23
[4] JING Han, HAIHONG E, GUAN Le, et al. Survey on NoSQL Database[C]//6th International Conference on Pervasive Computing and Applications, USA, 2011:363-366
[5] BHUVAN N T, ELAYIDOM M S. A Technical Insight on the New Generation Databases:NoSQL[J]. International Journal of Computer Applications, 2015, 121(7):24-26
[6] LIAO Yingti, ZHOU Jiazheng, LU Chiahung, et al. Data Adapter for Querying and Transformation between SQL and NoSQL Database[J]. Future Generation Computer Systems, 2016, 65:111-121
[7] XIE Guoqi, CHEN Yuekun, LIU Yan, et al. JDAS:a Software Development Framework for Multidatabases[J]. Software:Practice and Experience, 2018, 48(2):366-382
[8] LI Changqing, GU Jianhua. An Integration Approach of Hybrid Databases Based on SQL in Cloud Computing Environment[J]. Software:Practice and Experience, 2019, 49(3):401-422
[9] 潘明明, 李丁丁, 汤庸, 等. 一种基于中间件的异构数据库融合访问方法及系统[J]. 计算机科学, 2018, 45(5):163-167 PAN Mingming, LI Dingding, TANG Yong, et al. Design and Implemention of Accessing Hybrid Database Systems Based on Middleware[J]. Computer Science, 2018, 45(5):163-167(in Chinese)
[10] ZHANG Chao, XU Jing. A Unified SQL Middleware for NoSQL Databases[C]//The 2018 International Conference on Big Data and Computing, ACM USA, 2018:14-19
[11] SOLANKE G B, RAJESWARI K. SQL to NoSQL Transformation System Using Data Adapter and Analytics[C]//2017 IEEE International Conference on Technological Innovations in Communication, Control and Automation, USA, 2017:59-63
[12] ANDRE Calil, RONALDO Mello. SimpleSQL:a Relational Layer for SimpleDB[C]//East European Conference on Advances in Databases and Information Systems, Germany, 2012:99-110
[13] VINIT Padhye, ANAND Tripathi. Scalable Transaction Management with Snapshot Isolation for NoSQL Data Storage Systems[J]. IEEE Trans on Services Computing, 2015, 8(1):121-135
[14] ADEWOLE Conrad Ogunyadeka, MUHAMMAD Younas, HONG Zhu, et al. A Multi-Key Transactions Model for NoSQL Cloud Database Systems[C]//Second International Conference on Big Data Computing Service and Applications, USA, 2016:24-27
[15] 宣超. 基于MongoDB的事务机制研究与实现[D]. 成都:电子科技大学, 2018 XUAN Chao. Research and Implementation of Transaction Mechanism Based on MongoDB[D]. Chengdu:University of Electronic Science and Technology of China, 2018(in Chinese)
[16] FABIO Andre Coelho, FRANCISCO Miguel Barros da Cruz, RICARDO Vilaca, et al. PH1:a Transactional Middleware for NoSQL[C]//The 33rd International Symposium on Reliable Distributed Systems, USA, 2014:115-124
[17] 李小龙. 分布式数据库事务支持[D]. 成都:电子科技大学,2014 LI Xiaolong. The Support for Distributed Database Transaction[D]. Chengdu:University of Electronic Science and Technology of China,2014(in Chinese) |
|
|
|
相关文献: |
|
|
1．李常青, 谷建华.一种基于ANTLR的MongoDB数据库SQL转化模型[J]. 西北工业大学学报, 2017,35(1): 143-147 |
|
|
2．刘文洁, 陈震, 李战怀.一种面向海量分布式数据库的游标构造方法[J]. 西北工业大学学报, 2017,35(4): 718-723 |
|
|
|
|
|
|
