|
|
论文:2016,Vol:34,Issue(3):529-535 |
|
|
引用本文： |
|
|
王海涛, 李战怀, 张晓. 一种云存储系统分层性能监测和采集方法[J]. 西北工业大学学报 |
|
|
Haitao Wang, Zhanhuai Li, Xiao Zhang. A Layered Performance Monitoring and Gathering Method of Cloud Storage[J]. Northwestern polytechnical university |
|
|
|
|
|
|
|
| 一种云存储系统分层性能监测和采集方法 |
|
| 王海涛1, 李战怀1, 张晓1,2 |
|
1. 西北工业大学 计算机学院, 陕西 西安 710129;
2. 高效能服务器和存储技术国家重点实验室, 山东 济南 250101 |
| 摘要: |
| 为了解决现有云存储监测方法无法获得完整的系统特性,以确定最佳应用场景并定位性能瓶颈,根据云存储系统的分层架构,调查研究了云存储系统层上的性能监测和采集方法,并提出了一种针对云存储系统层进行分层性能监测和采集的框架。该框架可以获得云存储系统各个系统层次的性能数据,并做进一步的综合对比分析,确定系统的应用场景并定位系统瓶颈,从而对其进行进一步优化。最后在ceph云存储系统上进行了实验,验证了新方法的可用性。 |
| 关键词:
云存储
分层架构
性能监测
数据采集
|
|
| A Layered Performance Monitoring and Gathering Method of Cloud Storage |
|
| Haitao Wang1, Zhanhuai Li1, Xiao Zhang1,2 |
|
1. School of Computer Science, Northwestern Polytechnical University, Xi'an 710129, China;
2. State Key Laboratory of High-End Server and Storage Technology, Jinan 250101, China |
| Abstract: |
| In order to solve the problem that existing cloud storage monitoring methods can't obtain the whole system characters to find the best application scenario or perform failure analysis, this paper reviewed the models that used to monitor and gather performance data on system layers of cloud storage system, and proposed a frmework which can evaluate the whole system by gathering and analyzing performance information of main layers in cloud storage according to it's layered architecture. This framework can gather performance data of system layers to do further analysis, determine the best application scenario and locate system bottlenecks, then provide some optimized advises to improve the system. In the end, an experiment was conducted on the ceph cloud storage system using this method, the result verified the availability of proposed method. |
| Key words:
cloud storage
performance evaluation
monitoring model
failure analysis
|
|
| 收稿日期: 2015-10-22
修回日期:
|
| DOI: |
| 基金项目: 国家"863"重大项目(2013AA01A215)、自然科学基金面上项目(61472323)、西北工业大学基础研究基金(3102015JSJ0009)及高效能服务器和存储技术国家重点实验室开放基金(2014HSSA11)资助 |
| 通讯作者:
Email： |
| 作者简介: 王海涛(1990—),西北工业大学博士研究生,主要从事云存储的研究。
|
|
| 相关功能 |
|
|
|
|
| 作者相关文章 |
|
| 王海涛 在本刊中的所有文章 |
| 李战怀 在本刊中的所有文章 |
| 张晓 在本刊中的所有文章 |
|
|
|
|
|
|
|
|
参考文献: |
|
|
[1] International Data Corporation(IDC). Big Data-The Challenges and the Opportunity(2013-10-31), http://nextgendistribution.com.au/industry-trends/big-data-challenges-opportunity/
[2] Antoniou A. Performance Evaluation of Cloud Infrastructure Using Complex Workloads[D]. Delft University of Technology, 2012
[3] Cooper B F, Silberstein A, Tam E, et al. Benchmarking Cloud Serving Systems with YCSB[C]//Proceedings of the 1st ACM Symposium on Cloud Computing, 2010: 143-154
[4] Zhang X, Feng W X, Qin X. Performance Evaluation of Online Backup Cloud Storage[J]. International Journal of Cloud Applications and Computing, 2013, 3(3): 20-33
[5] Tan J, Kavulya S, Gandhi R, et al. Visual, Log-Based Causal Tracing for Performance Debugging of Map Reduce Systems[C]//30th IEEE International Conference on Distributed Computing Systems, 2010: 795-806
[6] Chen Y, Srinivasan K, Goodson G, et al. Design Implications for Enterprise Storage Systems via Multi-Dimensional Trace Analysis[C]//Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, 2011:43-56
[7] Ballani H, Costa P, Karagiannis T, et al. Towards Predictable Datacenter Networks[C]//ACM Computer Communication Review of Special Interest Group on Data Communication, 2011, 41(4): 242-253
[8] Benjamin H Sigelman, Luiz Andre Barroso, Mike Burrows, et al. Dapper, a Large-Scale Distributed Systems Tracing Infrastructure[R]. Google Research,2010
[9] Boulon J, Konwinski A, Qi R, et al. Chukwa, A Large-Scale Monitoring System[C]//Proceedings of Computability and Complexity in Analysis. 2008, 8: 1-5
[10] Kutare M, Eisenhauer G, Wang C, et al. Monalytics: Online Monitoring and Analytics for Managing Large Scale Data Centers[C]//Proceedings of the 7th International Conference on Autonomic Computing,2010:141-150
[11] Wang YA, Huang C, Li J, et al. Estimating the Performance of Hypothetical Cloud Service Deployments: A Measurement-Based Approach[C]//IEEE International Conference on Computer Communications,2011: 2372-2380
[12] Noorshams Q, Bruhn D, Kounev S, et al. Predictive Performance Modeling of Virtualized Storage Systems Using Optimized Statistical Regression Techniques[C]//Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering, 2013: 283-294
[13] 施杨斌, 吴杰, 梁瑾. 云存储上的I/O特征获取机制[J]. 计算机工程与设计, 2011, 32(8):2870-2873 Shi Yangbin, Wu Jie, Liang Jin. Efficient I/O Characteristics Collection Method on Cloud Storage[J]. Computer Engineering and Design, 2011,32(8):2870-2873 (in Chinese)
[14] Massie M L, Chun B N, Culler D E. The Ganglia Distributed Monitoring System: Design, Implementation and Experience[J]. Parallel Computing, 2003, 30(7):817-840 |
|
|
|
|
|
|
|
