A Cloud Service Architecture for Analyzing Big Monitoring Data

来源 :Tsinghua Science and Technology | 被引量 : 0次 | 上传用户:xuzhoucumt
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Cloud monitoring is of a source of big data that are constantly produced from traces of infrastructures,platforms, and applications. Analysis of monitoring data delivers insights of the system’s workload and usage pattern and ensures workloads are operating at optimum levels. The analysis process involves data query and extraction, data analysis, and result visualization. Since the volume of monitoring data is big, these operations require a scalable and reliable architecture to extract, aggregate, and analyze data in an arbitrary range of granularity. Ultimately, the results of analysis become the knowledge of the system and should be shared and communicated. This paper presents our cloud service architecture that explores a search cluster for data indexing and query. We develop REST APIs that the data can be accessed by different analysis modules. This architecture enables extensions to integrate with software frameworks of both batch processing(such as Hadoop) and stream processing(such as Spark) of big data. The analysis results are structured in Semantic Media Wiki pages in the context of the monitoring data source and the analysis process. This cloud architecture is empirically assessed to evaluate its responsiveness when processing a large set of data records under node failures. Cloud monitoring is a source of big data that are yet produced from traces of infrastructures, platforms, and applications. Analysis of monitoring data delivers insights of the system’s workload and usage pattern and recognized workloads are operating at optimum levels. The analysis process involves data query and extraction, data analysis, and result visualization. Since the volume of monitoring data is big, these operations require a scalable and reliable architecture to extract, aggregate, and analyze data in an arbitrary range of granularity. the knowledge of the system and should be shared and communicated. This paper presents our cloud service architecture that explores a search cluster for data indexing and query. We develop REST APIs that the data can be accessed by different analysis modules. This architecture enables extensions to integrate with software frameworks of both batch processing (such as Hadoop) and stream processing ( such as Spark) of big data. The analysis results are structured in Semantic Media Wiki pages in the context of the monitoring data source and the analysis process. This cloud architecture is empirically assessed to its responsiveness when processing a large set of data records under node failures.
其他文献
为探究吕家坨井田地质构造格局,根据钻孔勘探资料,采用分形理论和趋势面分析方法,研究了井田7
职场到底欢迎什么样的新人?什么样的基本素质能够帮助职场新人快速融入新的工作环境,为日后的发展打下良好的基础?这应该是每个刚入职的职场新人应该思考的问题.国有国法,家
“不动笔墨不读书.”批注式阅读是一种非常有效的方法.不过,现在很多教师因为操作不到位,导致了学生的批注阅读偏离的了文本,从而失去了应有的教学效果.在小学语文阅读课的教
期刊
2012年新刑诉法新修颁布后,卷宗移送制度由1996年刑诉法规定的“复印件移送制度”改为“卷宗移送制度”,而对于该项制度的回归是否解决了理论界和实践界一直担心的问题呢?本文将
20世纪80年代以来,世界经济发展的一个重要趋势是经济的全球化、网络化及知识化,由此生成了一种新经济形态。新经济的兴起与快速发展,极大地改变了企业运营的技术与经济环境,
汽车轻量化是实现节能减排的重要措施之一,对汽车工业的可持续发展具有重要意义.镁铝合金的材料特点及性能优势使其成为当今汽车轻量化的首选材料.本文主要阐述镁铝合金在汽
对话是语文课堂存在的最根本的方式.思想与思想的撞击,情感与情感的交流,知识与知识的链接,都是通过对话达成的.对话的效果直接关系到语文课堂教学目标的完成、学科价值的实
期刊
本文通过敢于向传统挑战,勇于突破自我,善于支持子女三方面用事例说明革命母亲葛健豪的不寻常之处,讲述了一个有血有肉英雄母亲的形象,展现了为妇女解放事业做出贡献的革命家长不
刘啸霆(实名刘孝廷),男,汉族,1963年4月生于辽宁朝阳,祖籍山东历城。哈尔滨师范大学理学学士、吉林大学哲学硕士、博士。自1987年起在哈尔滨学院执教,历任教育与发展研究所所长、科研处长、学报主编等,1995年晋升教授;2001年起任北京师范大学哲学与社会学学院教授、博士生导师,北京师范大学科学与人文研究中心主任,
期刊
中长跑训练可以发展人的耐力,如果多次参加,还可以提升人的耐力素养,培养吃苦耐劳、勇于拼搏、不抛弃不放弃的优秀品质.但是很多学生宁愿选择短跑也不愿意进行长跑训练,其中
期刊