论文部分内容阅读
在大数据背景下处理海量数据时,数据的获取和分析手段至关重要。本文运用网络平台的开放接口API,对特定的地理区域和特定的用户采集包含时空信息的数据,建立了一个通过模拟登录自动发送网络请求,解析与提取返回数据,集数据采集、处理、入库于一体的微博数据采集系统;用微博数据的发布位置分布及集聚状态研究了用户的行为特征。试验表明,该方法可为事件发现、趋势预测、用户特征分析等方面提供信息。
When dealing with large amounts of data in the context of big data, data acquisition and analysis tools are crucial. In this paper, an open interface API of network platform is used to collect data containing spatio-temporal information for a specific geographic area and a specific user, and an automatic network sending request through simulated login is established to parse and extract returned data. The data collection, processing, storage In one of the micro-blog data acquisition system; Weibo data distribution and use of the distribution of state characteristics of the user’s behavior. Experiments show that this method can provide information for event discovery, trend prediction and user characteristic analysis.