A Replication Strategy Based on Optimal Load Balancing for a Heterogeneous Distributed Caching System in Networked GISs
-
摘要: 云环境下的网络地理信息服务具有分布性和异构性,空间数据(瓦片)的访问请求具有高度聚集性和不均匀性。以最小化负载不均衡度为目标,提出了一种应用于异构的、分布式高速缓存集群系统的多副本策略。该策略针对瓦片访问请求存在不均衡性,最小化热点访问数据的通信权重值,最大化地利用分布式集群缓存能力生成副本;针对异构集群环境下服务器处理能力的不均衡性,根据服务器性能和瓦片副本的通信权重值,匹配各个服务器的缓存能力部署副本。实验证明,该策略避免服务器拥塞的同时,能充分利用有限的分布式集群缓存能力,实现较好的负载均衡和较高的资源利用率,并能获得良好的缓存命中和请求响应性能。Abstract: Networked geospatial information services in cloud-based environments are distributed and heterogeneous; accesses to geospatial data (tiles) are uneven and has the feature of a high degree of aggregation. Aiming to minimize the degree of load imbalance, this paper proposes a replication strategy for a heterogeneous distributed high-speed cluster-based caching system. First, taking into account the unbalanced accesses to tiles, it minimizes the weighted communication values of hotspot tiles, and generates the maximum number of replicas based on the total cache capability of the distributed cluster-based caching system. Then, since each server has a different processing capacity in the heterogeneous system, the strategy places the replicas based on the service performance of each caching server and the weighted communication value of each replica, thus matching the cache capacity of each server. Experimental results reveal that the proposed strategy can avoid server congestion while fully utilizing limited cache capacity to achieve a better load balancing and a high resource utilization, delivering good response performance and a high cache hit rate.
-
Keywords:
- load balancing /
- cluster /
- heterogeneous /
- cache /
- QoS
-
-
[1] Wu Huayi, Zhang Hanwu. QoGIS: Concept and Research Framework[J]. Geomatics and Information Science of Wuhan University,2007,32(5):385-388(吴华意, 章汉武.地理信息服务质量(QoGIS) :概念和研究框架[J], 武汉大学学报·信息科学版,2007,32 (5):385-388) [2] Lou Shurong,Meng Lingkui,Fang Jun,et al. The Network Transmission Model of Multiresolution Image Based on Peer-to-Peer [J]. Acta Geodaetica et Cartographica Sinica, 2011,40(5):628-634(娄书荣,孟令奎,方军,等.基于对等网络的多分辨率影像的网络传输模型[J].测绘学报,2011,40(5):628-634) [3] Serpanos D N. MMPacking:A Load and Storage Balancing Algorithm for Distributed Multimedia Servers[J].IEEE Transactions on Circuits and Systems for Video Technology,1998, 8(1):13-17 [4] Dukes J, Jones J. Dynamic Repacking: A Content Replication Policy for Clustered Multimedia Servers[R].Trinity College Dublin Computer Science Department Technical Reports,Cambridge,UK,2002 [5] Ibarkai T, Katoh N. Resource Allocation Problem—Algorithmic Approaches[M].Massachusetts United States:The MIT Press, 1988 [6] Zhou Xiaobo, Xu Chenzhong. Optimal Video Replication and Placement on a Cluster of Video-on-Demand Servers[C]. The 2002 International Conference on Parallel Processing,IEEE Computer Society,Washington D C, USA, 2002 [7] Zhuo Juchao. Study of Cache Placement for Time-shifted TV Cluster Using Genetic Algorithm[D]. Hefei:University of Science and Technology of China,2010 (卓居超.时移电视集群系统缓存调度研究[D].合肥:中国科学技术大学,2010) [8] Dan A, Sitaram D.An Online Video Placement Policy Based on Bandwidth to Space Ratio(BSR)[C].ACM SIGMOD'95, New York, USA,1995 [9] Fu Wei, Xiao Yi, Lu Xicheng. QoS Perception Placed a Copy of the Studies Reviewed[J].Research and Development of the Computer, 2009,46(2):36-43 (付伟,肖依,卢锡城.QoS感知的副本放置问题研究综述[J].计算机研究与发展,2009,46(2): 36-43) [10] Fisher D. Hotmap: Looking at Geographic Attention[J]. IEEE Transactions on Visualization and Computer Graphics,2007,13(6):1 184-1 191 [11] Wang Hao, Pan Shaoming, Peng Min, et al. Zipf-like Distribution and Its Application Analysis for Image Data Tile Request in Digital Earth[J]. Geomatics and Information Science of Wuhan University,2010,35(3):356-359(王浩,潘少明,彭敏,等.数字地球中影像数据的Zipf-like访问分布及应用分析[J].武汉大学学报·信息科学版,2010,35(3):356-359) [12] Li Rui, Zhang Yinfeng,Xu Zhengquan, et al.A Load-balancing Method for Network GISs in a Heterogeneous Cluster-based System Using Access Density[J].Future Generation Computer Systems,2013,29(2):528-535 -
期刊类型引用(15)
1. 肖泽辉，季青，庞小平，闫忠男. 利用海洋2B卫星数据反演南极海冰表面积雪厚度. 测绘地理信息. 2024(06): 64-68 . 
百度学术
2. 张颖，刘建强，石立坚，蒋城飞. 极地海冰观测卫星的发展现状与展望. 遥感技术与应用. 2024(06): 1339-1352 . 百度学术
3. 陈国栋，陈钰，金涛勇，张志杰，李黎. 利用Cryosat-2 SAR模式数据确定北冰洋海平面模型. 大地测量与地球动力学. 2023(06): 606-611+621 . 百度学术
4. 于亚冉，王丽华，张梦悦. 基于CryoSat-2的北极海冰类型分类. 测绘与空间地理信息. 2022(01): 147-150 . 百度学术
5. 陈国栋，梁圣豪，孟子淇，朱家亨. 利用Cryosat-2数据确定格陵兰冰盖高程和体积变化. 苏州科技大学学报(自然科学版). 2022(01): 66-70+76 . 百度学术
6. 屈猛，赵羲，庞小平，雷瑞波. 北极冰间水道区域的物理过程和遥感观测研究进展. 地球科学进展. 2022(04): 382-391 . 百度学术
7. 高翔，庞小平，季青. 利用CryoSat-2测高数据研究南极威德尔海海冰出水高度时空变化. 武汉大学学报(信息科学版). 2021(01): 125-132 . 百度学术
8. 张婷，张杰，张晰. 基于CryoSat-2数据的2014—2018年北极海冰厚度分析. 海洋科学进展. 2020(03): 425-434 . 百度学术
9. 王志勇，王丽华，张晰，孙伟富，刘健. 雷达高度计在海冰厚度探测中的研究进展. 遥感信息. 2020(05): 1-8 . 百度学术
10. 满富康，夏文韬，张杰，柯长青. 基于OSI-SAF微波遥感数据的北极一年冰和多年冰研究. 极地研究. 2019(01): 69-83 . 百度学术
11. 吴星泉，张胜军，车德福. 利用CryoSat-2卫星测高资料确定北极海冰干舷高. 测绘通报. 2019(07): 64-68 . 百度学术
12. 庞小平，刘清全，季青. 北极一年海冰表面积雪深度遥感反演与时序分析. 武汉大学学报(信息科学版). 2018(07): 971-977 . 百度学术
13. 蒋广敏，戴利，代欣. 基于改进遗传算法的镀层氧化膜厚度测量研究. 周口师范学院学报. 2018(05): 121-124 . 百度学术
14. 王蔓蔓，柯长青，邵珠德. 基于CryoSat-2卫星测高数据的北极海冰体积估算方法. 海洋学报. 2017(03): 135-144 . 百度学术
15. 袁乐先，李斐，张胜凯，朱婷婷，左耀文. 利用ICESat/GLAS数据研究北极海冰干舷高度. 武汉大学学报(信息科学版). 2016(09): 1176-1182 . 百度学术
其他类型引用(20)
计量
- 文章访问数: 1300
- HTML全文浏览量: 71
- PDF下载量: 719
- 被引次数: 35
下载:
