Q-learning based heterogenous network self-optimization for reconfigurable network with CPC assistan

来源 :Science in China(Series F:Information Sciences) | 被引量 : 0次 | 上传用户:zhangqi1234
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
With the irreversible trend of the convergence and cooperation among heterogeneous networks, there emerge some important issues for network evolution. One of them is to reconfigure network elements such as cellular base stations (BSs) or access points (APs) of wireless local area networks (WLANs) according to the real-time network environment, in order to maximize the cooperation gain of different networks. In this paper, we consider cognitive pilot channel (CPC) as an assistant to enable cooperation among heterogeneous networks. Based on the widely used reinforcement learning algorithm, this paper has proposed the heterogeneous network self-optimization algorithm (HNSA) to solve the adaptation problem in reconfigurable systems. In the algorithm, distributed agents perform reinforcement learning, and make decisions cooperatively with the help of CPC in order to reduce the system blocking rate and improve network revenue. Finally our simulation proves the anticipated goal is achieved. With the irreversible trend of the convergence and cooperation among heterogeneous networks, there emerge some important issues for network evolution. One of them is to reconfigure network elements such as cellular base stations (BSs) or access points (APs) of wireless local area networks According to the real-time network environment, in order to maximize the cooperation gain of different networks. learning algorithm, this paper has proposed the heterogeneous network self-optimization algorithm (HNSA) to solve the adaptation problem in reconfigurable systems. In the algorithm, distributed agents perform reinforcement learning, and make decisions cooperatively with the help of CPC in order to reduce the system blocking rate and improve network revenue. Finally our simulation proves the anticipated goal is achieved.
其他文献
SiPix已证实能以低成本、高效率的卷式(roll-to-roll)制程来生产超轻、超薄的柔软电子纸。本文针对SiPix电子纸显示技术,将详细介绍电泳显示技术基本原理、SiPix结构、SiPix
凉城县刘家矢公社四道咀大队牛路沟生产队社员段珍,几十年来坚持植树,群众亲切地称他是“植树迷”。段珍土生土长在牛路沟,父亲是个爱树的人。解放前,他们全家栽下了一块树
编辑同志: 我怀着激动的心情,向你们反映一件我终生难忘的事情。今年正月初三中午,我刚生下十天的儿子刘小志,突然患重病,来到河北省柏各庄农垦区医院。当时医院儿科大夫黄
国家会计学院于1999年5月5日—6月29日主办了第一期国有大中型企业总会计师培训班。本期培训班共有学员40人,都是国有大中型企业现任总会计师或财务负责人。 人事部副部长张
野兽主义画派存在于20世纪初,是一个松散的美术社团,它没有共同遵守的明确目标,也没有发表过宣言和理论主张,它只活动了三年。野兽主义一词的由来比较偶然,1905年秋季,在法国
白环柄菇在真菌分类地位属担子菌亚门,子实体的菌盖和菌柄洁白无瑕,菌肉浓香味美可口。一、白环柄菇生物学特性1、温度:菌丝生长适宜温度范围10℃-40℃,其中以25℃-26℃最为
树桩盆景当进入欣赏之期,盆中的树木生长还会继续的变化。尤其是生命强健的树种,如雀梅、紫薇、福建茶、宝荆等在生长期容易树势旺长,叶片也随之逐渐扩大。这样有失原有作品
病毒围栏增殖方法由云南省林科院经过10多年病毒复制试验证明:该方法是增殖CPV用以防治松毛虫最经济实用的方法。其病毒投入少,产量高,风险较小。设置围栏采集6~7龄文山松毛虫幼虫,选用1×
广东省畅好农场八队党支部记书骆刚,利用职权请客送礼,大吃大喝,随意挥霍集体钱财,并非法抢购、倒卖粮食,受到严肃处理。去年2月,骆刚擅自决定,拿集体的两头羊、300斤甘蔗、
乌尔旗汉林业局供应科小工厂,发扬自力更生,艰苦奋斗精神,因陋就简,勤俭办厂,取得了较好的经济效果,生产能力也得到较快的发展。 1971年,这个厂还是供应科的废品库,仅有几名