基于联邦深度强化学习的无人机辅助云边协同资源调度方法

UAV-assisted Cloud-edge Collaborative Resource Scheduling Method Based on Federated Deep Reinforcement Learning

  • 摘要: 随着5G通信技术的广泛应用,针对边缘计算中终端算力受限、时延严苛及数据隐私合规三大挑战,提出一种基于联邦深度强化学习的无人机辅助云边协同资源调度方法。首先,构建端-边-云协同架构,联合优化无人机(UnmannedAerial Vehicle,UAV)三维轨迹、通信资源与卸载决策,解决高动态环境下的全局优化难题;其次,在深度强化学习(Deep Reinforcement Learning,DRL)中引入多头注意力机制(Multi-head Attention,MHA),精准捕捉时空耦合特征,提升模型的表征能力与收敛速度;最后,设计基于模型新鲜度加权的异步联邦机制并结合差分隐私,在消除木桶效应的同时保障数据安全。仿真结果显示,模型收敛性能大幅提升,系统能耗显著降低,实现了调度效率与隐私保护的最优平衡。

     

    Abstract: With the widespread application of 5G communication technology, a droneassisted cloud-edge collaborative resource scheduling method based on federated deep reinforcement learning is proposed to address three major challenges in edge computing: limited terminal computing power, stringent latency requirements, and data privacy compliance. Firstly, an end-edge-cloud collaborative architecture is constructed to jointly optimize the three-dimensional trajectory of unmanned aerial vehicle(UAV), communication resources, and offloading decisions, addressing the global optimization challenge in highly dynamic environments. Secondly, a multi-head attention (MHA) mechanism is introduced into deep reinforcement learning (DRL) to accurately capture spatiotemporal coupling features and enhance the model's representation ability and convergence speed. Finally, an asynchronous federated mechanism weighted by model freshness is designed, combined with differential privacy, to eliminate the barrel effect while ensuring data security. Simulation results show that the model convergence performance is significantly improved, system energy consumption is significantly reduced, and an optimal balance between scheduling efficiency and privacy protection is achieved.

     

/

返回文章
返回