專利授權區國立清華大學國際產學營運總中心 Operations Center for Industry Collaboration

搜尋專利授權區

關鍵字

» 新增關鍵字

選單

專利授權區

專利授權區
專利名稱(中)	基於聯邦強化學習的邊緣計算卸載優化方法及通信系統
專利名稱(英)	METHOD AND SYSTEM FOR FEDERATED REINFORCEMENT LEARNING BASED OFFLOADING OPTIMIZATION IN EDGE COMPUTING
專利家族	中華民國：I792784
專利權人	國立清華大學 100%
發明人	范嘉豪,邱偉育
技術領域	通信傳輸,能源科技,電子電機

專利摘要(英)
A method and a system for federated reinforcement learning based offloading optimization in edge computing are provided. In the method, each user equipment inputs network and task states into an actor network to generate an actor weighting table, accordingly selects an action for executing the task and obtains an evaluation. The related data is stored as experience in a replay buffer. Some experiences are extracted from the replay buffer, input into a critic network to obtain a value function, and input into a target actor network and a target critic network in order, to obtain a target value function, which are used to update network parameters of the actor and critic networks, and soft update network parameters of the target actor and critic networks. An average utility of learning and the actor weighting table are uploaded to cloud equipment. The cloud equipment accordingly computes a global weighting table and replies the same to user equipment for updating the actor weighting table.

專利摘要(英)

A method and a system for federated reinforcement learning based offloading optimization in edge computing are provided. In the method, each user equipment inputs network and task states into an actor network to generate an actor weighting table, accordingly selects an action for executing the task and obtains an evaluation. The related data is stored as experience in a replay buffer. Some experiences are extracted from the replay buffer, input into a critic network to obtain a value function, and input into a target actor network and a target critic network in order, to obtain a target value function, which are used to update network parameters of the actor and critic networks, and soft update network parameters of the target actor and critic networks. An average utility of learning and the actor weighting table are uploaded to cloud equipment. The cloud equipment accordingly computes a global weighting table and replies the same to user equipment for updating the actor weighting table.

聯絡資訊
承辦人姓名	李曉琪
承辦人電話	03-5715131 #31061
承辦人Email	hsiaochi@mx.nthu.edu.tw