| CPC G05B 19/41895 (2013.01) [G05B 19/4185 (2013.01); G05B 2219/14006 (2013.01)] | 14 Claims |
|
1. A method of operating a device that interacts with a physical environment, the method comprising:
determining to take an action on the physical environment, wherein the action is based on an output of a computing task;
generating a risk level that estimates a risk of physical harm associated with taking the action within the physical environment;
obtaining a performance indicator of a communication network between the device and a remote computing device;
determining, based on the risk level and the performance indicator, whether to offload the computing task to the remote computing device or to perform the computing task locally,
wherein the deciding whether to offload the computing task to the remote computing device or to perform the computing task locally is performed using a reinforcement learning agent that evaluates a reward for offloading the computing task to the remote device, wherein the reward is calculated based on a latency reward rl, that is based on an amount of time needed to perform the computing task, an energy reward re that is based on an amount of energy needed to perform the computing task, and an accuracy reward ra that is based on an accuracy of the computing task, and
wherein the latency reward rl is defined as:
rl=wl×1/L
where wl is a weight that indicates a relative importance of the latency reward compared to other reward factors and L is a total latency associated with performing the computing task, including a communication latency and an execution latency; and
in response to determining to offload the computing task to the remote computing device, transmitting task input data to the remote computing device, receiving task output data from the remote computing device, and taking the action on the physical environment based on the task output data received from the remote computing device.
|