CPC H04L 41/16 (2013.01) [H04L 43/0894 (2013.01)] | 5 Claims |
1. A split computing device operating in a serverless edge computing environment, the split computing device comprising:
a transceiver configured to receive resource information of a terminal from the terminal and to measure a data transmission rate between the terminal and the split computing device in a process of receiving the resource information from the terminal;
a splitting point deriver configured to determine a splitting point of a deep neural network (DNN) model and an activation status of a container instance for each of tail models of the DNN for split computing using the resource information of the terminal, the data transmission rate, and resource information of the split computing device,
wherein the transceiver is configured to receive, from the terminal, intermediate data that is inference results for a head model of the DNN model for the determined splitting point; and
an inference unit configured to derive final results of the DNN model by performing inference on the intermediate data to derive inference results for a tail model of the DNN model for the determined splitting point,
wherein the inference results derived by the inference unit are transmitted to the terminal via the transceiver.
|