CPC H04L 41/5019 (2013.01) [H04L 41/0806 (2013.01); H04L 41/5045 (2013.01); H04L 67/12 (2013.01); H04L 67/61 (2022.05); H04L 67/63 (2022.05); G06N 5/04 (2013.01)] | 30 Claims |
1. A gateway comprising:
memory; and
processing circuitry coupled to the memory, the processing circuitry to:
receive a request from a requester via a network interface of the gateway, the request including: an inference model identifier that identifies a registered platform of the request and a response time indicator;
transmit the request to the registered platform to handle the request consistent with the response time indicator, the registered platform selected based on a latency of the registered platform and the response time indicator; and
delay a different request having a higher response time indicator than the received request.
|