US 12,436,530 B2
Latency management systems and methods for remote control of a robotic device
Nicholas Sidelnik, Lake Quivira, KS (US)
Assigned to Verizon Patent and Licensing Inc., Basking Ridge, NJ (US)
Filed by Verizon Patent and Licensing Inc., Basking Ridge, NJ (US)
Filed on Sep. 12, 2022, as Appl. No. 17/942,869.
Prior Publication US 2024/0085901 A1, Mar. 14, 2024
Int. Cl. G06K 9/00 (2022.01); G05D 1/00 (2006.01); G06V 10/70 (2022.01); G06V 20/40 (2022.01)
CPC G05D 1/0022 (2013.01) [G05D 1/0038 (2013.01); G06V 10/70 (2022.01); G06V 20/46 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by a latency management system, a sequence of captured frames in a video stream of an operating environment associated with a robotic device;
monitoring, by the latency management system, a communication latency of a communication channel between the robotic device and a robotic device operator;
predicting, by the latency management system, one or more estimated future frames associated with the video stream based on the sequence of captured frames and the communication latency;
providing, by the latency management system, the one or more estimated future frames to the robotic device operator;
utilizing, by the latency management system, an estimated future frame from the one or more estimated future frames in providing a control input for the robotic device; and
providing, by the latency management system, the control input to a machine learning model, the machine learning model being configured to use the control input in predicting one or more additional estimated future frames for the video stream in a subsequent prediction cycle.