US 12,461,522 B2
System and method to facilitate remote and accurate maneuvering of unmanned aerial vehicle under communication latency
Aviv Shapira, Tel-Aviv (IL); Matteo Shapira, Tel-Aviv (IL); Reuven Liani, Rosh Haayin (IL); and Adir Tubi, Beer Yaacov (IL)
Assigned to XTEND Reality Expansion Ltd., Tel-Aviv (IL)
Filed by XTEND Reality Expansion Ltd., Tel-Aviv (IL)
Filed on Oct. 8, 2021, as Appl. No. 17/497,035.
Claims priority of provisional application 63/089,230, filed on Oct. 8, 2020.
Prior Publication US 2022/0113720 A1, Apr. 14, 2022
Int. Cl. G05D 1/00 (2024.01); B64U 10/14 (2023.01); B64U 30/26 (2023.01); B64U 101/30 (2023.01); G08G 5/26 (2025.01); G08G 5/55 (2025.01); G08G 5/57 (2025.01); H04N 5/272 (2006.01); H04N 7/18 (2006.01)
CPC G05D 1/0022 (2013.01) [G05D 1/101 (2013.01); G08G 5/26 (2025.01); G08G 5/55 (2025.01); G08G 5/57 (2025.01); H04N 5/272 (2013.01); H04N 7/183 (2013.01); B64U 10/14 (2023.01); B64U 30/26 (2023.01); B64U 2101/30 (2023.01); B64U 2201/10 (2023.01); B64U 2201/20 (2023.01)] 18 Claims
OG exemplary drawing
 
1. A system for determining and visualizing communication latency
while maneuvering at least one unmanned aerial vehicle (UAV), the system comprising:
a ground control station (GCS) including a display, at least one transceiver, at least one processor, and a non-transitory processor-readable medium storing thereon a set of executable instructions that, when executed by the at least one processor, cause the at least one processor to:
establish a communication channel between at least one controller and the at least one UAV;
receive a persistent second marked singular point indicative of an Area of Interest (AOI) from the at least one controller, wherein the persistent second marked singular point is based at least in part on a user input to the at least one controller;
transmit the persistent second marked singular point to the at least one UAV, wherein the persistent second marked singular point instructs the at least one UAV to move towards the persistent second marked singular point;
receive via the at least one transceiver a live video feed from the at least one UAV and at least one UAV communication unit, the live video feed containing the AOI;
receive a duration indication of a continuous pressing of a trigger of the at least one controller;
render a raycast vector in the live video feed of the AOI while the trigger is continuously pressed, wherein the GCS renders the raycast vector into a distance in the rendered displayed live video feed based on the duration;
determine a communication latency of the live video feed from the at least one UAV;
determine a first marked singular point based at least in part on the determined communication latency of the live video feed from the at least one UAV;
render a display video feed using the live video feed from the at least one UAV, the persistent second marked singular point, and the first marked singular point, wherein the displayed live video feed further includes a visual connection between the persistent second marked singular point and the first marked singular point; and
transmit the rendered display video feed to the display.