US 12,230,144 B2
Flight route guidance system, flight route guidance device and flight route guidance method
Mitsuru Nakazawa, Tokyo (JP); and Hiroaki Iwase, Tokyo (JP)
Assigned to RAKUTEN GROUP, INC., Tokyo (JP)
Appl. No. 17/042,198
Filed by RAKUTEN GROUP, INC., Tokyo (JP)
PCT Filed Nov. 21, 2018, PCT No. PCT/JP2018/043028
§ 371(c)(1), (2) Date Sep. 28, 2020,
PCT Pub. No. WO2020/105147, PCT Pub. Date May 28, 2020.
Prior Publication US 2021/0118311 A1, Apr. 22, 2021
Int. Cl. G08G 5/00 (2006.01); B64U 10/14 (2023.01); B64U 50/19 (2023.01); G01C 23/00 (2006.01); G02B 27/01 (2006.01); G06T 19/00 (2011.01); B64U 50/30 (2023.01); B64U 101/30 (2023.01)
CPC G08G 5/0021 (2013.01) [B64U 10/14 (2023.01); B64U 50/19 (2023.01); G01C 23/005 (2013.01); G02B 27/0172 (2013.01); G06T 19/006 (2013.01); B64U 50/30 (2023.01); B64U 2101/30 (2023.01); B64U 2201/10 (2023.01); B64U 2201/20 (2023.01); G02B 2027/0141 (2013.01)] 22 Claims
OG exemplary drawing
 
22. A flight route guidance method, comprising:
acquiring flight route information indicating a flight route of an unmanned aerial vehicle in a real space;
identifying a visually recognized position of a user of the flight route guidance method, and a visually recognized direction in the real space of a user of the flight route guidance method, the visually recognized direction being a direction that the user's head is facing;
generating an image representing the flight route viewed from the visually recognized position in the visually recognized direction based on the flight route information;
displaying the image under a state in which a position of the image is matched with a situation viewed from the visually recognized position in the visually recognized direction in the real space, on a display;
determining whether the first unmanned aerial vehicle is on track of the flight route;
controlling, when it is determined that the first unmanned aerial vehicle is on the flight route, whether to display an image that corrects a position at which the flight route is represented by translating or rotating the image;
correcting the position at which the flight route is represented so that the first unmanned aerial vehicle is depicted on the flight route; and
generating the image in a mode that depends on whether the first unmanned aerial vehicle stays on track of the flight route,
wherein the mode includes a marker indicating whether or not the first unmanned aerial vehicle has stayed on track of the flight route.