US 11,733,838 B2
Augmented reality enabled autonomous vehicle command center
Shaurya Agarwal, Boston, MA (US); Ayman Alalao, Cambridge, MA (US); and Tyler Hendrickson, Tewksbury, MA (US)
Assigned to Motional AD LLC, Boston, MA (US)
Filed by Motional AD LLC, Boston, MA (US)
Filed on Nov. 6, 2020, as Appl. No. 17/92,188.
Prior Publication US 2022/0147203 A1, May 12, 2022
Int. Cl. G06F 3/0484 (2022.01); G05D 1/02 (2020.01); G06F 3/01 (2006.01); G05D 1/00 (2006.01); G06T 11/00 (2006.01)
CPC G06F 3/0484 (2013.01) [G05D 1/0038 (2013.01); G05D 1/0282 (2013.01); G06F 3/017 (2013.01); G06T 11/00 (2013.01); G05D 2201/0213 (2013.01); G06T 2200/24 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method comprising:
determining, by at least one processor, that a plurality of autonomous vehicles (i) are concurrently in a field of view of a user wearing an augmented reality display device and (ii) are in an idle state in a depot for at least one of storage or maintenance;
determining, by the at least one processor, first data regarding an operation of each of the first autonomous vehicles, the first data indicating:
a maintenance or repair status of each of the autonomous vehicles, and
a deployment status of each of the autonomous vehicles, wherein the deployment status of each of the autonomous vehicles comprises an indication of one or more routes previously traversed by that autonomous vehicle including:
a starting spatiotemporal location representing a pick up location for a respective passenger by that autonomous vehicle, and
a final spatiotemporal location representing a drop off location for the respective passenger by that autonomous vehicle; and
upon determining that the plurality of autonomous vehicles are concurrently in the field of view of the user and are in the idle state, causing, by the at least one processor, at least a portion of the first data to be presented to the user using the augmented reality display device, wherein causing at least the portion of the first data to the presented to the user comprises:
causing a graphical user interface to be presented in the field of view of the user using the augmented reality display device, and
causing at least the portion of the first data, including the indication of the one or more routes, to be included on the graphical user interface, such that at least the portion of the first data appears to be arranged spatially proximal to each of the first autonomous vehicles in the field of view of the user.