US 12,154,436 B2
User interfaces adapted for shared control of vehicles travelling in formation
Tekin Alp Meriçli, Pittsburgh, PA (US); Venkataramanan Rajagopalan, Sewickley, PA (US); Michael David George, Pittsburgh, PA (US); Cetin Alp Meriçli, Pittsburgh, PA (US); Alonzo James Kelly, Edgeworth, PA (US); Nezih Ergin Ozkucur, Pittsburgh, PA (US); Charles Brian Erny, Pittsburgh, PA (US); Craig Eugene Eyth, Ambridge, PA (US); and Dennis Jeffrey Hoff, South Park Township, PA (US)
Assigned to Stack AV Co., Mount Pleasant, PA (US)
Filed by Stack AV Co., Mount pleasant, PA (US)
Filed on Nov. 17, 2021, as Appl. No. 17/528,302.
Application 17/528,302 is a continuation of application No. 17/507,935, filed on Oct. 22, 2021, granted, now 11,995,991.
Claims priority of provisional application 63/128,961, filed on Dec. 22, 2020.
Prior Publication US 2022/0198937 A1, Jun. 23, 2022
Int. Cl. G08G 1/00 (2006.01); B60R 1/06 (2006.01); B60R 1/12 (2006.01); B60W 30/165 (2020.01); B60W 30/18 (2012.01); B60W 50/14 (2020.01); B60W 50/16 (2020.01); B62D 1/04 (2006.01); G05D 1/00 (2024.01); G05D 1/69 (2024.01)
CPC G08G 1/22 (2013.01) [B60R 1/06 (2013.01); B60R 1/12 (2013.01); B60W 30/165 (2013.01); B60W 30/18163 (2013.01); B60W 50/16 (2013.01); B62D 1/046 (2013.01); G05D 1/0291 (2013.01); G05D 1/69 (2024.01); B60R 2001/1215 (2013.01); B60W 2050/143 (2013.01); B60W 2050/146 (2013.01); B60W 2300/145 (2013.01); B60W 2556/65 (2020.02)] 14 Claims
OG exemplary drawing
 
1. A system for generating a plurality of synthetic viewpoints, the system comprising one or more processors configured to execute computer executable program code stored in one or more memories that, when executed causes the system to:
receive first information associated with one or more human driver inputs detected at one or more input devices and one or more outputs generated by one or more output devices on a first vehicle, wherein the first vehicle is at least partially controllable by a human driver;
receive second information associated with a plurality of sensors on both the first vehicle and a second vehicle, wherein the second vehicle is at least partially controllable by autonomy logic;
share the first information and the second information between the first and second vehicles as shared information;
maintain, using the shared information, a respective local copy of a shared world model at the first vehicle;
generate, by the first vehicle, based on the shared information included in its respective local copy of the shared world model, a plurality of synthetic viewpoints, wherein the plurality of synthetic viewpoints comprises a viewpoint from the second vehicle and an overhead viewpoint, the overhead viewpoint depicting both the first and the second vehicle, wherein the overhead viewpoint depicting both the first and the second vehicle is rendered based at least in part on sensor data from both the first and the second vehicle included in the local copy of the shared world model of the first vehicle;
cause display of at least one of the plurality of generated synthetic viewpoints on a display included in the first vehicle; and
wherein the computer executable program code, when executed, further causes the system to: display on the display associated with the first vehicle, a status of the first vehicle and the second vehicle collaboratively engaging in a decision.