US 12,444,143 B1
Augmented reality-based vehicle guidance for improved driving safety
Christopher James Waful, San Antonio, TX (US); Gerald Richard Halbeisen, Cibolo, TX (US); and Christopher Lee Doughton, San Antonio, TX (US)
Assigned to United Services Automobile Association, San Antonio, TX (US)
Filed by UIPCO, LLC, San Antonio, TX (US)
Filed on Jan. 27, 2023, as Appl. No. 18/160,552.
Claims priority of provisional application 63/304,353, filed on Jan. 28, 2022.
Int. Cl. G06T 19/00 (2011.01); G01S 19/01 (2010.01); G06Q 10/20 (2023.01); G06Q 30/0207 (2023.01); G06T 11/00 (2006.01); G06V 10/764 (2022.01); G06V 20/56 (2022.01)
CPC G06T 19/006 (2013.01) [G01S 19/01 (2013.01); G06Q 10/20 (2013.01); G06Q 30/0207 (2013.01); G06T 11/00 (2013.01); G06V 10/764 (2022.01); G06V 20/56 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method of intelligently managing the presentation of information to a driver of a vehicle, the method comprising:
receiving, at an application running on a mobile phone of the driver, first location data of the vehicle from a GPS device of the mobile phone that falls in a first zone;
receiving, at the application, first image data of an ongoing first roadway scene through a forward windshield of the vehicle, the first image data captured by a camera associated with the mobile phone, wherein the mobile phone is mounted within an interior region of the vehicle such that the ongoing first roadway scene through the forward windshield of the vehicle is within a field of view of the camera;
passing the first image data captured by the camera of the mobile phone through a feature parser layer of the application to detect and classify objects in the first image data using an object recognition algorithm;
classifying, at the application, a first object in the first roadway scene as a first billboard displaying a first original content, wherein the first object is identified as the first billboard by the object recognition algorithm using a sign model;
determining, via the application and with reference to a merchant database, that a first merchant is located within the first zone, wherein the first zone represents a maximum first distance from the vehicle or a maximum first driving time from the vehicle;
determining, by an advice layer of the application, a first replacement content to be applied to the first image data, wherein the first replacement content is related to the first merchant;
adding the first replacement content to the first image data using an image markup module of the mobile phone to generate an augmented reality-based first projection; and
presenting, via the application and on a display of the mobile phone, in response to determining the first merchant is in the first zone, the augmented reality-based first projection overlaid on the first original content, the first projection including the first replacement content that is related to the first merchant.