US 11,734,895 B2
Systems and methods for enabling precise object interaction within an augmented reality environment
Anthony D. Sanor, Melissa, TX (US); David Kleiner, Plano, TX (US); Jazmieka Smith, Fairview, TX (US); and Gary Banks, Dallas, TX (US)
Assigned to TOYOTA MOTOR NORTH AMERICA, INC., Plano, TX (US)
Filed by TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC., Plano, TX (US)
Filed on May 7, 2021, as Appl. No. 17/314,846.
Claims priority of provisional application 63/125,196, filed on Dec. 14, 2020.
Prior Publication US 2022/0189124 A1, Jun. 16, 2022
Int. Cl. G06T 19/00 (2011.01); G06T 17/20 (2006.01); G06N 20/00 (2019.01); G06N 5/04 (2023.01); G06V 20/20 (2022.01); G06F 30/15 (2020.01); G06F 3/0482 (2013.01); G06F 3/04847 (2022.01); G06F 18/214 (2023.01); G06F 111/16 (2020.01); G06F 111/02 (2020.01); G06F 111/18 (2020.01); G06Q 30/0601 (2023.01); B62D 65/00 (2006.01); G06Q 10/101 (2023.01)
CPC G06T 19/006 (2013.01) [G06F 3/0482 (2013.01); G06F 3/04847 (2013.01); G06F 18/214 (2023.01); G06F 30/15 (2020.01); G06N 5/04 (2013.01); G06N 20/00 (2019.01); G06Q 30/0605 (2013.01); G06Q 30/0621 (2013.01); G06Q 30/0631 (2013.01); G06Q 30/0643 (2013.01); G06T 17/20 (2013.01); G06V 20/20 (2022.01); B62D 65/00 (2013.01); G06F 2111/02 (2020.01); G06F 2111/16 (2020.01); G06F 2111/18 (2020.01); G06Q 10/101 (2013.01); G06T 2200/24 (2013.01); G06V 2201/08 (2022.01)] 14 Claims
OG exemplary drawing
 
1. A computer-implemented method for displaying a real-world vehicle in an augmented reality environment, the method comprising:
using a camera of a user device to obtain image data of an environment having a real-world vehicle therein;
displaying, on a display of the user device, instructions to scan an accessory of the real-world vehicle;
analyzing the image data to identify the real-world accessory within the environment;
displaying, on the display, a virtual accessory;
displaying, on the display, instructions to align the virtual accessory with the real-world vehicle accessory;
after the virtual image is aligned with the real-world vehicle accessory on the display, generating a wireframe model of the virtual accessory;
registering the wireframe model to the real-world vehicle accessory;
attaching a virtual accessory to the wireframe model; and
displaying the virtual accessory on the display in an augmented reality environment such that the vehicle appears to incorporate the virtual accessory.