US 12,444,177 B2
AR-assisted synthetic data generation for training machine learning models
Tingbo Hou, Santa Clara, CA (US); Jianing Wei, Cupertino, CA (US); Adel Ahmadyan, Mountain View, CA (US); and Matthias Grundmann, San Jose, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Appl. No. 17/778,085
Filed by Google LLC, Mountain View, CA (US)
PCT Filed Nov. 19, 2019, PCT No. PCT/US2019/062218
§ 371(c)(1), (2) Date May 19, 2022,
PCT Pub. No. WO2021/101527, PCT Pub. Date May 27, 2021.
Prior Publication US 2022/0415030 A1, Dec. 29, 2022
Int. Cl. G06V 10/774 (2022.01); G06V 20/64 (2022.01)
CPC G06V 10/7747 (2022.01) [G06V 20/64 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for generating training data, the method comprising:
obtaining, by one or more computing devices, a three-dimensional model of a virtual object having one or more contact seats;
obtaining, by the one or more computing devices, data comprising one or more image frames that depict a scene;
detecting, by the one or more processors, one or more planar surfaces included in the scene, wherein the one or more planar surfaces each provide a substantially planar area normal to gravity;
determining, by the one or more computing devices, a position and an orientation for one of the contact seats of the virtual object within the scene to be in contact with at least one planar surface;
generating, by the one or more computing devices and using an augmented reality rendering engine, an augmented image that depicts the virtual object within the scene at the position and the orientation;
storing, by the one or more computing devices, the augmented image as a training image within a machine learning training dataset; and
associating, by the one or more computing devices, a training label with the training image in the machine learning training dataset, wherein the training label at least: identifies the virtual object, or indicates the position of the virtual object within the scene, or indicates the orientation of the virtual object within the scene.