US 12,254,564 B2
Artificial intelligence-assisted virtual object builder
Vincent Charles Cheung, San Carlos, CA (US); Jiemin Zhang, Sunnyvale, CA (US); Bradley Duane Kowalk, San Francisco, CA (US); and Meng Wang, Hoboken, NJ (US)
Assigned to Meta Platforms, Inc., Menlo Park, CA (US)
Filed by Meta Platforms, Inc., Menlo Park, CA (US)
Filed on Dec. 19, 2022, as Appl. No. 18/067,980.
Claims priority of provisional application 63/309,760, filed on Feb. 14, 2022.
Prior Publication US 2023/0260208 A1, Aug. 17, 2023
Int. Cl. G06T 17/00 (2006.01); G06F 3/01 (2006.01); G06F 40/205 (2020.01); G06V 10/70 (2022.01)
CPC G06T 17/00 (2013.01) [G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 40/205 (2020.01); G06V 10/70 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method for building a virtual object in an XR world, the method comprising:
receiving, by an artificial intelligence (“AI”), a command from a user, wherein the command is associated with one or more images and the artificial intelligence is represented by a non-player character (NPC) in the XR world;
determining that the command is an object build command, wherein the determining is based on A) a determination that the user's attention is directed at the NPC, B) that the command includes the one or more images, and C) that the command does not indicate an existing virtual object in the XR world;
parsing a textual representation, of part of the command, for object type information and object location information;
building a 3D virtual object based on the one or more images and the object type information;
identifying a location, in the XR world, based on the object location information from the command and a direction determined for the user's attention; and
placing the built 3D virtual object in the XR world according to the identified location.