US 12,333,667 B1
Control of avatars in an augmented reality environment
Akash Raman Nigam, Venice, CA (US); and Sally Slade, Los Angeles, CA (US)
Assigned to GENIES, INC., West Hollywood, CA (US)
Filed by GENIES, INC., West Hollywood, CA (US)
Filed on Aug. 20, 2024, as Appl. No. 18/810,196.
Int. Cl. G06T 19/00 (2011.01); G06T 13/40 (2011.01); G06T 19/20 (2011.01)
CPC G06T 19/006 (2013.01) [G06T 13/40 (2013.01); G06T 19/20 (2013.01); G06T 2219/2004 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method of controlling avatars, the method comprising:
receiving, by a computing system comprising one or more processors, sensor data comprising a plurality of images of a physical environment and one or more images of a user;
generating, by the computing system, based on the sensor data, an augmented reality environment comprising an avatar, wherein the augmented reality environment is based on the plurality of images of the physical environment, wherein virtual distances within the augmented reality environment correspond to physical distances within the physical environment, wherein the augmented reality environment comprises a virtual computing system located at a virtual location within the augmented reality environment that corresponds to a physical location of the computing system within the physical environment, and wherein the avatar comprises a three-dimensional model comprising a facial region based on the one or more images of the user;
determining, by the computing system, the virtual location of the avatar within the augmented reality environment;
determining, by the computing system, based on the sensor data, that the virtual location of the avatar is at least a predetermined virtual distance from the virtual computing system;
detecting, by the computing system, one or more inputs to control the avatar within the augmented reality environment;
determining, by the computing system, based on the one or more images of the user, one or more facial states of the user; and
modifying, by the computing system, based on the one or more inputs and the one or more facial states, one or more states of the avatar, wherein the one or more states of the avatar comprise a position of the avatar within the augmented reality environment and a configuration of the facial region based on the one or more facial states.