US 11,861,757 B2
Self presence in artificial reality
James Allan Booth, Pacifica, CA (US); Mahdi Salmani Rahimi, San Francisco, CA (US); and Gioacchino Noris, Zurich (CH)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Sep. 7, 2022, as Appl. No. 17/930,181.
Application 17/930,181 is a continuation of application No. 16/734,240, filed on Jan. 3, 2020, granted, now 11,475,639.
Prior Publication US 2022/0415000 A1, Dec. 29, 2022
Int. Cl. G06T 19/00 (2011.01); G06T 15/20 (2011.01); G06N 20/00 (2019.01); G06V 40/10 (2022.01)
CPC G06T 19/006 (2013.01) [G06N 20/00 (2019.01); G06T 15/205 (2013.01); G06V 40/10 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A method for providing a self representation of a user in an artificial reality environment, the method comprising:
as a first process:
receiving one or more images captured in real time by one or more cameras on an artificial reality system;
classifying a self portion in each of the one or more images by applying, to the one or more images, a machine learning model trained to identify a user's own body in an image; and
displaying, in the artificial reality environment and as the self representation, the self portion of at least one of the one or more images, at a virtual location relative to the user's perspective in the artificial reality environment; and
as a second process, before a new self portion is classified and displayed as the self representation:
identifying a user movement based on identified movement of a controller or a tracked body part of the user;
determining one or more distances and directions of the user movement; and
based on the one or more determined distances and directions of the user movement, adjusting the displayed self representation of the at least one image to conform to the identified movement.