US 12,223,104 B2
Partial passthrough in virtual reality
Michael James LeBeau, London (GB); and John Nicholas Jitkoff, Seattle, WA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Oct. 11, 2021, as Appl. No. 17/498,284.
Claims priority of provisional application 63/129,486, filed on Dec. 22, 2020.
Prior Publication US 2022/0197382 A1, Jun. 23, 2022
Int. Cl. G06F 3/01 (2006.01); G06T 11/00 (2006.01)
CPC G06F 3/014 (2013.01) [G06F 3/017 (2013.01); G06T 11/00 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for providing partial passthrough video to a user of a virtual reality device, the method comprising:
displaying, to the user, a computer generated virtual environment;
detecting a hand passthrough trigger event based on a user action and/or a condition that occurs in the user's real-world environment;
in response to detecting the hand passthrough trigger event, identifying a hand passthrough video feed, from one or more cameras of the virtual reality device, that captures the user's real-world environment;
aligning the hand passthrough video feed with a portion of the virtual environment by matching a location of a real-world object and/or a location of a real-world hand of the user to a corresponding location in the virtual environment; and
dynamically overlaying the hand passthrough video feed, comprising the real world hand of the user and/or the real-world object, over the aligned portion of the virtual environment, wherein the dynamically overlaying provides, to the user via the hand passthrough video, a depth accurate view of a) the real-world hand of the user and/or b) the real-world object.