US 11,756,272 B2
Somatic and somatosensory guidance in virtual and augmented reality environments
Roger Brent, Seattle, WA (US); John Max Kellum, Seattle, WA (US); and James Ashley, Lilburn, GA (US)
Assigned to LabLightAR, Inc., Seattle, WA (US)
Filed by LabLightAR, Inc., Seattle, WA (US)
Filed on Aug. 29, 2022, as Appl. No. 17/823,015.
Claims priority of provisional application 63/237,992, filed on Aug. 27, 2021.
Prior Publication US 2023/0068660 A1, Mar. 2, 2023
Int. Cl. G06T 19/00 (2011.01); G06F 9/451 (2018.01); G06T 19/20 (2011.01); G09B 19/00 (2006.01); G06F 3/01 (2006.01)
CPC G06T 19/006 (2013.01) [G06F 3/011 (2013.01); G06F 9/453 (2018.02); G06T 19/20 (2013.01); G09B 19/003 (2013.01); G06T 2219/2012 (2013.01); G06T 2219/2016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of operating a procedural guidance system, the method comprising:
detecting first user interactions of a first user during an interactive guided process;
displaying to a second user, using at least one augmented reality (AR) layer, one or more representations of one or more first user hands of the first user carrying out the interactive guided process;
detecting second user interactions of the second user during the interactive guided process, wherein the second user attempts to superimpose one or more representations of one or more second user hands with the one or more representations of the one or more first user hands in the at least one AR layer;
determining if the one or more representations of the one or more first user hands and the one or more representations of the one or more second user hands are superimposed in the at least one AR layer;
in response to determining none of the representations of the one or more first user hands and the one or more second user hands being superimposed in the at least one AR layer, generating corrective action signals for the first user, the second user, or both; and
In response to determining at least one or more fingertips in a representation of a second user hand that are in contact with an object being superimposed on one or more corresponding fingertips in an additional representation of a corresponding first user hand in the at least one AR layer without other portions of the first user hand and the second user in each representation being superimposed, generating a continue signal for at least the second user or permitting a procedure in the interactive guided process to advance to a next step.