US 12,293,023 B2
Systems, apparatus, and methods for gesture-based augmented reality, extended reality
Te-Won Lee, San Diego, CA (US); and Edwin Chongwoo Park, San Diego, CA (US)
Assigned to SoftEye, Inc., San Diego, CA (US)
Filed by SoftEye, Inc., San Diego, CA (US)
Filed on Dec. 2, 2022, as Appl. No. 18/061,226.
Claims priority of provisional application 63/340,470, filed on May 11, 2022.
Claims priority of provisional application 63/285,453, filed on Dec. 2, 2021.
Prior Publication US 2023/0176658 A1, Jun. 8, 2023
Int. Cl. G06F 3/01 (2006.01); G06F 3/16 (2006.01); G06T 11/00 (2006.01); G06V 10/25 (2022.01); G06V 10/26 (2022.01); G06V 10/28 (2022.01); G06V 10/70 (2022.01); G06V 10/82 (2022.01); G06V 40/18 (2022.01); G06V 40/20 (2022.01); H04N 23/65 (2023.01)
CPC G06F 3/017 (2013.01) [G06F 3/013 (2013.01); G06F 3/167 (2013.01); G06T 11/00 (2013.01); G06V 10/25 (2022.01); G06V 10/26 (2022.01); G06V 10/28 (2022.01); G06V 10/70 (2022.01); G06V 10/82 (2022.01); G06V 40/18 (2022.01); G06V 40/20 (2022.01); G06V 40/28 (2022.01); H04N 23/651 (2023.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus for multi-stage hands-free gesture-based user interface processing, comprising:
an eye-tracking camera sensor;
an outward-facing camera sensor;
a power source;
a first processor;
a second processor;
a first non-transitory computer-readable medium comprising a first set of instructions that when executed by the first processor, causes the first processor to:
detect a gesture based on a first image captured by the outward-facing camera sensor;
identify the gesture is a valid gesture associated with one or more gesture-specific tasks;
determine a target based on a second image captured by the eye-tracking camera sensor; and
wake the second processor in response to identification of the valid gesture; and
a second non-transitory computer-readable medium different from the first non-transitory computer-readable medium comprising a second set of instructions that when executed by the second processor, causes the second processor to:
perform the one or more gesture-specific tasks of the valid gesture; and
enter a first sleep state in response to a completion of the one or more gesture-specific tasks.