US 12,094,070 B2
Coordinating cursor movement between a physical surface and a virtual surface
Doron Assayas Terre, Holon (IL); Tamir Berliner, Tel Aviv (IL); and Tomer Kahan, Ramat Hasharon (IL)
Assigned to SIGHTFUL COMPUTERS LTD, Tel Aviv (IL)
Filed by MULTINARITY LTD., Tel Aviv (IL)
Filed on May 5, 2023, as Appl. No. 18/313,055.
Application 18/313,055 is a continuation of application No. 17/947,039, filed on Sep. 16, 2022, abandoned.
Application 17/947,039 is a continuation of application No. 17/711,299, filed on Apr. 1, 2022, granted, now 11,475,650, issued on Oct. 18, 2022.
Application 17/711,299 is a continuation of application No. PCT/US2022/015548, filed on Feb. 8, 2022.
Claims priority of provisional application 63/307,203, filed on Feb. 7, 2022.
Claims priority of provisional application 63/307,207, filed on Feb. 7, 2022.
Claims priority of provisional application 63/307,217, filed on Feb. 7, 2022.
Claims priority of provisional application 63/300,005, filed on Jan. 16, 2022.
Claims priority of provisional application 63/226,977, filed on Jul. 29, 2021.
Claims priority of provisional application 63/216,335, filed on Jun. 29, 2021.
Claims priority of provisional application 63/215,500, filed on Jun. 27, 2021.
Claims priority of provisional application 63/213,019, filed on Jun. 21, 2021.
Claims priority of provisional application 63/173,095, filed on Apr. 9, 2021.
Claims priority of provisional application 63/157,768, filed on Mar. 7, 2021.
Claims priority of provisional application 63/147,051, filed on Feb. 8, 2021.
Prior Publication US 2023/0274512 A1, Aug. 31, 2023
Int. Cl. G06T 19/00 (2011.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06F 3/033 (2013.01); G06F 3/041 (2006.01); G06F 3/04812 (2022.01); G06F 3/04815 (2022.01); G06F 3/04817 (2022.01); G06F 3/0488 (2022.01); G06F 3/04892 (2022.01); G06F 3/14 (2006.01); G06F 3/16 (2006.01); G06T 3/40 (2006.01); G06T 7/70 (2017.01); G06V 40/20 (2022.01); G09G 5/10 (2006.01)
CPC G06T 19/006 (2013.01) [G02B 27/0101 (2013.01); G02B 27/017 (2013.01); G06F 3/011 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/033 (2013.01); G06F 3/041 (2013.01); G06F 3/04812 (2013.01); G06F 3/04815 (2013.01); G06F 3/04817 (2013.01); G06F 3/0488 (2013.01); G06F 3/04892 (2013.01); G06F 3/14 (2013.01); G06F 3/165 (2013.01); G06T 3/40 (2013.01); G06T 7/70 (2017.01); G06T 19/003 (2013.01); G06V 40/25 (2022.01); G09G 5/10 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0178 (2013.01); G06F 2203/04104 (2013.01); G06T 2219/012 (2013.01); G09G 2320/08 (2013.01); G09G 2340/04 (2013.01); G09G 2354/00 (2013.01); G09G 2370/16 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A non-transitory computer readable medium containing instructions that when executed by at least one processor cause the at least one processor to perform operations for moving a virtual cursor along two intersecting virtual planes, the operations comprising:
generating a display via a wearable extended reality appliance, the display including a virtual cursor and plurality of virtual objects located on a first virtual plane that intersects a second virtual plane overlying a physical surface;
while the virtual cursor is displayed on the first virtual plane, receiving a first two-dimensional input via a surface input device, wherein the first two-dimensional input is reflective of an intent to select a first virtual object located on the first virtual plane;
in response to the first two-dimensional input, causing a first cursor movement toward the first virtual object, the first cursor movement being along the first virtual plane at a first pace;
while the virtual cursor is displayed on the first virtual plane, receiving a second two-dimensional input via the surface input device, wherein the second two-dimensional input is reflective of an intent to select a second virtual object that appears on the physical surface; and
in response to the second two-dimensional input, causing a second cursor movement toward the second virtual object, the second cursor movement including a partial movement along the first virtual plane and a partial movement along the second virtual plane, wherein the movement along the second virtual plane is at a second pace, and the second pace differs from the first pace.