US 12,436,601 B2
Method for generating a virtual user interface
Rony Abovitz, Dania Beach, FL (US); Brian T. Schowengerdt, Seattle, WA (US); and Mathew D. Watson, Bellevue, WA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by MAGIC LEAP, INC., Plantation, FL (US)
Filed on May 22, 2023, as Appl. No. 18/321,124.
Application 18/321,124 is a continuation of application No. 17/485,941, filed on Sep. 27, 2021, granted, now 11,656,677.
Application 17/485,941 is a continuation of application No. 14/707,513, filed on May 8, 2015, granted, now 11,221,213, issued on Jan. 11, 2022.
Application 14/707,513 is a continuation of application No. 14/696,347, filed on Apr. 24, 2015, granted, now 9,612,403, issued on Apr. 4, 2017.
Application 14/696,347 is a continuation of application No. 14/331,218, filed on Jul. 14, 2014, granted, now 9,671,566, issued on Jun. 6, 2017.
Application 14/707,513 is a continuation in part of application No. 14/641,376, filed on Mar. 7, 2015, granted, now 9,874,749, issued on Jan. 23, 2018.
Claims priority of provisional application 61/845,907, filed on Jul. 12, 2013.
Claims priority of provisional application 62/012,273, filed on Jun. 14, 2014.
Claims priority of provisional application 61/950,001, filed on Mar. 7, 2014.
Prior Publication US 2023/0367387 A1, Nov. 16, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); A61B 34/10 (2016.01); A63F 13/00 (2014.01); A63F 13/213 (2014.01); A63F 13/428 (2014.01); G01B 11/30 (2006.01); G02B 6/10 (2006.01); G02B 6/34 (2006.01); G02B 27/01 (2006.01); G02B 27/42 (2006.01); G06F 3/00 (2006.01); G06F 3/03 (2006.01); G06F 3/04815 (2022.01); G06F 3/04842 (2022.01); G06F 3/04845 (2022.01); G06F 3/0485 (2022.01); G06F 3/0487 (2013.01); G06F 3/04883 (2022.01); G06F 16/783 (2019.01); G06F 18/22 (2023.01); G06Q 30/0601 (2023.01); G06T 7/60 (2017.01); G06T 19/00 (2011.01); G06V 10/75 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/40 (2022.01); G06V 20/64 (2022.01); G06V 40/20 (2022.01); G16H 40/00 (2018.01); G16H 40/20 (2018.01); G16H 40/67 (2018.01); H04B 10/25 (2013.01); G06V 40/10 (2022.01)
CPC G06F 3/011 (2013.01) [A61B 34/10 (2016.02); A63F 13/00 (2013.01); A63F 13/213 (2014.09); A63F 13/428 (2014.09); G01B 11/303 (2013.01); G02B 6/10 (2013.01); G02B 6/34 (2013.01); G02B 27/0101 (2013.01); G02B 27/017 (2013.01); G02B 27/0172 (2013.01); G02B 27/42 (2013.01); G02B 27/4205 (2013.01); G02B 27/4227 (2013.01); G06F 3/005 (2013.01); G06F 3/013 (2013.01); G06F 3/017 (2013.01); G06F 3/0304 (2013.01); G06F 3/04815 (2013.01); G06F 3/04842 (2013.01); G06F 3/04845 (2013.01); G06F 3/0485 (2013.01); G06F 3/0487 (2013.01); G06F 3/04883 (2013.01); G06F 16/7837 (2019.01); G06F 18/22 (2023.01); G06Q 30/0643 (2013.01); G06T 7/60 (2013.01); G06T 19/006 (2013.01); G06V 10/758 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/40 (2022.01); G06V 20/653 (2022.01); G06V 40/28 (2022.01); G16H 40/00 (2018.01); G16H 40/20 (2018.01); G16H 40/67 (2018.01); H04B 10/25891 (2020.05); A61B 2034/101 (2016.02); G02B 2027/0105 (2013.01); G02B 2027/0127 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0178 (2013.01); G02B 2027/0185 (2013.01); G02B 2027/0187 (2013.01); G06T 2200/04 (2013.01); G06T 2200/24 (2013.01); G06T 2207/10004 (2013.01); G06T 2207/30196 (2013.01); G06T 2210/41 (2013.01); G06T 2219/024 (2013.01); G06V 40/113 (2022.01)] 17 Claims
OG exemplary drawing
 
1. A method for generating a virtual user interface, comprising:
detecting a first gesture involving a hand of a user;
rendering, in real-time and in response to detecting the first gesture involving the hand of the user, a first virtual user interface related to the hand of the user, the first virtual interface including a first level menu item comprising a high level navigation menu item, icon or field, rendered and appearing on each of a plurality of first portions of the hand of the user;
detecting, at each said first portion, a second gesture involving the hand of the user;
rendering, in real-time and in response to detecting the second gesture involving the hand of the user, a second virtual user interface related to the hand of the user, said second virtual user interface including a plurality of discrete second level menu items, each appearing to be on or attached to an associated first level menu item at an associated first portion,
and
wherein the second virtual user interface comprises each said second level menu item expanding from and related to an associated first level menu item.