US 11,657,579 B2
Interactions with 3D virtual objects using poses and multiple-DOF controllers
James M. Powderly, Ft. Lauderdale, FL (US); Savannah Niles, Ft. Lauderdale, FL (US); Frank Alexander Hamilton, IV, Plantation, FL (US); Marshal Ainsworth Fontaine, St. Augustine, FL (US); and Paul Armistead Hoover, Bothell, WA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Jun. 28, 2021, as Appl. No. 17/361,059.
Application 17/361,059 is a continuation of application No. 16/911,166, filed on Jun. 24, 2020, granted, now 11,049,328.
Application 16/911,166 is a continuation of application No. 16/682,851, filed on Nov. 13, 2019, granted, now 10,733,806, issued on Aug. 4, 2020.
Application 16/682,851 is a continuation of application No. 16/530,901, filed on Aug. 2, 2019, granted, now 10,510,191, issued on Dec. 17, 2019.
Application 16/530,901 is a continuation of application No. 16/053,620, filed on Aug. 2, 2018, granted, now 10,417,831, issued on Sep. 17, 2019.
Application 16/053,620 is a continuation of application No. 15/473,444, filed on Mar. 29, 2017, granted, now 10,078,919, issued on Sep. 18, 2018.
Claims priority of provisional application 62/325,679, filed on Apr. 21, 2016.
Claims priority of provisional application 62/316,030, filed on Mar. 31, 2016.
Prior Publication US 2022/0020218 A1, Jan. 20, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/0346 (2013.01); G06T 19/00 (2011.01); G06F 3/01 (2006.01); G06F 1/16 (2006.01)
CPC G06T 19/006 (2013.01) [G06F 3/011 (2013.01); G06F 3/0346 (2013.01); G06F 1/163 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
a display system of a wearable device configured to provide a three-dimensional (3D) view to a user and permit a user interaction with objects in a field of view (FOV) of the user, the FOV comprising a portion of an environment around the user that is capable of being perceived by the user via the display system;
a hardware processor in communication with the display system, the hardware processor programmed to:
initiate a cone cast of a virtual cone;
determine contextual information in the FOV of the user;
anchor a proximal end of the virtual cone to an anchoring location associated with a physical object designated by the user via a user input, wherein the user is enabled to anchor the proximal end to a pointing device and wherein the user is enabled to anchor the proximal end to the user, wherein movement of the anchoring location, designated by the user, associated with the physical object causes corresponding movement of the virtual cone so that the proximal end of the virtual cone remains at the anchoring location associated with the physical object, wherein the virtual cone further comprises a distal end, or a depth, and the hardware processor is programmed to anchor the the distal end, and/or the depth of the virtual cone to the physical object based on at least one of: a user input, a body gesture, a body pose, a direction of gaze, or a voice command;
determine one or more objects within the virtual cone anchored to the physical object; and
perform an action on one or more of the objects within the virtual cone anchored to the physical object.