US 11,868,583 B2
Tangible six-degree-of-freedom interfaces for augmented reality
Ruofei Du, San Francisco, CA (US); Alex Olwal, Santa Cruz, CA (US); Mathieu Simon Le Goc, San Francisco, CA (US); David Kim, Zug (CH); and Danhang Tang, Los Angeles, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Mar. 28, 2022, as Appl. No. 17/656,818.
Prior Publication US 2023/0305672 A1, Sep. 28, 2023
Int. Cl. G06F 3/04815 (2022.01); G02B 27/01 (2006.01); G10L 15/22 (2006.01)
CPC G06F 3/04815 (2013.01) [G02B 27/0172 (2013.01); G02B 27/0176 (2013.01); G10L 15/22 (2013.01); G02B 2027/0178 (2013.01); G10L 2015/223 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
capturing, by a camera of a computing device, image data associated with an ambient environment;
identifying, in the image data, a physical object in the ambient environment;
detecting an input to associate a virtual user interface with the physical object;
designating the physical object as a physical user interface apparatus in response to the input;
triggering display, by a display device of the computing device, of the virtual user interface as a virtual object overlaid on the physical object in the ambient environment;
attaching the virtual object corresponding to the virtual user interface to the physical object;
mapping at least one virtual feature of the virtual user interface to at least one physical feature of the physical object to enable coordinated movement of the virtual user interface with the physical object;
detecting a physical manipulation of the physical object designated as the physical user interface apparatus;
associating the physical manipulation of the physical object with a corresponding user interaction with the virtual user interface attached to the physical object; and
in response to the physical manipulation of the physical object and the corresponding user interaction with the virtual user interface, triggering a change in a control algorithm associated with the virtual user interface corresponding to the physical manipulation of the physical object and the corresponding user interaction with the virtual user interface.