US 12,423,926 B2
XR multi-window control
Young-Cheol Yu, Palo Alto, CA (US); Yuya Tanaka, Palo Alto, CA (US); and Yoji Osako, Palo Alto, CA (US)
Assigned to NTT DOCOMO, INC., Tokyo (JP)
Filed by NTT DOCOMO, INC., Tokyo (JP)
Filed on Mar. 9, 2023, as Appl. No. 18/119,708.
Claims priority of provisional application 63/393,175, filed on Jul. 28, 2022.
Prior Publication US 2024/0037865 A1, Feb. 1, 2024
Int. Cl. G06T 19/00 (2011.01); G06F 3/01 (2006.01); G06F 3/04815 (2022.01)
CPC G06T 19/006 (2013.01) [G06F 3/017 (2013.01); G06F 3/04815 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for performing multi-window control in a user interface, the method comprising:
displaying the user interface in a display of a virtual environment created by an extend reality (XR) device, the user interface including a single graphical user interface (GUI) element and a number of objects;
detecting selection of the GUI element in the UI, wherein the single GUI element is a gather button;
in response to detecting selection of the GUI element, gathering a set of manipulatable objects being displayed in the virtual environment and scattered in an area in the virtual environment in which a user is located, by moving objects in the set of objects into a window on the display in front of the user where each object in the set of objects may be selected;
detecting a selection of one or more objects in the set of manipulatable objects by tracking movement of the user;
displaying selected objects of the one or more manipulatable objects in front of a user and returning non-selected objects to their location in the virtual environment prior to being moved into the window;
selecting one or more operations from a set of operations to perform on at least one of the selected objects, wherein the set of operations comprises rotating the at least one selected object, scaling the at least one selected object, and moving the at least one object;
in response to selecting the one or more operations, performing the one or more operations on the at least one of the selected objects; and
returning the selected objects to their location in the virtual environment prior to being moved into the window, wherein any altering of the selected objects that resulted from performing the one or more operations remains after returning the selected objects to their location in the virtual environment.