| CPC A61B 34/20 (2016.02) [A61B 34/10 (2016.02); A61B 34/25 (2016.02); A61B 90/36 (2016.02); G06F 3/016 (2013.01); G06T 15/08 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); A61B 2034/102 (2016.02); A61B 2090/365 (2016.02); A61B 2560/0295 (2013.01); G06T 2200/24 (2013.01); G06T 2219/004 (2013.01); G06T 2219/2012 (2013.01); G06T 2219/2016 (2013.01)] | 37 Claims |
|
1. A workstation for multidimensional data visualization and interaction in an augmented reality (AR), virtual reality (VR), or mixed reality (MR) environment, said workstation comprising at least one of:
an application state module adapted to:
maintain a plurality of virtual scenes which describe distinct states of the application and include data and contents presented in AR/VR/MR,
manage a plurality of application systems and corresponding system data, and
allow querying and interaction with said application systems and the corresponding system data;
the plurality of application systems adapted to create, read, modify, or destroy the corresponding system data and execute relevant application commands;
the plurality of system data comprising at least one of:
multidimensional data, including 3D volume data, or 2D image data, 3D or 2D geometry data,
user input data, including hand position and orientation data, head position and orientation data, or controller input data, user interaction data, and informational data;
a save/load module adapted to save the plurality of system data from memory to files, and load the plurality of system data from the files into the memory;
an undo/redo module adapted to undo or redo user operations;
a networking module adapted to support multi-user collaboration over the network;
a state change router adapted to:
receive a command to create, modify, or destroy the corresponding system data, and
send the received command to the application state module, the undo/redo module, or the networking module for creating, modifying, or destroying the corresponding system data;
a plurality of view controllers adapted to:
query a public interface of the application state for the state of one or more application systems,
subscribe to events that will trigger if at least a portion of the plurality of system data changes, and
issue the commands to create, modify, or destroy the system data based on user instruction with plurality of interaction features;
an AR/VR interface adapted to update the user input data from one or more AR/VR devices to at least one of: an AR/VR graphical user interface (GUI), or the plurality of view controllers; and
a graphics rendering module adapted to:
receive the system data from the plurality of view controllers,
visualize the data on at least one of: 2D space or 3D space via a plurality of graphics rendering mechanisms, and
display the visualizations on at least one of: a display device, or a GUI.
|