US 12,277,267 B2
Two-way communication between head-mounted display and electroanatomic system
Jennifer N. Avari Silva, St. Louis, MO (US); Jonathan R. Silva, St. Louis, MO (US); Michael K. Southworth, St. Louis, MO (US); Ignacio Soriano, Madrid (ES); Matthew Dagley, Chicago, IL (US); Christopher Michael Andrews, Chesterfield, MO (US); Sharif Razzaque, St. Louis, MO (US); Irene Hougard, St. Louis, MO (US); and Berk Tas, Eden Prairie, MN (US)
Assigned to SentiAR, Inc., St. Louis, MO (US)
Filed by SentiAR, Inc., St. Louis, MO (US)
Filed on Apr. 21, 2023, as Appl. No. 18/305,121.
Claims priority of provisional application 63/333,900, filed on Apr. 22, 2022.
Prior Publication US 2023/0341932 A1, Oct. 26, 2023
Int. Cl. G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06F 3/14 (2006.01); G06T 19/00 (2011.01)
CPC G06F 3/013 (2013.01) [G06F 3/04815 (2013.01); G06F 3/1423 (2013.01); G06T 19/006 (2013.01); G06T 2200/24 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
a head-mounted display (HMD) worn by a user, wherein the HMD is configured to display an augmented reality graphic;
a display monitor; and
a processing system configured to:
provide image data for display by the HMD based on data provided to the display monitor for a user interface displayed by the display monitor,
wherein the image data includes a collection of 3D voxels;
receive, from the HMD, a gaze direction of the user;
determine a position of a cursor displayed on the user interface based on the gaze direction of the user;
provide the position of the cursor to the display monitor to update display of the cursor on the display monitor;
pre-process the image data based on the gaze direction of the user by sorting the collection of 3D voxels; and
provide the pre-processed image data to the HMD, wherein the HMD further processes the pre-processed image data by performing an additional sort of a subset of the sorted collection of 3D voxels to account for change in the gaze direction of the user and to display the augmented reality graphic.