US 11,789,532 B1
System and method for navigating on an augmented reality display
Shailendra Singh, Maharashtra (IN)
Assigned to Bank of America Corporation, Charlotte, NC (US)
Filed by Bank of America Corporation, Charlotte, NC (US)
Filed on Jan. 12, 2023, as Appl. No. 18/153,975.
Application 18/153,975 is a continuation of application No. 17/747,568, filed on May 18, 2022, granted, now 11,586,286.
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); G02B 27/01 (2006.01); G02B 27/00 (2006.01); G06T 19/00 (2011.01)
CPC G06F 3/013 (2013.01) [G02B 27/0093 (2013.01); G02B 27/0101 (2013.01); G02B 27/017 (2013.01); G02B 27/0179 (2013.01); G06F 3/012 (2013.01); G06T 19/006 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0187 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for navigating on an augmented reality display, comprising:
a memory configured to store:
a mapping table comprising a mapping between each of a plurality of elements of a web application and a respective element attribute, such that:
a first element from among the plurality of elements is mapped to a first element attribute; and
a second element from among the plurality of elements is mapped to a second element attribute;
a processor, operably coupled to the memory, and configured to:
receive, from an augmented reality device, a first image of the web application that shows the first element;
receive, from the augmented reality device, eye tracking information that indicates eye movements of a user as the user is looking at different elements on the web application;
determine, based at least in part upon the eye tracking information, that the user is looking at a first location coordinate on the first image of the web application;
determine a location of the first element associated with the first location coordinate;
identify the first element attribute that is associated with the first element;
generate an augmented reality message comprising the first element attribute;
generate an augmented reality display in which the augmented reality message is presented as a virtual object;
anchor the augmented reality message to the first location coordinate on the augmented reality display; and
communicate the augmented reality display to the augmented reality device, such that the augmented reality display is superimposed on a field of view that shows the web application as seen by the user using the augmented reality device.