CPC G06V 20/20 (2022.01) [G06F 18/40 (2023.01); G06N 20/00 (2019.01); G06Q 30/0625 (2013.01); G06T 11/00 (2013.01); G06V 10/25 (2022.01); H04N 23/617 (2023.01); H04N 23/635 (2023.01); H04N 23/80 (2023.01)] | 20 Claims |
1. A method, comprising:
obtaining, by a system process of a computing device, an image being displayed by an application at the computing device;
identifying, by the system process and responsive to providing the image to one or more machine learning models at the computing device, an element of interest in the image, the identifying further comprising:
identifying a plurality of elements in the image using the one or more machine learning models;
ranking the plurality of elements based on a ranking algorithm; and
based on the ranking, determining the element of interest, from amongst the plurality of elements; and
displaying a visual indicator for the element of interest overlaid on the image at a location corresponding to the element of interest, wherein the visual indicator is selectable to cause a display of information associated with the element of interest.
|