| CPC G06F 40/169 (2020.01) [G06F 16/906 (2019.01); G06F 16/9535 (2019.01); G06F 16/9577 (2019.01); G06F 40/123 (2020.01); G06F 40/14 (2020.01)] | 31 Claims |

|
1. A method comprising:
analyzing a web page rendered for a user to identify visual elements in the web page;
generating, for each of the identified visual elements, uniform visual element identifiers (UVEIs), each of the UVEIs uniquely identifying a corresponding one of the identified visual elements;
associating, with each of the UVEIs, at least one of: information regarding the web page, distinctive information of the corresponding one of the visual elements, distinctive properties of the corresponding one of the visual elements, or relative position information of the corresponding one of the visual elements in the web page;
identifying, for each of the visual elements, cluster information to interrelate the visual elements within the web page, the cluster information identifying clusters of interrelated visual elements based on respective relative position of the visual elements, respective functional relationships of the visual elements with other visual elements, or both;
associating with at least one of the visual elements or a cluster of interrelated visual elements an application that dynamically processes and/or manipulates at least one of the visual elements or the cluster of interrelated visual elements;
re-analyzing the web page in response to the web page being subsequently rendered as a re-rendered web page to re-identify each of the visual elements in the re-rendered web page;
generating, for each of the visual elements identified in the re-rendered web page, new uniform visual identifiers (nUVEIs), each of the nUVEIs uniquely identifying a corresponding one of the visual elements identified in the re-rendered web page;
associating, with each of the nUVEIs, at least one of: information regarding the re-rendered web page, distinctive information of the corresponding one of the visual elements identified in the re-rendered web page, distinctive properties of the corresponding one of the visual elements identified in the re-rendered web page, or relative position information of the corresponding one of the visual elements in the re-rendered web page;
comparing the nUVEIs with the UVEIs and associating the nUVEIs with the UVEIs based on a predefined threshold of similarity; and
adapting respective execution procedures of the application for the nUVEIs in accordance with association and comparison of the nUVEIs and the UVEIs.
|