US 12,405,809 B2
GUI element acquisition using a plurality of alternative representations of the GUI element
Ron Zohar, Givatayim (IL); Moran Shemer, Ra'anana (IL); and Nir Nahum, Tel Aviv (IL)
Assigned to Walkme LTD., Tel Aviv (IL)
Filed by WalkMe Ltd., Tel Aviv (IL)
Filed on Oct. 28, 2021, as Appl. No. 17/513,291.
Application 17/513,291 is a continuation of application No. PCT/IL2019/050475, filed on Apr. 30, 2019.
Prior Publication US 2022/0050564 A1, Feb. 17, 2022
Int. Cl. G06F 9/451 (2018.01); G06F 3/0482 (2013.01); G06F 3/0484 (2022.01); G06F 16/953 (2019.01); G06F 16/958 (2019.01)
CPC G06F 9/451 (2018.02) [G06F 3/0482 (2013.01); G06F 3/0484 (2013.01); G06F 16/953 (2019.01); G06F 16/972 (2019.01)] 29 Claims
OG exemplary drawing
 
1. A method comprising:
obtaining multiple representations of a Graphical User Interface (GUI) element in a first page, wherein the multiple representations comprise alternative representations of the GUI element that enable to identify the GUI element in the first page, whereby acquisition of the GUI element in the first page is enabled using each alternative representation of the GUI element individually, wherein the multiple representations comprise first and second alternative representations of the GUI element, the first alternative representation different from the second alternative representation, wherein the first alternative representation comprises a first plurality of attributes of the GUI element in the first page, wherein the second alternative representation comprises a second plurality of attributes of the GUI element in the first page, wherein the first alternative representation of the GUI element utilizes a first combination of the first plurality of attributes to represent the GUI element, wherein the second alternative representation of the GUI element of utilizes a second combination of the second plurality of attributes to represent the GUI element, wherein the first alternative representation is sufficient for acquiring the GUI element in the first page, wherein the second alternative representation is sufficient for acquiring the GUI element in the first page;
applying the multiple representations of the GUI element over a second page in order to identify the GUI element in the second page, wherein said applying comprises separately applying each representation of the multiple representations over the second page, wherein said applying comprises separately applying the first and second alternative representations of the GUI element over the second page;
identifying the GUI element in the second page by determining that all of the multiple representations of the GUI element identify only one same element in the second page, wherein said identifying comprises identifying that applying the first alternative representation in the second page identities only the one same element in the second page, and that applying the second alternative representation identifies only the one same element in the second page, thereby acquiring the GUI element over the first and second pages; and
performing an operation on the second page based on the GUI element being acquired in the second page.