US 11,656,881 B2
Detecting repetitive patterns of user interface actions
Nikolay Ryabikin, Nizhniy Novgorod (RU); Vasily Loginov, Moscow (RU); and Ruslan Garashchuk, Moscow (RU)
Assigned to ABBYY Development Inc., Dover, DE (US)
Filed by ABBYY Development Inc., Dover, DE (US)
Filed on Oct. 28, 2021, as Appl. No. 17/512,791.
Claims priority of application No. RU2021130755 (RU), filed on Oct. 21, 2021.
Prior Publication US 2023/0131542 A1, Apr. 27, 2023
Int. Cl. G06F 11/34 (2006.01); G06F 9/451 (2018.01); G06F 3/0481 (2022.01)
CPC G06F 9/451 (2018.02) [G06F 3/0481 (2013.01); G06F 11/3438 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method, comprising:
defining, by a processing device, a set of overlapping shingles on a sequence of user interface events;
grouping the shingles into a plurality of shingle clusters based on a chosen shingle similarity metric;
selecting a shingle cluster having a maximum, among the plurality of shingle clusters, value of a chosen intra-cluster shingle similarity metric;
labeling, in the sequence of user interface events, elements covered by shingles of the selected shingle cluster;
defining, on a sequence of user interface events, a second set of overlapping shingles of a predetermined shingle size;
responsive to determining that a value of the chosen shingle similarity metric of a shingle of the second set of overlapping shingles with respect to the selected shingle cluster exceeds a predefined threshold, appending the shingle to the selected shingle cluster; and
identifying a repetitive user interface operation represented by the selected shingle cluster.