US 11,886,327 B2
Training a system to recognize scroll bars in an application under test
Gaoyang Zhou, Shanghai (CN); YunSheng Liu, Shanghai (CN); and ChengZhe Xu, Shanghai (CN)
Assigned to Micro Focus LLC, Santa Clara, CA (US)
Filed by MICRO FOCUS LLC, Santa Clara, CA (US)
Filed on May 24, 2022, as Appl. No. 17/752,751.
Prior Publication US 2023/0385184 A1, Nov. 30, 2023
Int. Cl. G06F 11/36 (2006.01); G06N 3/08 (2023.01); G06F 3/04855 (2022.01); G06F 18/22 (2023.01); G06F 18/214 (2023.01)
CPC G06F 11/3684 (2013.01) [G06F 3/04855 (2013.01); G06F 18/214 (2023.01); G06F 18/22 (2023.01); G06N 3/08 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A method for training a system to recognize scroll bars, comprising:
executing an application under test and wherein the system provides machine-generated inputs to a graphical user interface (GUI) of the application under test and observes outputs from the application under test via the GUI;
capturing a first image of the GUI at a first time;
after the first time, providing the GUI with a mouse input comprising a machine-generated mouse middle-button input;
capturing a second image of the GUI at a second time after the mouse input;
obtaining a difference image comprising a difference between the first image and the second image;
determining whether the difference image comprises an altered mouse pointer; and
upon determining that the difference image does comprise the altered mouse pointer, causing a test of a set of tests of the application under test in accordance with the GUI comprising a scroll bar.