US 12,299,466 B2
Graphical user interface for macro generation, modification, and verification
Edward Hinton, Dover, NH (US); Frank Pulito, Berlin, MA (US); Greg Giannone, Ayer, MA (US); Jonathan Ferrin, Derry, NH (US); and Zachary Chupka, Pelham, NH (US)
Assigned to Hyland Software, Inc., Westlake, OH (US)
Filed by Hyland Software, Inc., Westlake, OH (US)
Filed on May 15, 2023, as Appl. No. 18/317,172.
Application 18/317,172 is a continuation of application No. 17/556,589, filed on Dec. 20, 2021, granted, now 11,720,381.
Application 17/556,589 is a continuation of application No. 16/564,665, filed on Sep. 9, 2019, granted, now 11,204,789.
Application 16/564,665 is a continuation in part of application No. 16/545,628, filed on Aug. 20, 2019, granted, now 11,144,338, issued on Oct. 12, 2021.
Prior Publication US 2023/0281029 A1, Sep. 7, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 11/07 (2006.01); G06F 8/34 (2018.01); G06F 8/35 (2018.01); G06F 9/44 (2018.01); G06F 9/455 (2018.01); G06F 16/901 (2019.01)
CPC G06F 9/45512 (2013.01) [G06F 8/34 (2013.01); G06F 16/9024 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method executed by a processor of a computing device while the processor executes an automation application, the method comprising:
building a computer-controlled macro for a target application, wherein the computer-controlled macro is generated based upon:
recording a sequence of inputs received by the target application from a user, wherein the sequence of inputs causes the target application to perform an action;
recording a series of input timestamps, wherein an input timestamp is associated with each input of the sequence of inputs;
assigning one or more state timestamps to at least one of:
a screen state of the target application when the target application receives an input of the sequence of inputs or
operating system processes performed by the processor when the target application receives the input;
storing an order of the input timestamps for the sequence of inputs, and storing the state timestamps; and
executing the computer-controlled macro on the target application, by performing the actions on the target application in correct order, utilizing the order of the input timestamps and one or more state timestamps;
wherein the sequence of inputs comprises a first input and a second input, and the series of input timestamps comprises a first input timestamp and a second input timestamp and the one or more state timestamps comprise a first state timestamp and a second state timestamp;
wherein the first input timestamp is assigned to the first input, and the first state timestamp is assigned:
the screen state of the target application when the target application receives the input or the operating system processes performed by the processor when the target application receives the input; and
the second input timestamp is assigned to a second input, and a second state timestamp is assigned to second instance of:
the screen state of the target application when the target application receives the input or the operating system processes performed by the processor when the target application receives the input.