US 11,809,887 B2
Computing system for macro generation, modification, verification, and execution
Edward Hinton, Dover, NH (US); Frank Pulito, Berlin, MA (US); Greg Giannone, Ayer, MA (US); Jonathan Ferrin, Derry, NH (US); and Zachary Chupka, Pelham, NH (US)
Assigned to Hyland Software, Inc.
Filed by Hyland Software, Inc., Westlake, OH (US)
Filed on Sep. 17, 2021, as Appl. No. 17/478,504.
Application 17/478,504 is a continuation of application No. 16/545,628, filed on Aug. 20, 2019, granted, now 11,144,338.
Prior Publication US 2022/0004409 A1, Jan. 6, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/0484 (2022.01); G06F 3/0481 (2022.01); G06F 9/46 (2006.01); G06F 9/455 (2018.01); G06F 3/023 (2006.01); G06F 9/448 (2018.01); G06F 9/54 (2006.01); G06F 3/0346 (2013.01); G06F 3/04895 (2022.01); G06F 3/04842 (2022.01); G06F 11/34 (2006.01); G06F 3/0482 (2013.01); G06F 9/451 (2018.01)
CPC G06F 9/45512 (2013.01) [G06F 3/023 (2013.01); G06F 9/448 (2018.02); G06F 9/544 (2013.01); G06F 3/0238 (2013.01); G06F 3/0346 (2013.01); G06F 3/0482 (2013.01); G06F 3/0484 (2013.01); G06F 3/04842 (2013.01); G06F 3/04895 (2013.01); G06F 9/451 (2018.02); G06F 9/455 (2013.01); G06F 9/541 (2013.01); G06F 9/542 (2013.01); G06F 11/3438 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computing system, comprising:
a processor; and
memory storing an automation application that, when executed by the processor, causes the processor to perform acts comprising:
obtaining a macro for a target application, wherein the macro has been generated based upon:
a sequence of inputs received by the target application from a user, wherein the sequence of inputs causes the target application to perform an action;
screen states of the target application as the target application receives the sequence of inputs from the user; and
operating system processes that are performed by an operating system executing concurrently with the target application as the target application receives the sequence of inputs from the user; and
executing the macro, wherein executing the macro causes the automation application to mimic the sequence of inputs to the target application, thereby causing the target application to perform the action;
wherein the screen states include screenshots of the target application; and one or both of:
characteristics of a display; or
font characteristics of the target application.