US 11,782,734 B2
Method and system for text extraction from an application window for robotic process automation
Hasmukh Meghabhai Ginoya, Vadodara (IN); and Mahendra Parsottambhai Gajera, Vadodara (IN)
Assigned to Automation Anywhere, Inc., San Jose, CA (US)
Filed by Automation Anywhere, Inc., San Jose, CA (US)
Filed on Dec. 22, 2020, as Appl. No. 17/131,674.
Prior Publication US 2022/0197674 A1, Jun. 23, 2022
Int. Cl. G06F 40/279 (2020.01); G06F 9/451 (2018.01); G06F 9/445 (2018.01); G06F 3/14 (2006.01)
CPC G06F 9/451 (2018.02) [G06F 3/14 (2013.01); G06F 9/44521 (2013.01); G06F 40/279 (2020.01)] 16 Claims
OG exemplary drawing
 
1. A computer-implemented method for facilitating robotic process automation, the method comprising:
identifying a software automation process that facilitates automation of a previously captured series of user interactions;
initiating execution of the software automation process, the software automation process configured to interact with at least one user interface produced by an application program operating on the at least one computing device, the at least one user interface presented on a display screen associated with at least one computing device;
locating data content within the user interface as stored in memory of the at least one computing device that is allocated to the application program;
accessing the data content for the at least one user interface from the memory of the at least one computing device allocated to the application program;
determining text within the at least one user interface based on the accessed data content; and
affecting a programmatic action with respect to the application program, the programmatic action being requested by the software automation process based at least in part on the determined text.