US 12,282,801 B2
Instruction interpretation for web task automation
Karan Walia, Brampton (CA); Anton Mamonov, Toronto (CA); and Sobi Walia, Brampton (CA)
Assigned to Karan Walia; Anton Mamonov; and Sobi Walia
Filed by YAAR INC., Toronto (CA)
Filed on Aug. 5, 2021, as Appl. No. 17/395,164.
Prior Publication US 2023/0045426 A1, Feb. 9, 2023
Int. Cl. G06F 9/48 (2006.01); G06F 40/14 (2020.01); G06F 40/279 (2020.01); G06F 40/30 (2020.01); G06F 40/40 (2020.01)
CPC G06F 9/4881 (2013.01) [G06F 40/14 (2020.01); G06F 40/279 (2020.01); G06F 40/30 (2020.01); G06F 40/40 (2020.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving a natural language instruction describing a sequence of actions representative of a manner in which a human would interact with a web browser to perform the actions on web elements of at least one web page, wherein an instruction performance skeleton is based on the natural language instruction;
storing the instruction performance skeleton in a database, wherein the instruction performance skeleton is representative of performance of the actions and includes respective key-value pairs associated with each of the actions; and
concurrently performing a first action of the actions in a first webview of the web browser in parallel with a second action of the actions in a different second webview of the web browser, wherein:
the first webview comprises a first object model of the at least one web page and the second webview comprises a second object model of the at least one web page, and
the first object model comprises a first plurality of the web elements and the second object model comprises a second plurality of the web elements.