US 12,293,157 B2
Semantic matching between a source screen or source data and a target screen using semantic artificial intelligence
Mircea Neagovici, Bucharest (RO); and Cosmin Voicu, Bucharest (RO)
Assigned to UiPath, Inc., New York, NY (US)
Filed by UiPath, Inc., New York, NY (US)
Filed on Dec. 20, 2022, as Appl. No. 18/068,642.
Application 18/068,642 is a continuation of application No. 17/494,744, filed on Oct. 5, 2021, granted, now 12,124,806.
Prior Publication US 2023/0125223 A1, Apr. 27, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 40/30 (2020.01); G06F 3/0481 (2022.01); G06F 40/289 (2020.01); G06N 20/00 (2019.01); G06V 30/148 (2022.01); G06F 17/10 (2006.01); G06F 17/18 (2006.01); G06F 30/20 (2020.01); G06V 30/10 (2022.01)
CPC G06F 40/30 (2020.01) [G06F 3/0481 (2013.01); G06F 40/289 (2020.01); G06N 20/00 (2019.01); G06V 30/153 (2022.01); G06F 17/10 (2013.01); G06F 17/18 (2013.01); G06F 30/20 (2020.01); G06V 30/10 (2022.01)] 27 Claims
OG exemplary drawing
 
1. A non-transitory computer-readable medium storing a computer program, wherein the computer program is configured to cause at least one processor to:
extract data from a source application or a data source after receiving user input via a data extraction interface;
predict a type of the source application or the data source using a classification algorithm;
receive an indication of a target application to copy the extracted data into, via a semantic copy and paste interface;
call one or more artificial intelligence/machine learning (AI/ML) models that have been trained to perform semantic matching between labels in a user interface of the source application and labels in a user interface of the target application, between data elements in the data source and the labels in the user interface of the target application, or both; and
based on the predicted type of the source application or the data source and the semantic matching, automatically copy the extracted data from the source application or data source into the target application, via the semantic copy and paste interface, wherein
at least one field in the user interface of the target application differs from one or more fields of the user interface of the source application and/or one or more data elements from the source data.