US 12,112,513 B2
System and method for identifying non-standard user interface object
Hyo Young Kim, Seoul (KR); Koo Hyun Park, Seoul (KR); and Keun Taek Park, Seoul (KR)
Assigned to SAMSUNG SDS CO., LTD., Seoul (KR)
Filed by SAMSUNG SDS CO., LTD., Seoul (KR)
Filed on Oct. 27, 2021, as Appl. No. 17/511,711.
Claims priority of application No. 10-2020-0140598 (KR), filed on Oct. 27, 2020.
Prior Publication US 2022/0129691 A1, Apr. 28, 2022
Int. Cl. G06V 10/20 (2022.01); G06F 16/22 (2019.01); G06F 18/22 (2023.01); G06V 10/75 (2022.01); G06V 30/10 (2022.01); G06V 30/19 (2022.01)
CPC G06V 10/255 (2022.01) [G06F 16/2282 (2019.01); G06F 18/22 (2023.01); G06V 10/751 (2022.01); G06V 30/1912 (2022.01); G06V 30/19127 (2022.01); G06V 30/10 (2022.01)] 14 Claims
OG exemplary drawing
 
1. A non-standard user interface object identification system comprising:
an object candidate extractior extracting one or more objects from an image;
a first similarity analyzer determining object type candidates of the one or more objects in accordance with similarities between the one or more objects and a standard user interface (UI) element;
a second similarity analyzer selecting object type-specific weight values in accordance with layout characteristics of the one or more objects and determining object types of the one or more objects using the object type candidates and the object type-specific weight values; and
an object identifier receiving type and characteristic information of a search target object and identifying the search target object in accordance with characteristic information and the object types of the one or more objects,
wherein the second similarity analyzer generates one or more groups from the one or more objects in accordance with similarities of position information of the one or more objects and selects one among a plurality of object type-specific weight values in consideration of positions of the one or more groups in the image.