US 12,217,480 B1
Detecting and monitoring unauthorized uses of visual content
Dmitriy Karpman, San Francisco, CA (US); Kevin Guo, San Francisco, CA (US); and Ryan Weber, San Francisco, CA (US)
Assigned to CASTLE GLOBAL, INC., San Francisco, CA (US)
Filed by Castle Global, Inc., San Francisco, CA (US)
Filed on Jan. 24, 2024, as Appl. No. 18/421,825.
Claims priority of provisional application 63/481,375, filed on Jan. 24, 2023.
Int. Cl. G06V 10/74 (2022.01); G06F 16/951 (2019.01); G06F 16/953 (2019.01); G06V 10/77 (2022.01); G06V 10/94 (2022.01)
CPC G06V 10/761 (2022.01) [G06F 16/951 (2019.01); G06F 16/953 (2019.01); G06V 10/7715 (2022.01); G06V 10/95 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving query content that includes first visual data;
selecting reference content that includes second visual data;
determining a model, wherein the model comprises:
a first sub-model that is trained with a first training dataset to output a first score based on a comparison of a content pair to detect visible alterations in the content pair, and
a second sub-model that is trained with a second training dataset to output a second score based on a comparison of a content pair for a visible match as distinguishable by a human wherein the second sub-model outputs a higher second score for similarity when visible identifiable, wherein the first sub-model is trained to output a higher score for similarity than the second sub-model when visible alterations are found in the content pair and are identifiable by the human;
generating a first visual feature mapping for the query content using the first sub-model and the second sub-model;
determining a second visual feature mapping for the reference content, wherein the second visual feature mapping is determined using the first sub-model and the second sub-model of the model;
comparing the first visual feature mapping and the second visual feature mapping for the first sub-model and the second sub-model to generate a third score that rates a similarity between the query content and the reference content; and
outputting the third score.