US 11,900,662 B2
Method, apparatus, and computer program product for training a signature encoding module and a query processing module to identify objects of interest within an image utilizing digital signatures
Ofer Melnik, Weehawken, NJ (US); and Mark Thompson, Lake Forest Park, WA (US)
Assigned to HERE GLOBAL B.V., Eindhoven (NL)
Filed by HERE Global B.V., Eindhoven (NL)
Filed on Dec. 16, 2020, as Appl. No. 17/123,935.
Prior Publication US 2022/0188346 A1, Jun. 16, 2022
Int. Cl. G06V 10/82 (2022.01); G06F 16/51 (2019.01); G06F 16/583 (2019.01); G06F 16/535 (2019.01); G06V 10/40 (2022.01)
CPC G06V 10/82 (2022.01) [G06F 16/51 (2019.01); G06F 16/535 (2019.01); G06F 16/5854 (2019.01); G06V 10/40 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method for generating and utilizing a digital signature to identify an object of interest, the method comprising:
concurrently training both a signature encoding module, to generate one or more digital signatures representative of one or more objects of interest, and a query processing module to identify the one or more objects of interest within an image, each module including a plurality of neural network layers, wherein concurrently training both the signature encoding module and the query processing module further comprises:
providing the signature encoding module with a first reference image containing a first object of interest that is marked within the first reference image;
generating a first digital signature of the first object of interest and at least some context associated with the first object of interest in the first reference image;
providing the query processing module with a first query image and the first digital signature representing the first object of interest and at least some of the context associated with the first object of interest in the first reference image;
identifying a second object of interest within the first query image based upon the first digital signature of the first object of interest; and
modifying at least one of the signature encoding module or the query processing module based upon a qualitative or quantitative difference between the first object of interest marked in the first reference image and the second object of interest identified within the first query image;
providing a reference image containing the object of interest to the signature encoding module, wherein an indication of the object of interest within the reference image is also provided;
generating, with the signature encoding module, the digital signature representing the object of interest and at least some context associated with the object of interest in the reference image;
providing (i) the digital signature representing the object of interest and at least some of the context associated with the object of interest and (ii) at least one query image to the query processing module; and
identifying, by the query processing module, the object of interest within the at least one query image based upon the digital signature of the object of interest.