US 12,407,882 B2
Displaying items relevant to a video
Valery Ushakov, Geneva (CH); Andrey Tatarinov, Geneva (CH); Aleksandr Kozlov, Geneva (CH); and Anna Zakutniaia, Geneva (CH)
Assigned to TAP Technologies SA, (CH)
Filed by TAP Technologies SA, Geneva (CH)
Filed on Sep. 6, 2023, as Appl. No. 18/461,768.
Claims priority of provisional application 63/405,148, filed on Sep. 9, 2022.
Prior Publication US 2024/0089522 A1, Mar. 14, 2024
Int. Cl. H04N 21/254 (2011.01); G06F 16/732 (2019.01); G06F 16/783 (2019.01); G06Q 30/0601 (2023.01); H04N 21/2187 (2011.01); H04N 21/4725 (2011.01)
CPC H04N 21/2542 (2013.01) [G06F 16/7328 (2019.01); G06F 16/7837 (2019.01); G06Q 30/0601 (2013.01); H04N 21/2187 (2013.01); H04N 21/4725 (2013.01)] 23 Claims
OG exemplary drawing
 
1. A method suitable for product placement in which items, such as products, are displayed in synchronisation with a video, the method comprising:
predefining, in a database of records, an association between a set of items, and a corresponding set of video time locations of a video;
at an arbitrary time during display of the video on a screen of a video content player:
capturing images of the screen with a user device;
generating a video search query derived from the captured images of the video;
querying the database with the video search query to:
identify the video being displayed on the screen of the video content player; and
locate the set of items that are associated with the video time location corresponding to the arbitrary time at which the images were captured by the user device; and
displaying the set of items located by the video search query in synchronisation with the video being displayed of the screen of the video content player;
receiving a video search query that comprises a sequence of image signatures derived from a sequential set of images captured by the user device of the screen of the video content player; and
performing a similarity search to identify a candidate sequential set of records of the database; wherein the candidate sequential set of records include a sequence of video clip signatures that have a similarity with the sequence of image signatures included with the video search query, the similarity being prespecified by a similarity threshold.