US 11,657,850 B2
Virtual product placement
Ahmed Aly Saad Ahmed, Bothell, WA (US); Muhammad Raffay Hamid, Seattle, WA (US); Yongjun Wu, Bellevue, WA (US); Yash Chaturvedi, Issaquah, WA (US); Steven James Cox, Mill Creek, WA (US); Travis Silvers, Lynnwood, WA (US); Amit S. Jain, Bellevue, WA (US); Amjad Y. A. Abu Jbara, Bothell, WA (US); and Prasanth Saraswatula, Bellevue, WA (US)
Assigned to Amazon Technologies, Inc., Seattle, WA (US)
Filed by Amazon Technologies, Inc., Seattle, WA (US)
Filed on Dec. 9, 2020, as Appl. No. 17/247,393.
Prior Publication US 2022/0180898 A1, Jun. 9, 2022
Int. Cl. G11B 27/031 (2006.01); G06V 20/64 (2022.01); G06V 20/40 (2022.01)
CPC G11B 27/031 (2013.01) [G06V 20/41 (2022.01); G06V 20/64 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
analyzing frames of video content to identify attributes, the attributes including, for a first clip of the video content, a categorization of a first object represented in the first clip;
identifying a first candidate placement using the attributes, the first candidate placement corresponding to a surface of the first object represented in the first clip;
selecting a plurality of secondary content items, wherein the plurality of secondary content items includes a first secondary content item comprising a representation of a second object, wherein selecting the plurality of secondary content items includes selecting the first secondary content item from a repository of secondary content items based, at least in part, on:
attributes of the second object represented in the first secondary content item;
the attributes of the video content; and
a set of rules including a mapping of scene types to attributes of secondary content items based on constraints configurable by a primary content provider specifying primary content attributes permitted to have secondary content item replacement, and constraints configurable by a secondary content provider specifying secondary content attributes permitted to be placed in primary content;
generating a plurality of replacement clips using the first clip and the plurality of secondary content items, each replacement clip including a representation of a corresponding secondary content item of the plurality of secondary content items positioned at the first candidate placement;
processing a request to initiate playback of the video content, the request being received from a client device;
identifying an account profile associated with the client device, wherein the account profile comprises characteristics of a user associated with the account profile;
identifying metadata marking a first candidate insertion point within the video content, the first candidate insertion point corresponding to a start time of the first clip;
selecting a first replacement clip of the plurality of replacement clips based, at least in part, on the account profile; and
providing a manifest to the client device, the manifest comprising first manifest data including references to fragments corresponding to a first subset of a plurality of segments of the video content and second manifest data including references to a set of replacement fragments corresponding to the selected first replacement clip, the set of replacement fragments corresponding to a second subset of the plurality of segments of the video content.