US 11,900,559 B1
Virtual shoe try-on
Yuelong Li, Santa Clara, CA (US); Sunil Sharadchandra Hadap, Dublin, CA (US); and Miriam Bellver Bueno, Barcelona (ES)
Assigned to Amazon Technologies, Inc., Seattle, WA (US)
Filed by Amazon Technologies, Inc., Seattle, WA (US)
Filed on Mar. 28, 2022, as Appl. No. 17/706,213.
Int. Cl. G06T 19/20 (2011.01); G06T 7/20 (2017.01); G06T 5/00 (2006.01); G06T 5/50 (2006.01); G06T 7/73 (2017.01)
CPC G06T 19/20 (2013.01) [G06T 5/002 (2013.01); G06T 5/50 (2013.01); G06T 7/20 (2013.01); G06T 7/75 (2017.01); G06T 2207/20132 (2013.01); G06T 2207/20221 (2013.01); G06T 2219/2004 (2013.01); G06T 2219/2016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for fitting a virtual shoe onto a foot, the method comprising:
capturing a video comprising a sequence of frames of a foot;
predicting a first location of a bounding box for the foot in a first frame of the sequence of frames and a second location of the bounding box for the foot in a second frame of the sequence of frames;
predicting a first location of a structure of the foot in the first frame and a second location of the structure in the second frame;
estimating, based at least in part on the first location of the bounding box in the first frame, the second location of the bounding box in the second frame, and a movement of content in a pixel of the first frame to the second frame, a two-dimensional (2D) affine transformation that characterizes a movement of the foot in the sequence of frames;
smoothing, based at least in part on the 2D affine transformation, a movement of the structure from the first location of the structure to the second location of the structure; and
superimposing a model of a shoe onto the foot in the sequence of frames based at least in part on the smoothed movement of the structure from the first location of the structure to the second location of the structure.