US 11,783,557 B2
Virtual try-on systems and methods for spectacles
David Goldberg, New York, NY (US); Michael Rakowski, Brooklyn, NY (US); Benjamin Cohen, New York, NY (US); Ben Hall, Brooklyn, NY (US); Brian Bernberg, Montclair, NJ (US); and Hannah Zachritz, Brooklyn, NY (US)
Assigned to WARBY PARKER INC., New York, NY (US)
Filed by WARBY PARKER INC., New York, NY (US)
Filed on Dec. 13, 2021, as Appl. No. 17/549,563.
Application 17/549,563 is a continuation of application No. 17/085,485, filed on Oct. 30, 2020, granted, now 11,200,753.
Application 17/085,485 is a continuation of application No. 16/239,745, filed on Jan. 4, 2019, granted, now 10,825,260, issued on Nov. 3, 2020.
Prior Publication US 2022/0101621 A1, Mar. 31, 2022
Int. Cl. G06T 19/20 (2011.01); G06T 7/62 (2017.01); G06T 7/73 (2017.01); H04N 23/56 (2023.01)
CPC G06T 19/20 (2013.01) [G06T 7/62 (2017.01); G06T 7/75 (2017.01); H04N 23/56 (2023.01); G06T 2207/30201 (2013.01); G06T 2219/2004 (2013.01); G06T 2219/2016 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
capturing, with a camera, an image of a face of a user;
determining three-dimensional location information for a plurality of points associated with the face of the user in the image;
identifying at least one landmark associated with the face of the user in the image, the at least one landmark corresponding to at least one of the plurality of points;
determining a size of a virtual representation of a first pair of spectacles based on the three-dimensional location information and a three-dimensional model of the first pair of spectacles;
determining a position of the virtual representation of the first pair of spectacles 1a intersecting at least one point of the three-dimensional model of the first pair of spectacles with a first location in the image based on the at least one landmark in a facial coordinate system having an origin at the at least one landmark; and
displaying, on a display, a combined image including the image of the face of the user and the virtual representation of the first pair spectacles with the determined size and at the determined position.