US 12,131,462 B2
System and method for facial and dental photography, landmark detection and mouth design generation
Motahare Amiri Kamalabad, Yazd (IR); Mohammad Hossein Rohban, Tehran (IR); Homayoun Moradi, Tehran (IR); Amirhossein Heydarian Ardakani, Yazd (IR); and Milad Soltany Kadarvish, Bookan (IR)
Filed by Motahare Amiri Kamalabad, Yazd (IR); Mohammad Hossein Rohban, Tehran (IR); Homayoun Moradi, Tehran (IR); Amirhossein Heydarian Ardakani, Yazd (IR); and Milad Soltany Kadarvish, Bookan (IR)
Filed on Jan. 13, 2022, as Appl. No. 17/575,082.
Claims priority of provisional application 63/137,226, filed on Jan. 14, 2021.
Claims priority of application No. 13995014000300917 (IR), filed on Jan. 14, 2021.
Prior Publication US 2022/0222814 A1, Jul. 14, 2022
Int. Cl. G06T 7/00 (2017.01); G06T 7/11 (2017.01); G06T 7/70 (2017.01)
CPC G06T 7/0012 (2013.01) [G06T 7/11 (2017.01); G06T 7/70 (2017.01); G06T 2207/10004 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30036 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A method, comprising:
identifying one or more first images of a patient, wherein a first image of the one or more first images comprises a representation of a first tooth;
determining, based upon the one or more first images, landmark information comprising first segmentation information indicative of boundaries of:
teeth of the patient; and
one or more lips of the patient;
generating, based upon the landmark information, a first masked image, wherein generating the first masked image comprises:
identifying a border area of the first tooth in the first image; and
replacing pixels, corresponding to the border area, of the first image with masked pixels corresponding to Gaussian noise to generate the first masked image;
generating, based upon the first masked image, a mouth design using a first machine learning model, wherein:
the first tooth of the patient is represented in the landmark information by one or more first boundaries, and wherein an adjusted representation of the first tooth is represented in the mouth design by one or more second boundaries at least partially different than the one or more first boundaries; and
a first lip of the patient is represented in the landmark information by one or more third boundaries, and wherein an adjusted representation of the first lip is represented in the mouth design by one or more fourth boundaries at least partially different than the one or more third boundaries; and
displaying a representation of the mouth design, comprising the adjusted representation of the first tooth and the adjusted representation of the first lip, via a client device.