US 11,717,380 B2
Automated 2D/3D integration and lip spline autoplacement
Pavel Pokotilov, Moscow (RU); Dmitry Yurievich Chekh, Moscow (RU); Dmitriy Konstantinovich Ten, Novosibirsk (RU); Samuel Blanco, Santa Clara, CA (US); David Patrick Lopes, El Dorado Hills, CA (US); Jason Ramos, Heredia (CR); Rene M. Sterental, Palo Alto, CA (US); Evgenii Vladimirovich Karnygin, Moscow (RU); Vladislav Andreevich Miryaha, Engels (RU); Boris Aleksandrovich Vysokanov, Moscow (RU); Yury A. Brailov, Moscow (RU); and Artem Kuanbekov, Moscow (RU)
Assigned to Align Technology, Inc., San Jose, CA (US)
Filed by ALIGN TECHNOLOGY, INC., San Jose, CA (US)
Filed on Nov. 4, 2020, as Appl. No. 17/88,909.
Application 17/088,909 is a continuation of application No. 15/926,952, filed on Mar. 20, 2018, granted, now 10,828,130.
Claims priority of provisional application 62/474,026, filed on Mar. 20, 2017.
Prior Publication US 2021/0045843 A1, Feb. 18, 2021
Int. Cl. G06K 9/00 (2022.01); A61C 7/00 (2006.01); A61C 9/00 (2006.01); A61C 7/08 (2006.01); G16H 20/40 (2018.01); G16H 50/20 (2018.01); G06T 17/20 (2006.01); B33Y 50/00 (2015.01); B33Y 80/00 (2015.01); G16H 50/50 (2018.01)
CPC A61C 7/002 (2013.01) [A61C 7/08 (2013.01); A61C 9/0053 (2013.01); G06T 17/20 (2013.01); G16H 20/40 (2018.01); G16H 50/20 (2018.01); B33Y 50/00 (2014.12); B33Y 80/00 (2014.12); G06T 2207/30036 (2013.01); G16H 50/50 (2018.01)] 20 Claims
OG exemplary drawing
 
1. A method for virtually representing an orthodontic treatment outcome of a patient's teeth, the computer-implemented method comprising:
receiving a facial image of a patient;
identifying a facial landmark on the facial image, wherein the facial landmark comprises at least a lip landmark;
locating a mouth opening within the facial image based at least in part on the lip landmark;
extracting a first set of teeth contours within the mouth opening;
extracting a second set of teeth contours from a 3D model representing the patient's teeth rendered in an intermediate position between an initial position and a final position, wherein the intermediate position and the final position are part of a treatment plan;
aligning the extracted second set of teeth contours with the first set of teeth contours within the mouth opening; and
inserting the 3D model into the facial image to form a composite image.