US 11,864,971 B2
Generating a virtual patient depiction of an orthodontic treatment
Pavel Pokotilov, Moscow (RU); Dmitry Yurievich Chekh, Moscow (RU); Dmitriy Konstantinovich Ten, Novosibirsk (RU); Samuel Blanco, Santa Clara, CA (US); David Patrick Lopes, El Dorado Hills, CA (US); Jason Ramos, Heredia (CR); Rene M. Sterental, Palo Alto, CA (US); Evgenii Vladimirovich Karnygin, Moscow (RU); Vladislav Andreevich Miryaha, Engels (RU); Boris Aleksandrovich Vysokanov, Moscow (RU); Yury A. Brailov, Moscow (RU); and Artem Kuanbekov, Moscow (RU)
Assigned to Align Technology, Inc., San Jose, CA (US)
Filed by Align Technology, Inc., San Jose, CA (US)
Filed on Jun. 8, 2023, as Appl. No. 18/331,747.
Application 18/331,747 is a continuation of application No. 17/088,909, filed on Nov. 4, 2020, granted, now 11,717,380.
Application 17/088,909 is a continuation of application No. 15/926,952, filed on Mar. 20, 2018, granted, now 10,828,130, issued on Nov. 10, 2020.
Claims priority of provisional application 62/474,026, filed on Mar. 20, 2017.
Prior Publication US 2023/0346515 A1, Nov. 2, 2023
Int. Cl. G16H 20/40 (2018.01); A61C 7/00 (2006.01); A61C 9/00 (2006.01); A61C 7/08 (2006.01); G16H 50/20 (2018.01); G06T 17/20 (2006.01); B33Y 50/00 (2015.01); B33Y 80/00 (2015.01); G16H 50/50 (2018.01)
CPC A61C 7/002 (2013.01) [A61C 7/08 (2013.01); A61C 9/0053 (2013.01); G06T 17/20 (2013.01); G16H 20/40 (2018.01); G16H 50/20 (2018.01); B33Y 50/00 (2014.12); B33Y 80/00 (2014.12); G06T 2207/30036 (2013.01); G16H 50/50 (2018.01)] 30 Claims
OG exemplary drawing
 
1. A system for generating a virtual depiction of an orthodontic treatment of a patient, the system comprising:
one or more processors; and
a memory operably coupled to the one or more processors, wherein the memory comprises instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
receiving, from a digital imaging device, one or more 2D images of a patient's face comprising a mouth region, wherein the one or more 2D images comprise a depiction of the patient's teeth in an initial arrangement;
extracting teeth contours of the patient's teeth from within the mouth region of the one or more received 2D images of the patient's face;
generating, using a neural network, a 2D rendering depicting a post-treatment arrangement of the patient's teeth based on the one or more received 2D images;
generating a realistic composite 2D image depicting the patient's face with the 2D rendering depicting the post-treatment arrangement of the patient's teeth, wherein the generating comprises:
performing a comparison between the extracted teeth contours and teeth contours of the 2D rendering, and
positioning the 2D rendering within a mouth opening of the patient's face in the realistic composite 2D image; and
sending the realistic composite 2D image to an output device for display on a user interface of the output device.