US 12,402,983 B2
Image based assessment for dental treatment monitoring
Artem Borovinskih, San Jose, CA (US); Mitra Derakhshan, Herndon, VA (US); Carina Morik, Amsterdam (NL); Eric Meyer, Pleasanton, CA (US); Ekaterina Tolstaya, Moscow (RU); and Yury Brailov, Moscow (RU)
Assigned to Align Technology, Inc., San Jose, CA (US)
Filed by Align Technology, Inc., San Jose, CA (US)
Filed on Jun. 23, 2023, as Appl. No. 18/340,793.
Application 18/340,793 is a continuation of application No. 17/353,535, filed on Jun. 21, 2021, granted, now 11,723,749.
Application 17/353,535 is a continuation of application No. 16/370,788, filed on Mar. 29, 2019, granted, now 11,042,774, issued on Jun. 22, 2021.
Application 16/370,788 is a continuation of application No. 14/831,548, filed on Aug. 20, 2015, granted, now 10,248,883, issued on Apr. 2, 2019.
Prior Publication US 2024/0016576 A1, Jan. 18, 2024
Int. Cl. A61C 7/00 (2006.01); G06T 3/06 (2024.01); G06T 5/20 (2006.01); G06T 7/00 (2017.01); G06T 7/136 (2017.01); G06T 7/269 (2017.01); G06T 7/32 (2017.01); G06T 17/00 (2006.01); G06V 10/44 (2022.01); G06V 10/75 (2022.01); G06V 30/182 (2022.01)
CPC A61C 7/002 (2013.01) [G06T 3/06 (2024.01); G06T 5/20 (2013.01); G06T 7/0014 (2013.01); G06T 7/136 (2017.01); G06T 7/269 (2017.01); G06T 7/32 (2017.01); G06T 17/00 (2013.01); G06V 10/44 (2022.01); G06V 10/76 (2022.01); G06V 30/1831 (2022.01); A61C 2007/004 (2013.01); G06T 2207/30036 (2013.01); G06V 2201/03 (2022.01)] 21 Claims
OG exemplary drawing
 
1. A dental treatment monitoring system comprising:
one or more processors; and
a memory coupled to the one or more processors, the memory configured to store computer-program instructions, that, when executed by the one or more processors, perform a computer-implemented method comprising:
accessing a captured two-dimensional (2D) image of a patient's teeth taken at a particular time during a course of dental treatment;
generating a first teeth mask for the captured 2D image, wherein the first teeth mask is configured to distinguish between tooth and non-tooth regions of the captured 2D image;
accessing an expected three-dimensional (3D) model representing an expected configuration of the patient's teeth at the particular time;
determining a set of virtual camera parameters of a virtual camera for the expected 3D model corresponding to the captured 2D image;
generating an expected 2D image from the expected 3D model by mapping points from a surface of the expected 3D model to points on an image plane of the virtual camera;
generating a second teeth mask for the expected 2D image, wherein the second teeth mask is configured to distinguish between tooth and non-tooth regions of the expected 2D image;
aligning the first teeth mask with the second teeth mask, wherein aligning the first teeth mask with the second teeth mask includes taking a distance transform of the first teeth mask, and determining a minimal-cost overlay between the second teeth mask and the distance transform of the first teeth mask;
comparing the captured 2D image with the expected 2D image, with the first and second teeth masks aligned, to determine whether a configuration of the patient's teeth is within a threshold level of correspondence to the expected configuration of the patient's teeth; and
providing an indication that the dental treatment is proceeding as expected or not proceeding as expected based on the determination as to whether the configuration of the patient's teeth is within the threshold level of correspondence.