US 11,744,681 B2
Foreign object identification and image augmentation for intraoral scanning
Avi Kopelman, Palo Alto, CA (US); and Michael Sabina, Campbell, CA (US)
Assigned to Align Technology, Inc., San Jose, CA (US)
Filed by Align Technology, Inc., San Jose, CA (US)
Filed on Mar. 4, 2020, as Appl. No. 16/809,457.
Claims priority of provisional application 62/815,954, filed on Mar. 8, 2019.
Prior Publication US 2020/0281702 A1, Sep. 10, 2020
Int. Cl. A61C 9/00 (2006.01); A61C 7/00 (2006.01); G06T 7/00 (2017.01); G06T 17/00 (2006.01); G06T 19/20 (2011.01); G06T 7/70 (2017.01); G16H 30/40 (2018.01); G16H 50/50 (2018.01); G06N 20/00 (2019.01); A61B 1/24 (2006.01); A61B 1/00 (2006.01)
CPC A61C 9/0046 (2013.01) [A61B 1/000094 (2022.02); A61B 1/000096 (2022.02); A61B 1/00194 (2022.02); A61B 1/24 (2013.01); A61C 7/002 (2013.01); A61C 9/0053 (2013.01); A61C 9/0073 (2013.01); G06N 20/00 (2019.01); G06T 7/0014 (2013.01); G06T 7/70 (2017.01); G06T 17/00 (2013.01); G06T 19/20 (2013.01); G16H 30/40 (2018.01); G16H 50/50 (2018.01); A61B 1/00009 (2013.01); A61B 1/00108 (2013.01); G06T 2200/08 (2013.01); G06T 2207/30036 (2013.01); G06T 2210/41 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A method comprising:
receiving intraoral scan data comprising a plurality of images of a dental site of a patient;
generating a virtual three-dimensional (3D) model of the dental site based on the plurality of images;
performing an analysis on an image of the dental site;
identifying, in the image, a representation of a foreign object that is not naturally occurring in a mouth of the patient, wherein the foreign object has one or more known properties, and wherein identifying the representation of the foreign object comprises:
performing image processing on the image to determine a probable object represented in the image, wherein the probable object comprises one or more physical properties;
comparing the one or more physical properties of the probable object to the one or more known properties of the foreign object that is not naturally occurring in the mouth of the patient;
determining that the one or more physical properties of the probable object match the one or more known properties the foreign object as a result of the comparing; and
determining that the probable object is the foreign object; and
modifying at least one of the image or the virtual 3D model of the dental site by adding additional data about the foreign object to at least one of the image or the virtual 3D model based on the one or more known properties of the foreign object.