US 11,657,600 B2
Method for assessing oral health using a mobile device
Richard Bundsgaard, Copenhagen K (DK); and Thøger Bundsgaard, Copenhagen K (DK)
Assigned to Adent ApS, Copenhagen K (DK)
Appl. No. 17/765,795
Filed by Adent ApS, Copenhagen K (DK)
PCT Filed Oct. 1, 2020, PCT No. PCT/EP2020/077547
§ 371(c)(1), (2) Date Mar. 31, 2022,
PCT Pub. No. WO2021/064114, PCT Pub. Date Apr. 8, 2021.
Claims priority of application No. PA201970623 (DK), filed on Oct. 4, 2019.
Prior Publication US 2022/0351500 A1, Nov. 3, 2022
Int. Cl. G06V 10/776 (2022.01); G16H 50/30 (2018.01); G16H 30/40 (2018.01); G06V 10/56 (2022.01); G06V 10/77 (2022.01); G06V 10/778 (2022.01); G06V 10/82 (2022.01); G06V 10/764 (2022.01); G06T 7/00 (2017.01)
CPC G06V 10/776 (2022.01) [G06T 7/0012 (2013.01); G06V 10/56 (2022.01); G06V 10/764 (2022.01); G06V 10/7715 (2022.01); G06V 10/7796 (2022.01); G06V 10/82 (2022.01); G16H 30/40 (2018.01); G16H 50/30 (2018.01); G06T 2207/30036 (2013.01); G06V 2201/033 (2022.01)] 13 Claims
OG exemplary drawing
 
1. A computer-implemented method for assessing oral health of a user of a mobile device to determine whether the user is a candidate for an oral treatment, the method comprising:
obtaining (101) at least one digital image (1) of the user's (30) oral cavity (31) using a camera (41) of the mobile device (40);
obtaining (102) non-image data (2) associated with the user (30) using the mobile device (40), the non-image data (2) comprising anamnestic information about the user;
processing (103) the at least one digital image (1) using a statistical object detection algorithm (20) executed on a processor of the mobile device (40) or a processor of a remote server (50) to calculate the likelihood of at least one local visual feature (3) corresponding to a medical finding related to a sub-region of the user's oral cavity (31);
processing (104) the at least one digital image (1) using a statistical image recognition algorithm (21) executed on a processor of the mobile device (40) or a processor of a remote server (50) to calculate the likelihood of at least one global classification label (4) corresponding to a medical finding related to the user's oral cavity (31);
processing (201) the non-image data (2) and the at least one local visual feature (3) using a statistical or non-statistical algorithm executed on a processor of the mobile device (40) or a processor of a remote server (50) to extract a set of priority classification labels (7) corresponding to a predefined number of prioritized medical findings of the user's oral cavity (31), and relative likelihoods of the priority classification labels (7) based on predefined conditions;
arranging (202) the set of priority classification labels (7) into a subset of priority classification labels (7A) of highest relative likelihoods;
using (203) the subset of priority classification labels (7A) as further input for at least one of the statistical object detection algorithm (20) or the statistical image recognition algorithm (21) to enhance the predictability of the at least one local visual feature (3) or the at least one global classification label (4);
determining (105) an assessment (10) of the oral health of the user (30) using a processor of the mobile device (40) or a processor of a remote server (50) by feeding (1051) the likelihood of the at least one local visual feature (3) and the likelihood of the at least one global classification label (4) to a synthesizing algorithm (24) arranged to map local visual features (3) to global classification labels (4) and to determine a set of concepts (9), each concept (9) comprising at least one global classification label (4) and any number of related local visual features (3); and
validating (1052) the set of concepts (9) either automatically or by a human dental reviewer (32,33) based on medical certainty, wherein the medical certainty is determined based on at least one of:
predefined threshold values for the likelihoods of the global classification labels (4) and related local visual features (3) comprised in each concept; and
predefined threshold values for validity scores associated with each statistical algorithm used for predicting the likelihoods.