US 11,854,528 B2
Method and system for detecting unsupported utterances in natural language understanding
Yen-Chang Hsu, Fremont, CA (US); Yilin Shen, Santa Clara, CA (US); Avik Ray, Sunnyvale, CA (US); and Hongxia Jin, San Jose, CA (US)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Aug. 13, 2021, as Appl. No. 17/402,045.
Claims priority of provisional application 63/129,415, filed on Dec. 22, 2020.
Prior Publication US 2022/0199070 A1, Jun. 23, 2022
Int. Cl. G06N 20/00 (2019.01); G10L 15/02 (2006.01); G10L 15/18 (2013.01)
CPC G10L 15/02 (2013.01) [G10L 15/18 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus for detecting unsupported utterances in natural language understanding, the apparatus comprising:
a memory storing instructions; and
at least one processor configured to execute the instructions to:
classify a feature that is extracted from an input utterance of a user, as one of in-domain and out-of-domain (OOD) for a response to the input utterance, via a trained neural network-based classifier;
obtain an OOD score of the extracted feature via a distribution-based OOD detector, based on a distance between the extracted feature and distributions of a predetermined distribution function;
based on the feature being classified as in-domain via the trained neural network-based classifier, identify whether the OOD score of the feature is greater than a predefined threshold; and
based on the OOD score being greater than the predefined threshold, re-classify the feature, which is classified as in-domain via the trained neural network-based classifier, as OOD.