US 12,230,369 B2
Systems and methods for mental health assessment
Elizabeth Shriberg, Berkeley, CA (US); Michael Aratow, Mountain View, CA (US); Mainul Islam, San Francisco, CA (US); Amir Hossein Harati Nejad Torbati, Toronto (CA); Tomasz Rutowski, Gdansk (PL); David Lin, Foster City, CA (US); Yang Lu, Waterloo, CA (US); Farshid Haque, San Francisco, CA (US); and Robert D. Rogers, Pleasanton, CA (US)
Assigned to Ellipsis Health, Inc., San Francisco, CA (US)
Filed by Ellipsis Health, Inc., San Francisco, CA (US)
Filed on Feb. 1, 2024, as Appl. No. 18/430,067.
Application 18/430,067 is a continuation of application No. 17/671,337, filed on Feb. 14, 2022, granted, now 11,942,194.
Application 17/671,337 is a continuation of application No. 17/400,066, filed on Aug. 11, 2021, abandoned.
Application 17/400,066 is a continuation of application No. 17/129,859, filed on Dec. 21, 2020, granted, now 11,120,895, issued on Sep. 14, 2021.
Application 17/129,859 is a continuation of application No. 16/918,624, filed on Jul. 1, 2020, abandoned.
Application 16/918,624 is a continuation of application No. 16/560,720, filed on Sep. 4, 2019, granted, now 10,748,644, issued on Aug. 18, 2020.
Application 16/560,720 is a continuation of application No. 16/523,298, filed on Jul. 26, 2019, abandoned.
Application 16/523,298 is a continuation of application No. PCT/US2019/037953, filed on Jun. 19, 2019.
Claims priority of provisional application 62/755,356, filed on Nov. 2, 2018.
Claims priority of provisional application 62/755,361, filed on Nov. 2, 2018.
Claims priority of provisional application 62/754,547, filed on Nov. 1, 2018.
Claims priority of provisional application 62/754,541, filed on Nov. 1, 2018.
Claims priority of provisional application 62/754,534, filed on Nov. 1, 2018.
Claims priority of provisional application 62/749,672, filed on Oct. 24, 2018.
Claims priority of provisional application 62/749,654, filed on Oct. 23, 2018.
Claims priority of provisional application 62/749,663, filed on Oct. 23, 2018.
Claims priority of provisional application 62/749,669, filed on Oct. 23, 2018.
Claims priority of provisional application 62/749,113, filed on Oct. 22, 2018.
Claims priority of provisional application 62/733,552, filed on Sep. 19, 2018.
Claims priority of provisional application 62/733,568, filed on Sep. 19, 2018.
Claims priority of provisional application 62/687,176, filed on Jun. 19, 2018.
Prior Publication US 2024/0170109 A1, May 23, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G16H 10/20 (2018.01); A61B 5/00 (2006.01); A61B 5/16 (2006.01); G06F 16/24 (2019.01); G09B 19/00 (2006.01); G10L 15/18 (2013.01); G10L 25/66 (2013.01); G16H 50/20 (2018.01); G16H 50/30 (2018.01)
CPC G16H 10/20 (2018.01) [A61B 5/164 (2013.01); A61B 5/165 (2013.01); A61B 5/4803 (2013.01); G09B 19/00 (2013.01); G10L 25/66 (2013.01); G16H 50/20 (2018.01); G16H 50/30 (2018.01); A61B 5/4088 (2013.01); A61B 5/7275 (2013.01); G06F 16/24 (2019.01); G10L 15/18 (2013.01)] 27 Claims
OG exemplary drawing
 
1. A system for identifying whether a subject is at risk of having a mental or physiological condition, comprising:
one or more computer processors; and
a memory comprising machine-executable instructions;
wherein, upon execution, the instructions cause the one or more computer processors to:
(a) obtain data from said subject, said data comprising speech data and optionally associated visual data;
(b) process said data using a plurality of machine learning models comprising a natural language processing (NLP) model and an acoustic model to generate an NLP output and an acoustic output, wherein said plurality of machine learning models comprises a neural network trained on labeled speech data collected from one or more other subjects, wherein said labeled speech data for each of said one or more other subjects is labeled as (i) having, to some level, said mental or physiological condition or (ii) not having said mental or physiological condition;
(c) fuse said NLP output and said acoustic output by (1) applying weights to said NLP output and said acoustic output to generate weighted outputs and (2) generating a composite output from said weighted outputs, wherein said NLP output and said acoustic output each comprise a plurality of outputs corresponding to a plurality of time segments of said speech data, and wherein said weights in (1) are temporally-based; and
(d) output an electronic report identifying whether said subject is at risk of having said mental or physiological condition, based at least on said composite output, which risk is quantified in a form of a score having a confidence level provided in said report.