US 12,236,767 B2
Machine learning based monitoring system
Bilal Muhsin, Irvine, CA (US); Richard Priddell, Irvine, CA (US); Valery G. Telfort, Irvine, CA (US); Naoki Kokawa, Tustin, CA (US); Ammar Al-Ali, San Juan Capistrano, CA (US); and Mohammad Usman, Mission Viejo, CA (US)
Assigned to Masimo Corporation, Irvine, CA (US)
Filed by Masimo Corporation, Irvine, CA (US)
Filed on Jan. 11, 2023, as Appl. No. 18/153,108.
Claims priority of provisional application 63/299,168, filed on Jan. 13, 2022.
Claims priority of provisional application 63/298,569, filed on Jan. 11, 2022.
Prior Publication US 2023/0222887 A1, Jul. 13, 2023
Int. Cl. G08B 21/04 (2006.01); G06T 7/00 (2017.01); G06T 7/70 (2017.01); G06T 7/90 (2017.01); G06V 10/764 (2022.01); G06V 10/774 (2022.01); G06V 20/52 (2022.01); G06V 40/10 (2022.01); G06V 40/16 (2022.01); G06V 40/20 (2022.01); G08B 21/02 (2006.01); G10L 25/51 (2013.01)
CPC G08B 21/043 (2013.01) [G06T 7/0012 (2013.01); G06T 7/70 (2017.01); G06T 7/90 (2017.01); G06V 10/764 (2022.01); G06V 10/774 (2022.01); G06V 20/52 (2022.01); G06V 40/10 (2022.01); G06V 40/168 (2022.01); G06V 40/172 (2022.01); G06V 40/20 (2022.01); G08B 21/0208 (2013.01); G08B 21/0294 (2013.01); G08B 21/0492 (2013.01); G10L 25/51 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/30041 (2013.01); G06T 2207/30201 (2013.01); G06T 2207/30232 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A system comprising:
a storage device configured to store first instructions and second instructions;
a camera;
a microphone;
a hardware accelerator configured to execute the first instructions; and
a hardware processor configured to execute the second instructions to:
receive, from the camera, first image data;
invoke, on the hardware accelerator, a person detection model based on the first image data, wherein the person detection model outputs first classification result;
detect a person based on the first classification result;
receive, from the camera, second image data; and
in response to detecting the person,
invoke, on the hardware accelerator, a fall detection model based on the second image data, wherein the fall detection model outputs a second classification result,
detect a potential fall based on the second classification result, and
in response to detecting the potential fall, provide an alert;
receive, from the microphone, audio data; and
in response to detecting the person,
invoke, on the hardware accelerator, a loud noise detection model based on the audio data, wherein the loud noise detection model outputs a third classification result,
detect a potential scream based on the third classification result, and
in response to detecting the potential scream, provide a second alert.