US 12,260,731 B2
System and method for detecting, recording and communicating events in the care and treatment of cognitively impaired persons
George Netscher, Berkeley, CA (US); Julien Jacquemot, Berkeley, CA (US); Pulkit Agrawal, Berkeley, CA (US); and Alexandre Bayen, Piedmont, CA (US)
Assigned to Safely You Inc., San Francisco, CA (US)
Filed by SafelyYou Inc., San Francisco, CA (US)
Filed on Dec. 29, 2023, as Appl. No. 18/400,622.
Application 18/400,622 is a continuation of application No. 17/556,372, filed on Dec. 20, 2021, granted, now 11,900,782.
Application 17/556,372 is a continuation of application No. 15/920,534, filed on Mar. 14, 2018, granted, now 11,232,694, issued on Jan. 25, 2022.
Prior Publication US 2024/0135796 A1, Apr. 25, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G08B 21/04 (2006.01); G06F 40/169 (2020.01); G06N 3/08 (2023.01); G06V 20/40 (2022.01); G06V 20/52 (2022.01); G16H 40/20 (2018.01)
CPC G08B 21/0476 (2013.01) [G06F 40/169 (2020.01); G06N 3/08 (2013.01); G06V 20/41 (2022.01); G06V 20/52 (2022.01); G08B 21/043 (2013.01); G16H 40/20 (2018.01)] 22 Claims
OG exemplary drawing
 
1. An apparatus, comprising:
a 2-dimensional camera configured to be disposed within a care location and configured to record within a field of view of the 2-dimensional camera, to generate a sequence of 2-dimensional video frames,
a memory operatively coupled to the camera and configured to store the sequence of 2-dimensional video frames,
a processor operatively coupled to the camera and configured to receive from a remote compute device a convolutional neural network (CNN) trained based on aggregate data from a plurality of care locations,
the processor configured to detect an event of interest from a set of predetermined events of interest and from the sequence of 2-dimensional video frames using the CNN, the processor configured to define an event alert upon detection of the event of interest, including event information;
the processor configured to produce a final classification and detection decision of the event of interest based on both pattern recognition and on the sequence of 2-dimensional video frames;
the processor configured to transfer the event alert, the event information and the sequence of 2-dimensional video frames relating to the event of interest over a communications network to a remote server that also receives notification of event validity for each event of interest from an event verification location upon receiving the event information and the sequence of 2-dimensional video frames.