US 12,347,202 B2
System and method for monitoring clinical activities
Nadeesha O. Ranasinghe, Laguna Niguel, CA (US); Ammar Al-Ali, San Juan Capistrano, CA (US); Massi Joe E. Kiani, Laguna Niguel, CA (US); Mohammad Usman, Mission Viejo, CA (US); Bowen Zhao, Irvine, CA (US); Pierre de Malliard, Laguna Beach, CA (US); and Peter Sunghwan Min, Irvine, CA (US)
Assigned to Masimo Corporation, Irvine, CA (US)
Filed by Masimo Corporation, Irvine, CA (US)
Filed on Jul. 3, 2024, as Appl. No. 18/763,580.
Application 18/763,580 is a continuation of application No. 18/335,672, filed on Jun. 15, 2023, granted, now 12,067,783.
Application 18/335,672 is a continuation of application No. 17/174,931, filed on Feb. 12, 2021, granted, now 11,721,105, issued on Aug. 8, 2023.
Claims priority of provisional application 63/085,058, filed on Sep. 29, 2020.
Claims priority of provisional application 63/075,731, filed on Sep. 8, 2020.
Claims priority of provisional application 62/976,000, filed on Feb. 13, 2020.
Prior Publication US 2025/0005930 A1, Jan. 2, 2025
Int. Cl. G06V 20/52 (2022.01); G01S 11/12 (2006.01); G06N 3/044 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01); G08B 21/24 (2006.01); G16H 40/20 (2018.01); G16H 50/80 (2018.01); H04N 23/90 (2023.01)
CPC G06V 20/52 (2022.01) [G01S 11/12 (2013.01); G06N 3/044 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 40/10 (2022.01); G06V 40/103 (2022.01); G06V 40/20 (2022.01); G08B 21/245 (2013.01); G16H 40/20 (2018.01); G16H 50/80 (2018.01); H04N 23/90 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A system for monitoring of hand hygiene compliance on a local network in a clinical room, the system comprising:
a first camera configured to capture first image data from a first viewpoint in the clinical room; and
a first hardware processor in physical proximity to the first camera, the first hardware processor configured to detect a hand hygiene activity from the first image data by:
receiving the first image data at a first deep learning structure running on the first hardware processor, the first image data comprising a plurality of image frames;
using the first deep learning structure to extract features related to handwashing or hand sanitizing from each of the plurality of image frames;
feeding the features to a second deep learning structure;
combining output of the second deep learning structure of each of the plurality of image frames to output a state of whether handwashing or hand sanitizing has occurred;
a second camera configured to capture second image data from a second viewpoint in the clinical room, the second viewpoint being different from the first viewpoint; and
a second hardware processor in physical proximity to the second camera, the second hardware processor configured to detect a person from the second image data and track movements of the person without storing any images, wherein the first hardware processor is in communication with the second hardware processor such that the first or second hardware processor is configured to determine whether the hand hygiene activity detected by the first hardware processor was performed by the person detected and tracked by the second hardware processor,
wherein the first or second hardware processor is further configured to update a hand hygiene status of the person.