US 12,249,144 B2
Monitoring surface cleaning of medical surfaces using video streaming
Joseph Ferrante, Cambridge, MA (US); Kelsey Gross, Seattle, WA (US); and Elliot Swart, Phoenix, AZ (US)
Assigned to Digital Diagnostics Inc., Coralville, IA (US)
Appl. No. 17/621,570
Filed by Digital Diagnostics Inc., Coralville, IA (US)
PCT Filed Jun. 26, 2020, PCT No. PCT/US2020/039918
§ 371(c)(1), (2) Date Dec. 21, 2021,
PCT Pub. No. WO2020/264367, PCT Pub. Date Dec. 30, 2020.
Claims priority of provisional application 62/868,243, filed on Jun. 28, 2019.
Prior Publication US 2022/0358761 A1, Nov. 10, 2022
Int. Cl. G06V 20/40 (2022.01); A61L 2/24 (2006.01); A61L 2/28 (2006.01); G06T 7/70 (2017.01); G06V 10/764 (2022.01); G16H 40/20 (2018.01); G16H 40/67 (2018.01)
CPC G06V 20/41 (2022.01) [A61L 2/24 (2013.01); A61L 2/28 (2013.01); G06T 7/70 (2017.01); G06V 10/764 (2022.01); G16H 40/20 (2018.01); G16H 40/67 (2018.01); A61L 2202/17 (2013.01); A61L 2202/24 (2013.01); A61L 2202/25 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method comprising:
receiving a video stream;
inputting a first set of frames of the video stream into a first machine learning model, the first machine learning model trained to output whether the first set of frames corresponds to activity that initiates a cleaning protocol for an item of medical equipment;
responsive to receiving output that the first set of frames corresponds to activity that initiates the cleaning protocol, inputting a second set of frames from the video stream into a second machine learning model, the second machine learning model trained to output a pixel map, the pixel map representing one or more aspects of the cleaning protocol based on the second set of frames;
inputting the pixel map into one or more classifiers;
receiving, as output from each of the one or more classifiers, whether pixels of the pixel map conform to required values of the cleaning protocol; and
responsive to the pixels of the pixel map conforming to the required values of the cleaning protocol, determining that the second set of frames meets criteria of the cleaning protocol; and
responsive to the second set of frames meeting the criteria of the cleaning protocol, transmitting a notification to an operator that the cleaning protocol is complete.