US 11,941,050 B2
Systems and methods for segmenting surgical videos
Joëlle K. Barral, Mountain View, CA (US); Martin Habbecke, Palo Alto, CA (US); Michal Levin, Mountain View, CA (US); Antons Krumins, Mountain View, CA (US); and Thomas Teisseyre, Pacifica, CA (US)
Assigned to VERILY LIFE SCIENCES LLC, South San Francisco, CA (US)
Filed by Verily Life Sciences LLC, South San Francisco, CA (US)
Filed on Feb. 16, 2021, as Appl. No. 17/176,795.
Application 17/176,795 is a continuation of application No. 16/162,898, filed on Oct. 17, 2018, granted, now 10,956,492.
Claims priority of provisional application 62/573,327, filed on Oct. 17, 2017.
Prior Publication US 2021/0200804 A1, Jul. 1, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/738 (2019.01); A61B 34/20 (2016.01); A61B 90/00 (2016.01); G16H 30/40 (2018.01); A61B 34/00 (2016.01); A61B 34/10 (2016.01); G11B 27/34 (2006.01); H04N 21/472 (2011.01); H04N 21/845 (2011.01); H04N 21/858 (2011.01)
CPC G06F 16/739 (2019.01) [A61B 34/20 (2016.02); A61B 90/37 (2016.02); G16H 30/40 (2018.01); A61B 2034/107 (2016.02); A61B 34/25 (2016.02); G11B 27/34 (2013.01); H04N 21/47217 (2013.01); H04N 21/8456 (2013.01); H04N 21/858 (2013.01)] 30 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by a processor of a computing device, surgical video, the surgical video comprising at least a sequence of video frames captured by an endoscope during an endoscopic surgical procedure;
recognizing one or more steps of the surgical video by the processor using a trained ML technique;
identifying one or more video frames of the surgical video corresponding to the recognized steps;
in response to identification of the one or more video frames, generating one or more bookmarks based on the one or more steps of the surgical video and the one or more video frames;
associating, by the processor, the one or more bookmarks with the respective one or more video frames; and
storing, by the processor, the one or more bookmarks.