US 12,407,945 B2
Video overlay synchronization for a digital surgical stereoscope
David S. Immel, Goleta, CA (US)
Assigned to Digital Surgery Systems, Inc., Goleta, CA (US)
Filed by Digital Surgery Systems, Inc., Goleta, CA (US)
Filed on Oct. 17, 2022, as Appl. No. 17/967,413.
Claims priority of provisional application 63/256,475, filed on Oct. 15, 2021.
Prior Publication US 2023/0117586 A1, Apr. 20, 2023
Int. Cl. G06K 9/00 (2022.01); A61B 5/02 (2006.01); G06T 7/00 (2017.01); H04N 5/232 (2006.01); H04N 23/951 (2023.01)
CPC H04N 23/951 (2023.01) [G06T 7/0012 (2013.01); G06T 2207/10 (2013.01); G06T 2207/10012 (2013.01); G06T 2207/10064 (2013.01); G06T 2207/30101 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A surgical imaging apparatus configured to:
receive fluorescence image data of patient tissue from a camera, the fluorescence image data having a specified duration;
determine first scalar gradients between subsequent frames of the fluorescence image data;
determine, as recorded fluorescence frames, peak times and a recording start time of the fluorescence image data using the determined scalar gradients plotted over a recording time;
receive live visible light image data;
determine second scalar gradients between subsequent frames of the visible light image data;
determine, as an overlay time, a time since a last peak of the visible light image data using the determined second scalar gradients;
locate a frame of the recorded fluorescence frames that has a same overlay time since a first recorded peak;
create an overlay image by overlaying or superimposing at least a portion of the located frame of the recorded fluorescence frames on a corresponding frame of the visible light image data; and
cause the overlay image to be displayed,
wherein the specified duration is between ten and thirty seconds, and
wherein the specified duration includes at least two movement peaks of human tissue.