US 12,236,499 B2
Multithreading video processing with cloud services to detect and analyze objects
Rakesh Madan, Schenectady, NY (US); and Zohair Hussain, Schenectady, NY (US)
Assigned to UTECH PRODUCTS, INC., Schenectady, NY (US)
Filed by UTECH PRODUCTS, INC., Schenectady, NY (US)
Filed on Oct. 6, 2022, as Appl. No. 17/938,355.
Claims priority of provisional application 63/362,841, filed on Apr. 12, 2022.
Prior Publication US 2024/0119554 A1, Apr. 11, 2024
Int. Cl. G06T 1/20 (2006.01); G06T 1/60 (2006.01); G06T 7/00 (2017.01)
CPC G06T 1/20 (2013.01) [G06T 1/60 (2013.01); G06T 7/0012 (2013.01); G06T 2207/30096 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system, comprising:
a memory; and
a processor having a first core and a second core coupled to the memory and configured to process a video stream captured during a clinical procedure according to process that includes:
receiving and forwarding a current image frame from the video stream to a display manager using a first processing thread running on the first core;
forwarding the current image frame to a memory buffer;
using a second processing thread that runs on the second core independently of the first processing thread to check for a new image frame in the memory buffer;
in response to the new image frame being detected in the memory buffer, using the second processing thread to retrieve and forward the new image frame to a cloud service running remotely from the first core and the second core that is configured to detect lesions in image data;
receiving a result from the cloud service at the second processing thread;
in response to the result being indicative of a new detected lesion in the new image frame, performing object sizing on the new detected lesion using the second processing thread and forwarding new lesion information to the first processing thread; and
receiving, at the first processing thread, the new lesion information and graphically overlaying the new lesion information onto the current image frame at the display manager.