US 12,079,995 B2
System and method for a hybrid unsupervised semantic segmentation
Chirag Pabbaraju, Sunnyvale, CA (US); João D. Semedo, Pittsburgh, PA (US); and Wan-Yi Lin, Wexford, PA (US)
Assigned to Robert Bosch GmbH, (DE)
Filed by Robert Bosch GmbH, Stuttgart (DE)
Filed on Sep. 28, 2021, as Appl. No. 17/487,345.
Prior Publication US 2023/0107917 A1, Apr. 6, 2023
Int. Cl. G06T 7/10 (2017.01); G06T 7/11 (2017.01); G06T 7/269 (2017.01)
CPC G06T 7/10 (2017.01) [G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of image segmentation comprising:
receiving one or more images, wherein the one or more images includes a plurality of frames and no more than a partial annotation of the one or more images;
determining a loss component associated with a image segmentation model;
for each pixel of the one or more images, identifying a majority class and identify a cross-entropy loss between a network output and a target;
randomly selecting pixels associated with the one image and select a second set of pixels to compute a super pixel loss for each pair of pixels;
summing corresponding loss associated with each pair of pixels;
for each corresponding frame of the plurality of frames of the image, computing a positive flow loss, a negative flow loss, a contrastive optical flow loss, and a equivariant optical flow loss;
computing a final loss including a weighted average of the positive flow loss, the negative flow loss, the contrastive optical flow loss, the equivariant optical flow loss, the cross entropy loss, the super pixel loss, and foreground loss;
updating a network parameter associated with the image segmentation model in response to the final loss; and
outputting a trained neural network utilizing the updated network parameter in response to exceeding a convergence threshold.