US 12,142,023 B2
System and method for generating a mask for object instances in an image
Wim Abbeloos, Brussels (BE); Davy Neven, Leuven (BE); Bert De Brabandere, Leuven (BE); Marc Proesmans, Leuven (BE); and Luc Van Gool, Leuven (BE)
Assigned to TOYOTA MOTOR EUROPE, Brussels (BE); and KATHOLIEKE UNIVERSITEIT LEUVEN, K.U. LEUVEN R&D, Leuven (BE)
Appl. No. 17/423,287
Filed by Toyota Motor Europe, Brussels (BE); and Katholieke Universiteit Leuven, K.U. Leuven R&D, Leuven (BE)
PCT Filed Jan. 17, 2019, PCT No. PCT/EP2019/051191
§ 371(c)(1), (2) Date Jul. 15, 2021,
PCT Pub. No. WO2020/147957, PCT Pub. Date Jul. 23, 2020.
Prior Publication US 2022/0092869 A1, Mar. 24, 2022
Int. Cl. G06V 10/82 (2022.01); G06N 3/08 (2023.01); G06V 10/44 (2022.01); G06V 10/762 (2022.01); G06V 10/764 (2022.01); G06V 10/774 (2022.01); G06V 20/58 (2022.01); G06V 20/70 (2022.01); G06V 40/10 (2022.01)
CPC G06V 10/454 (2022.01) [G06N 3/08 (2013.01); G06V 10/762 (2022.01); G06V 10/764 (2022.01); G06V 10/774 (2022.01); G06V 10/82 (2022.01); G06V 20/58 (2022.01); G06V 20/70 (2022.01); G06V 40/10 (2022.01)] 16 Claims
OG exemplary drawing
 
1. A system for generating a mask for object instances in an image, comprising:
a first module comprising a trained neural network and configured to input the image to the neural network, wherein the neural network is configured to generate:
pixel offset vectors for the pixels of the object instance configured to point towards a unique center of an object instance, the pixel offset vectors thereby forming a cluster with a cluster distribution, and
for each object instance an estimate of said cluster distribution defining a margin for determining which pixels belong to the object instance.