US 11,776,131 B2
Neural network for eye image segmentation and image quality estimation
Alexey Spizhevoy, Nizhny Novgorod (RU); Adrian Kaehler, Los Angeles, CA (US); and Vijay Badrinarayanan, Mountain View, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Aug. 20, 2021, as Appl. No. 17/407,763.
Application 17/407,763 is a continuation of application No. 16/570,418, filed on Sep. 13, 2019, granted, now 11,100,644.
Application 16/570,418 is a continuation of application No. 15/605,567, filed on May 25, 2017, granted, now 10,445,881, issued on Oct. 15, 2019.
Claims priority of application No. RU2016138608 (RU), filed on Sep. 29, 2016.
Prior Publication US 2022/0044406 A1, Feb. 10, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 7/00 (2017.01); G06T 7/12 (2017.01); G06T 7/11 (2017.01); G06T 7/194 (2017.01); G06V 10/56 (2022.01); G06V 10/44 (2022.01); G06V 10/98 (2022.01); G06V 40/18 (2022.01); G06F 18/2413 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06T 7/10 (2017.01)
CPC G06T 7/12 (2017.01) [G06F 18/2413 (2023.01); G06T 7/0002 (2013.01); G06T 7/10 (2017.01); G06T 7/11 (2017.01); G06T 7/194 (2017.01); G06V 10/454 (2022.01); G06V 10/56 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 10/993 (2022.01); G06V 40/193 (2022.01); G06V 40/197 (2022.01); G06T 2207/10024 (2013.01); G06T 2207/20076 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30041 (2013.01); G06T 2207/30168 (2013.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for training a convolutional neural network for eye image segmentation and image quality estimation, the method being performed by a system of one or more processors, and the method comprising:
obtaining a training set of eye images;
providing a convolutional neural network with the training set of eye images;
and training the convolutional neural network with the training set of eye images, wherein the convolution neural network comprises a segmentation tower and a quality estimation tower, wherein the segmentation tower comprises segmentation layers and shared layers,
wherein the quality estimation tower comprises quality estimation layers and the shared layers,
wherein an output layer of the shared layers is connected to a first input layer of the segmentation tower and a second input layer of the segmentation tower,
and wherein the output layer of the shared layers is connected to an input layer of the quality estimation layer.