	US 12,106,483 B2
	Gaze-based control of device operations
Fedir Poliakov, Odessa (UA)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Aug. 31, 2023, as Appl. No. 18/241,179.
Application 18/241,179 is a continuation of application No. 17/567,206, filed on Jan. 3, 2022, granted, now 11,783,487.
Application 17/567,206 is a continuation of application No. 16/708,584, filed on Dec. 10, 2019, granted, now 11,216,949, issued on Jan. 4, 2022.
Application 16/708,584 is a continuation of application No. 16/418,333, filed on May 21, 2019, granted, now 10,535,139, issued on Jan. 14, 2020.
Application 16/418,333 is a continuation of application No. 15/829,539, filed on Dec. 1, 2017, granted, now 10,346,985, issued on Jul. 9, 2019.
Application 15/829,539 is a continuation of application No. 15/821,405, filed on Nov. 22, 2017, granted, now 10,102,634, issued on Oct. 16, 2018.
Application 15/821,405 is a continuation of application No. 14/884,536, filed on Oct. 15, 2015, granted, now 9,830,708, issued on Nov. 28, 2017.
Prior Publication US 2023/0410314 A1, Dec. 21, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 7/00 (2017.01); G06T 7/11 (2017.01); G06T 7/136 (2017.01); G06T 7/62 (2017.01); G06T 7/66 (2017.01); G06T 7/73 (2017.01); G06T 7/90 (2017.01); G06V 10/20 (2022.01); G06V 10/28 (2022.01); G06V 40/16 (2022.01); G06V 40/18 (2022.01); G06V 40/19 (2022.01)

CPC G06T 7/11 (2017.01) [G06T 7/136 (2017.01); G06T 7/62 (2017.01); G06T 7/66 (2017.01); G06T 7/73 (2017.01); G06T 7/90 (2017.01); G06V 10/255 (2022.01); G06V 10/28 (2022.01); G06V 40/162 (2022.01); G06V 40/19 (2022.01); G06V 40/193 (2022.01); G06V 40/197 (2022.01); G06T 2207/10024 (2013.01); G06T 2207/30041 (2013.01)]

20 Claims

1. A method for segmenting a video stream, comprising:

receiving, at a first client device, a first portion of the video stream from an imaging device;

generating a binary mask indicative of pixels representing an object of interest within one or more images of the first portion of the video stream, the binary mask comprising a set of first pixels having a first value;

determining an approximate center of mass of the set of first pixels;

receiving, at the first client device, one or more images of a second portion of the video stream;

receiving, at the first client device, at least one of the binary mask or tracking data representative of a location of the object of interest within the one or more images of the first portion of the video stream;

modifying, using the at least one of the binary mask or tracking data, one or more values for pixels of the binary mask representing the object of interest within the second portion of the video stream to generate a modified video stream;

identifying the location of the object of interest relative to the imaging device and a display device; and

determining a direction of the object of interest in the modified video stream by calculating a line of sight extending from the center of mass of the set of first pixels to the display device.