US 12,075,190 B2
Generating an image mask using machine learning
Lidiia Bogdanovych, Los Angeles, CA (US); William Brendel, Los Angeles, CA (US); Samuel Edward Hare, Los Angeles, CA (US); Fedir Poliakov, Marina Del Rey, CA (US); Guohui Wang, Los Angeles, CA (US); Xuehan Xiong, Los Angeles, CA (US); Jianchao Yang, Los Angeles, CA (US); and Linjie Yang, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jul. 13, 2023, as Appl. No. 18/221,702.
Application 18/221,702 is a continuation of application No. 16/992,968, filed on Aug. 13, 2020, granted, now 11,743,426.
Application 16/992,968 is a continuation of application No. 16/521,956, filed on Jul. 25, 2019, granted, now 10,776,663.
Application 16/521,956 is a continuation of application No. 15/706,057, filed on Sep. 15, 2017, granted, now 10,402,689.
Claims priority of provisional application 62/481,415, filed on Apr. 4, 2017.
Prior Publication US 2023/0362331 A1, Nov. 9, 2023
Int. Cl. G06T 7/11 (2017.01); G06F 18/214 (2023.01); G06F 18/24 (2023.01); G06N 3/04 (2023.01); G06N 3/08 (2023.01); G06T 7/194 (2017.01); G06V 10/82 (2022.01); G06V 30/19 (2022.01); G06V 30/242 (2022.01); H04N 7/14 (2006.01); H04N 5/445 (2011.01); H04N 5/76 (2006.01)
CPC H04N 7/147 (2013.01) [G06F 18/214 (2023.01); G06F 18/24765 (2023.01); G06N 3/04 (2013.01); G06N 3/08 (2013.01); G06T 7/11 (2017.01); G06T 7/194 (2017.01); G06V 10/82 (2022.01); G06V 30/19173 (2022.01); G06V 30/242 (2022.01); G06T 2207/10016 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/20024 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/20221 (2013.01); G06T 2207/30201 (2013.01); H04N 5/44504 (2013.01); H04N 5/76 (2013.01); H04N 7/141 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method comprising:
generating, by a processor of a device, an image of a user of the device;
generating an initial mask by applying a segmentation neural network to the image of the user;
refining borders of labeled areas of the initial mask by applying a post-processing engine to the initial mask to generate an output mask;
generating a modified image based on the output mask; and
storing the modified image on the device,
wherein the post-processing engine comprises a guided filter using a downsampled image of the image and a grayscale image of the downsampled image to generate the output mask,
wherein the guided filter further uses an eroded mask of the initial mask and a resized mask of the eroded mask to generate the output mask.