US 11,887,224 B2
Method, apparatus, and computer program for completing painting of image, and method, apparatus, and computer program for training artificial neural network
Sungmin Kang, Seongnam-si (KR); and Jaehyuk Chang, Seongnam-si (KR)
Assigned to NAVER WEBTOON LTD., Seongnam-si (KR)
Filed by NAVER WEBTOON LTD., Seongnam-si (KR)
Filed on Apr. 28, 2021, as Appl. No. 17/242,831.
Application 17/242,831 is a continuation of application No. PCT/KR2019/010556, filed on Aug. 20, 2019.
Claims priority of application No. 10-2018-0133842 (KR), filed on Nov. 2, 2018.
Prior Publication US 2021/0248795 A1, Aug. 12, 2021
Int. Cl. G06T 5/00 (2006.01); G06N 3/08 (2023.01); G06T 11/00 (2006.01); G06T 11/40 (2006.01); G06F 16/583 (2019.01); G06F 16/532 (2019.01); G06N 3/04 (2023.01)
CPC G06T 11/40 (2013.01) [G06F 16/532 (2019.01); G06F 16/5838 (2019.01); G06N 3/04 (2013.01); G06N 3/08 (2013.01); G06T 5/001 (2013.01); G06T 11/001 (2013.01); G06T 2200/24 (2013.01); G06T 2207/20084 (2013.01)] 11 Claims
OG exemplary drawing
 
1. A method of completing coloring of an image based on a query regarding a color-unknown region in the image and an answer to the query, the method comprising:
generating, by using an artificial neural network, a first intermediate image in which at least one uncolored region in a primary image is colored;
generating, by using the artificial neural network, a first color query regarding the at least one color-unknown region in the primary image; and
generating a secondary image based on at least one of the first color query, a first answer to the first color query, and the first intermediate image,
wherein the artificial neural network is a neural network that further learned a corresponding relationship between an input image in which a first region is not colored, a third color query regarding a colored second region of the input image, a third answer to the third color query, an output image in which the first region is colored, and a fourth color query regarding the output image, and
wherein the second region is a region colored according to the third color query of the input image and the third answer.