US 12,340,517 B2
Image processing to detect edges, walls, and surfaces for a virtual painting application
Douglas Milsom, Tacoma, WA (US); Un Ho Chung, Santa Ana, CA (US); Michael Askew, Chicago, IL (US); and Kiki Takakura-Merquise, San Mateo, CA (US)
Assigned to Behr Process LLC, Santa Ana, CA (US)
Filed by Behr Process LLC, Santa Ana, CA (US)
Filed on Jun. 3, 2024, as Appl. No. 18/731,836.
Application 18/731,836 is a continuation of application No. 18/225,714, filed on Jul. 25, 2023, granted, now 12,008,766.
Claims priority of provisional application 63/392,345, filed on Jul. 26, 2022.
Prior Publication US 2024/0346661 A1, Oct. 17, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06K 9/48 (2006.01); G06T 3/40 (2006.01); G06T 7/00 (2017.01); G06T 7/13 (2017.01); G06T 7/50 (2017.01); G06V 10/46 (2022.01); G06V 10/56 (2022.01)
CPC G06T 7/13 (2017.01) [G06T 3/40 (2013.01); G06T 7/0002 (2013.01); G06T 7/50 (2017.01); G06V 10/46 (2022.01); G06V 10/56 (2022.01); G06T 2207/20044 (2013.01); G06T 2207/20132 (2013.01); G06T 2207/30168 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
generating a depth map by performing a depth estimation on an image of a scene having at least one wall;
generating a first edge map that includes a first set of edge lines outlining the at least one wall by performing edge detection on the image;
generating a second edge map that includes a second set of edge lines of the scene by performing edge detection on the depth map;
generating a third edge map by thinning a width of each edge line in the first set of edge lines;
generating a fourth edge map by performing a skeletonization function on the depth map;
generating a final edge map based on the third edge map and the fourth edge map;
generating a colorized image by applying color to the final edge map to paint the at least one wall; and
displaying the colorized image on a display of a device.