US 12,445,717 B2
Techniques for enhanced image capture using a computer-vision network
William Castillo, Belmont, CA (US); Brandon Scott, New York, NY (US); Alrik Firl, San Francisco, CA (US); David Royston Cutts, San Francisco, CA (US); Jonathan Mark Igner, San Francisco, CA (US); Dario Rethage, Kendall Park, NJ (US); Domenico Curro, San Francisco, CA (US); Giridhar Murali, Sunnyvale, CA (US); and Panfeng Li, San Francisco, CA (US)
Assigned to Hover Inc., San Francisco, CA (US)
Filed by Hover Inc., San Francisco, CA (US)
Filed on Jan. 29, 2021, as Appl. No. 17/163,043.
Claims priority of provisional application 63/140,716, filed on Jan. 22, 2021.
Claims priority of provisional application 63/059,093, filed on Jul. 30, 2020.
Claims priority of provisional application 62/968,977, filed on Jan. 31, 2020.
Prior Publication US 2021/0243362 A1, Aug. 5, 2021
Int. Cl. H04N 23/60 (2023.01); G06F 3/16 (2006.01); G06T 7/11 (2017.01); G06T 7/12 (2017.01); G06T 7/174 (2017.01); G06T 7/277 (2017.01); G06T 7/73 (2017.01); G06T 15/00 (2011.01); G06T 17/00 (2006.01); G06V 10/26 (2022.01); G06V 10/44 (2022.01); G06V 30/19 (2022.01); G06V 30/414 (2022.01); H04N 23/63 (2023.01)
CPC H04N 23/64 (2023.01) [G06T 7/11 (2017.01); G06T 7/12 (2017.01); G06T 7/174 (2017.01); G06T 7/277 (2017.01); G06T 7/74 (2017.01); G06T 17/00 (2013.01); G06V 10/26 (2022.01); G06V 10/44 (2022.01); H04N 23/635 (2023.01); G06F 3/167 (2013.01); G06T 15/00 (2013.01); G06T 2207/20072 (2013.01); G06T 2207/20084 (2013.01); G06T 2210/00 (2013.01); G06V 30/19013 (2022.01); G06V 30/19107 (2022.01); G06V 30/414 (2022.01)] 18 Claims
OG exemplary drawing
 
1. A computer-implemented method, comprising:
capturing a set of pixels representing a scene visible to an image capturing device including a display, the set of pixels including a plurality of border pixels, and each border pixel of the plurality of border pixels being located at or within a defined range of a boundary of the set of pixels;
detecting a physical structure depicted within the set of pixels, the physical structure being represented by a subset of the set of pixels;
generating a segmentation mask associated with the physical structure depicted within the set of pixels, the segmentation mask including one or more segmentation pixels, wherein the segmentation mask comprises an irregular shape that conforms to contours of the subset of the set of pixels;
determining a pixel value for each border pixel of the plurality of border pixels;
generating an indicator based on the pixel value of one or more border pixels of the plurality of border pixels by:
determining a number of the one or more border pixels with pixel values indicating overlap with the one or more segmentation pixels; and
generating the indicator based on whether the number of the one or more border pixels with pixel values indicating overlap with the one or more segmentation pixels exceeds a threshold percentage of the plurality of border pixels; and
presenting the indicator, the indicator representing an instruction for framing the physical structure within the display.