US 11,681,919 B2
Automatically selecting query objects in digital images
Khoi Pham, Hyattsville, MD (US); Scott Cohen, Sunnyvale, CA (US); Zhe Lin, Fremont, CA (US); Zhihong Ding, Fremont, CA (US); and Walter Wei Tuh Chang, San Jose, CA (US)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on May 26, 2021, as Appl. No. 17/331,161.
Application 17/331,161 is a continuation of application No. 16/817,418, filed on Mar. 12, 2020, granted, now 11,055,566.
Prior Publication US 2021/0319255 A1, Oct. 14, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 10/00 (2022.01); G06N 3/08 (2023.01); G06F 18/2113 (2023.01); G06F 18/214 (2023.01); G06F 18/21 (2023.01); G06V 10/764 (2022.01); G06V 10/771 (2022.01); G06V 10/774 (2022.01); G06V 10/82 (2022.01)
CPC G06N 3/08 (2013.01) [G06F 18/2113 (2023.01); G06F 18/2155 (2023.01); G06F 18/2163 (2023.01); G06V 10/764 (2022.01); G06V 10/765 (2022.01); G06V 10/771 (2022.01); G06V 10/7753 (2022.01); G06V 10/82 (2022.01)] 20 Claims
OG exemplary drawing
 
1. In a digital medium environment for creating or editing digital images, a computer-implemented method of selecting query objects, comprising:
in response to receiving a query string to select a query object within a digital image, generating a plurality of region proposals for objects detected in the digital image utilizing a region proposal model;
generating a heat mask of the digital image that indicates areas in the digital image that potentially contain the query object;
adding an additional region proposal to the plurality of region proposals based on identifying an area in the heat mask that is missing a region proposal from the plurality of region proposals;
generating object labels for the plurality of region proposals; and
detecting the query object based on comparing the object labels generated for the plurality of region proposals with the query string.