US 12,001,475 B2
Mobile image search system
Jonathan Brody, Marina Del Rey, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Dec. 18, 2020, as Appl. No. 17/127,460.
Application 17/127,460 is a continuation of application No. 15/640,124, filed on Jun. 30, 2017, granted, now 10,909,425.
Application 15/640,124 is a continuation of application No. 15/247,697, filed on Aug. 25, 2016, granted, now 10,157,333.
Claims priority of provisional application 62/358,461, filed on Jul. 5, 2016.
Prior Publication US 2021/0103779 A1, Apr. 8, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 1/00 (2006.01); G06F 16/58 (2019.01); G06F 16/9038 (2019.01); G06F 18/24 (2023.01); G06N 3/04 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2023.01); G06N 5/022 (2023.01); G06V 10/75 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); H04N 23/63 (2023.01)
CPC G06F 16/5866 (2019.01) [G06F 16/9038 (2019.01); G06F 18/24 (2023.01); G06N 3/04 (2013.01); G06N 3/045 (2023.01); G06N 3/08 (2013.01); G06T 1/0007 (2013.01); G06V 10/751 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); H04N 23/63 (2023.01); G06N 5/022 (2013.01); G06V 2201/09 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A mobile device comprising:
a display;
a memory comprising a content database;
an image sensor coupled to the memory and configured to capture image data for a first image; and
one or more processors coupled to the memory, the display, and the image sensor, and configured to performing operations comprising:
accessing the image data for the first image;
processing, by the one or more processors, the image data using a filter convolved across a width and a height of the first image in a neural network to determine one or more characteristics of the image data selected from a set of tags and based at least in part on image content of the first image, the neural network comprising a first layer and a second layer in a first subgraph;
determining that the first and second layers in the first subgraph comprises an output of the neural network;
associating each tag of the set of tags with the output;
storing the one or more characteristics of the image data in the content database;
processing a user input requesting a user interface output on the display;
presenting the user interface with a first plurality of images comprising the first image, wherein the plurality of images are based on a set of default search content characteristics from the content database; and
responsive to determining that the first and second layer do not comprise the output, reserving a location in the memory associated with the image data comprising the one or more characteristics.