US 12,216,702 B1
Redirection to digital content based on image-search
Kirk Ouimet, Orem, UT (US); Rong Yan, Marina Del Rey, CA (US); Yantao Zheng, Venice, CA (US); Timothy Michael Sehn, Marina Del Rey, CA (US); and Evan Spiegel, Venice, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jan. 28, 2016, as Appl. No. 15/008,956.
Claims priority of provisional application 62/264,549, filed on Dec. 8, 2015.
Int. Cl. G06F 16/51 (2019.01); G06F 16/583 (2019.01)
CPC G06F 16/51 (2019.01) [G06F 16/583 (2019.01)] 15 Claims
OG exemplary drawing
 
1. A method to perform image-based searching, the method comprising:
for each of a plurality of visitor destinations at respective sub-locations of a real-world physical establishment:
receiving from a content owner associated with the establishment image data specific to the respective sub-location;
receiving from the content owner audio index data comprising a plurality of recordings made at the respective sub-location; and
receiving from the content owner location index data specific to the respective visitor destination;
in an automated procedure performed using one or more computer processor devices configured for performance of the automated procedure, compiling and storing on a machine-readable memory a respective index specific to each visitor destination, thereby provisioning a plurality of indexes corresponding to the plurality of visitor destinations, each index being provided by a respective data structure that is specific to the corresponding visitor destination and that comprises:
the image data of the respective visitor destination,
the location index data of the respective sub-location,
the audio index data associated with the respective sub-location, and
text index data that includes words that are frequently spoken by guides or visitors in proximity to the respective sub-location and that pertain to subject matter available for visitor consumption at the corresponding visitor destination;
receiving from a mobile computing device of a user a search query comprising one or more query items selected from: a query image, textual query data, and audio data associated with the query image;
in an automated operation based at least in part on the plurality of indexes and performed using one or more computer processor devices configured for performance of the automated operation, identifying as a target visitor destination at the establishment one of the plurality of visitor destinations at the respective sub-locations of the establishment based at least in part on determining a correlation between the search query and the index specific to the target visitor destination; and
responsive to determining of the correlation, based at least in part on the determining of the correlation and based at least in part on associated map information, directing the mobile computing device of the user to the sub-location of the identified target visitor destination situated within the establishment.