US 11,709,881 B2
Visual menu
Cesar Morais Palomo, Zurich (CH); and Haroon Baig, Zurich (CH)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Mar. 12, 2021, as Appl. No. 17/200,020.
Application 17/200,020 is a continuation of application No. 16/470,682, granted, now 10,963,696, issued on Mar. 30, 2021, previously published as PCT/US2018/041247, filed on Jul. 9, 2018.
Prior Publication US 2021/0216772 A1, Jul. 15, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 19/00 (2011.01); G06F 16/532 (2019.01); G06F 16/583 (2019.01); G06F 16/2457 (2019.01); G06F 40/205 (2020.01); G06V 20/20 (2022.01); G06F 18/21 (2023.01)
CPC G06F 16/532 (2019.01) [G06F 16/24578 (2019.01); G06F 16/5846 (2019.01); G06F 18/217 (2023.01); G06F 40/205 (2020.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method of identifying content corresponding to text items, comprising:
receiving, with one or more processors, a captured image of captured text from an image capture device;
parsing, with the one or more processors, the captured text in the captured image, wherein the parsed text is associated with at least one first label;
determining, with the one or more processors, an entity associated with the captured text based on information in the captured image or from user input;
identifying, with the one or more processors, images corresponding to the parsed text and the entity, wherein the identified images are associated with at least one second label;
selecting, with the one or more processors based on a comparison of the at least one first label and the at least one second label, at least one of the identified images; and
providing, with the one or more processors, the selected image for display as an augmented reality overlay in relation to the captured text.