US 12,087,055 B2
Real time object detection and tracking
Ibrahim Badr, New York, NY (US); Roland Peter Kehl, Dubendorf (CH); Kaan Yucer, San Francisco, CA (US); Thomas Jonathan Stone, Zürich (CH); Gokhan H. Bakir, Zürich (CH); and Adrian Zumbrunnen, Zürich (CH)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Mar. 22, 2023, as Appl. No. 18/188,005.
Application 18/188,005 is a continuation of application No. 16/347,484, granted, now 11,651,589, previously published as PCT/IB2018/053167, filed on May 7, 2018.
Prior Publication US 2023/0222792 A1, Jul. 13, 2023
Int. Cl. G06V 20/20 (2022.01); G06F 18/24 (2023.01); G06T 7/246 (2017.01); G06T 7/73 (2017.01); G06V 10/764 (2022.01); G06V 20/50 (2022.01); H04N 23/61 (2023.01); H04N 23/63 (2023.01)
CPC G06V 20/20 (2022.01) [G06F 18/24 (2023.01); G06T 7/248 (2017.01); G06T 7/74 (2017.01); G06V 10/764 (2022.01); G06V 20/50 (2022.01); H04N 23/61 (2023.01); H04N 23/63 (2023.01); H04N 23/633 (2023.01); G06T 2207/10016 (2013.01); G06T 2207/30244 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method performed by one or more data processing apparatus of a mobile device, the method comprising:
detecting presence of a plurality of objects depicted in a viewfinder of a camera of the mobile device;
in response to detecting the presence of the plurality of objects:
sending image data representing the plurality of objects to a content distribution system that selects content related to the plurality of objects depicted in the image data, and wherein the content distribution system is remotely located from the mobile device; and
tracking the respective location of each of the plurality of objects in the viewfinder of the camera while waiting to receive the content related to the plurality of objects depicted in the image data from the content distribution system;
receiving, from the content distribution system, the content related to the plurality of objects; and
for each of the plurality of objects:
determining, based on the tracking, a respective current location of the object in the viewfinder; and
presenting, within the viewfinder and at the respective current location of the object, the received content related to the object.