US 11,734,729 B2
Systems and methods for annotating online content with offline interaction data
Vinod Kumar Ramachandran, Mountain View, CA (US); Surojit Chatterjee, Los Altos, CA (US); and Philip McDonnell, Belmont, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Dec. 11, 2020, as Appl. No. 17/119,264.
Application 17/119,264 is a continuation of application No. 15/833,902, filed on Dec. 6, 2017, granted, now 10,885,560.
Application 15/833,902 is a continuation of application No. 14/505,612, filed on Oct. 3, 2014, abandoned.
Prior Publication US 2021/0097583 A1, Apr. 1, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06Q 30/0242 (2023.01); G06Q 30/0241 (2023.01); G06Q 50/00 (2012.01)
CPC G06Q 30/0277 (2013.01) [G06Q 30/0242 (2013.01); G06Q 50/01 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A system, comprising:
memory and one or more processors to:
receive offline interaction data comprising a first identifier and an indication of an interaction between a merchant computing device located at a physical location of a merchant and a first computing device associated with an online user;
receive a first audio-based input detected by a microphone of the first computing device and a second identifier corresponding to the online user providing the first audio-based input;
receive a second audio-based input detected by a microphone of a second computing device:
identify, responsive to receipt of the first audio-based input, a first request in the first audio-based input;
identify a second request in the second audio-based input;
compare the second identifier with the first identifier to determine that the first audio-based input and the interaction are associated with the online user;
identify, responsive to the determination that the first audio-based input and the interaction are associated with the online user, a first content item based on the first request and the offline interaction data;
select a second content item based on the second request;
generate an annotation based on received online interaction data; and
transmit, responsive to the first audio-based input, the first content item to the first computing device and the second content item with the annotation to the second computing device.