US 11,836,886 B2
Systems and methods for capturing and processing user consumption of information
Nathaniel D'Amico, Redwood City, CA (US); and Chandrasekhar Vijay Ramaseshan, Davis, CA (US)
Assigned to MetaConsumer, Inc., Redwood City, CA (US)
Filed by MetaConsumer, Inc., Redwood City, CA (US)
Filed on Nov. 2, 2022, as Appl. No. 17/979,336.
Application 17/979,336 is a continuation in part of application No. 17/721,186, filed on Apr. 14, 2022, granted, now 11,688,035.
Claims priority of provisional application 63/274,738, filed on Nov. 2, 2021.
Claims priority of provisional application 63/175,237, filed on Apr. 15, 2021.
Prior Publication US 2023/0061646 A1, Mar. 2, 2023
Int. Cl. G06T 3/40 (2006.01); H04N 1/00 (2006.01)
CPC G06T 3/40 (2013.01) [H04N 1/00244 (2013.01)] 18 Claims
OG exemplary drawing
 
10. A processor-based method of capturing user consumption of information, the method comprising:
receiving image data comprising a series of screen image snapshots being presented on a screen of a client device, the screen image snapshots comprising respective timestamps;
receiving audio data captured by a microphone of the client device;
receiving metadata comprising image metadata, audio metadata, and client device metadata, the metadata comprising timestamps corresponding to the image data and to the audio data;
determining one or more first matches to the image data;
determining one or more second matches to the audio data; and
aggregating the one or more first matches and the one or more second matches based on the metadata to identify an exposure to an event, the aggregating of the one or more first matches and the one or more second matches being based on a temporal alignment of the timestamps corresponding to the image data and the audio data.