CPC G06T 3/40 (2013.01) [H04N 1/00244 (2013.01)] | 18 Claims |
10. A processor-based method of capturing user consumption of information, the method comprising:
receiving image data comprising a series of screen image snapshots being presented on a screen of a client device, the screen image snapshots comprising respective timestamps;
receiving audio data captured by a microphone of the client device;
receiving metadata comprising image metadata, audio metadata, and client device metadata, the metadata comprising timestamps corresponding to the image data and to the audio data;
determining one or more first matches to the image data;
determining one or more second matches to the audio data; and
aggregating the one or more first matches and the one or more second matches based on the metadata to identify an exposure to an event, the aggregating of the one or more first matches and the one or more second matches being based on a temporal alignment of the timestamps corresponding to the image data and the audio data.
|