US 12,072,934 B2
Entity cards including descriptive content relating to entities from a video
Jonathan Matthew Malmaud, Campbell, CA (US); Nicolas Paul-Stringall Higuera, Davis, CA (US); Jeff Hsu, Milpitas, CA (US); Sarah Fay Smith, San Francisco, CA (US); Gabriel Rubow Culbertson, Madison, WI (US); and Runmin Zhao, Mountain View, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Dec. 30, 2022, as Appl. No. 18/091,837.
Claims priority of provisional application 63/341,674, filed on May 13, 2022.
Prior Publication US 2023/0367810 A1, Nov. 16, 2023
Int. Cl. G06F 16/78 (2019.01); G06F 16/783 (2019.01); H04N 21/4722 (2011.01)
CPC G06F 16/7844 (2019.01) [G06F 16/7837 (2019.01); H04N 21/4722 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for a server system, comprising:
obtaining a transcription of content from a video;
applying a machine learning resource to identify one or more entities most likely to be searched for by a user viewing the video, based on the transcription of the content;
generating one or more entity cards for each of the one or more entities, each of the one or more entity cards including descriptive content relating to a respective entity among the one or more entities; and
providing a user interface, to be displayed on a respective display of one or more user computing devices, for:
playing the video on a first portion of the user interface, and
when the video is played and a first entity among the one or more entities is mentioned in the video, displaying a first entity card on a second portion of the user interface, the first entity card including descriptive content relating to the first entity.