US 12,346,374 B2
Graph-based video indexing to support querying with implicit relations
Oron Nir, Herzeliya (IL); Ika Bar-Menachem, Herzeliya (IL); and Inbal Sagiv, Kfar Saba (IL)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on Dec. 16, 2022, as Appl. No. 18/067,294.
Prior Publication US 2024/0202240 A1, Jun. 20, 2024
Int. Cl. G06F 16/735 (2019.01); G06F 16/71 (2019.01); G06F 16/738 (2019.01); G06F 16/783 (2019.01)
CPC G06F 16/735 (2019.01) [G06F 16/71 (2019.01); G06F 16/738 (2019.01); G06F 16/784 (2019.01)] 17 Claims
OG exemplary drawing
 
1. A method comprising:
creating a merged relational graph by:
obtaining relational graph data created for a video, the relational graph data including a video node identifying video subject nodes that identify multiple subjects of the video;
retrieving implicit relational data for each of the multiple subjects identified in the relational graph data by querying a knowledge graph with unique identifiers corresponding to the multiple subjects; and
merging the implicit relational data retrieved from the knowledge graph with the relational graph data created for the video;
indexing the merged relational graph in a video-based database by combining the merged relational graph with other graphs of common format previously created for other videos;
receiving a video search query via a search interface, the video search query specifying an implicit relation identifying a fact satisfied by video content that is not evident from viewing the video content without access to an external data source;
identifying, based on the merged relational graph, the video content that is characterized by the implicit relation; and
providing, responsive to the query via the search interface, search results that identify the video content.