US 11,880,408 B2
Interacting with hierarchical clusters of video segments using a metadata search
Seth Walker, Oakland, CA (US); Joy Oakyung Kim, Menlo Park, CA (US); Morgan Nicole Evans, Seattle, WA (US); Najika Skyler Halsema Yoo, Seattle, WA (US); Aseem Agarwala, Seattle, WA (US); Joel R. Brandt, Venice, CA (US); Jovan Popović, Seattle, WA (US); Lubomira Dontcheva, Seattle, WA (US); Dingzeyu Li, Seattle, WA (US); Hijung Shin, Arlington, MA (US); and Xue Bai, Bellevue, WA (US)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by ADOBE INC., San Jose, CA (US)
Filed on Sep. 10, 2020, as Appl. No. 17/017,370.
Prior Publication US 2022/0075820 A1, Mar. 10, 2022
Int. Cl. G06F 16/75 (2019.01); G06F 16/738 (2019.01); G06T 13/80 (2011.01); G06F 3/0482 (2013.01); G06F 16/74 (2019.01); G06F 16/735 (2019.01); G06F 3/0484 (2022.01)
CPC G06F 16/738 (2019.01) [G06F 3/0482 (2013.01); G06F 3/0484 (2013.01); G06F 16/735 (2019.01); G06F 16/743 (2019.01); G06F 16/75 (2019.01); G06T 13/80 (2013.01)] 20 Claims
OG exemplary drawing
 
1. One or more computer storage media storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations comprising:
accessing a hierarchical segmentation of a video timeline of a video, the hierarchical segmentation associating extracted metadata extracted from the video by one or more machine learning models with corresponding video segments defined by a first level of the hierarchical segmentation;
receiving, via a search bar of a user interface, an input identifying a textual search criterion;
executing a search of the extracted metadata using the textual search criterion to identify matching metadata segments of the extracted metadata and corresponding matching video segments of video segments defined by the first level of the hierarchical segmentation; and
causing the user interface to visually emphasize, on the video timeline, the corresponding matching video segments that are from the first level and correspond to the matching metadata segments that match the input in the search bar.