US 12,094,078 B2
Systems and methods for spline-based object tracking
Apurvakumar Dilipkumar Kansara, San Jose, CA (US)
Assigned to Netlix, Inc., Los Gatos, CA (US)
Filed by Netflix, Inc., Los Gatos, CA (US)
Filed on Feb. 4, 2022, as Appl. No. 17/665,357.
Claims priority of provisional application 63/239,336, filed on Aug. 31, 2021.
Prior Publication US 2023/0064431 A1, Mar. 2, 2023
Int. Cl. G06T 3/4007 (2024.01); G06T 7/246 (2017.01); G06T 11/60 (2006.01)
CPC G06T 3/4007 (2013.01) [G06T 7/248 (2017.01); G06T 11/60 (2013.01); G06T 2207/10016 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
accessing a video portraying an object within a set of frames;
defining a subset of key frames within the video based on movement of the object across the set of frames by:
calculating a movement metric describing movement of the object between a sequential pair of frames included in the set of frames;
determining that the movement metric exceeds a predetermined threshold; and
in response to determining that the movement metric exceeds the predetermined threshold, adding one of the sequential pair of frames to the subset of key frames;
generating, for each key frame within the subset of key frames, a spline outlining the object within the key frame;
receiving input to adjust, for a selected key frame within the subset of key frames, a corresponding spline; and
interpolating the adjusted spline with a spline in a sequentially proximate key frame to define the object in frames between the selected key frame and the sequentially proximate key frame.