US 12,223,661 B2
System for automatic object mask and hotspot tracking
Lu Zhang, Dalian (CN); Jianming Zhang, Campbell, CA (US); Zhe Lin, Fremont, CA (US); and Radomir Mech, Mountain View, CA (US)
Assigned to ADOBE INC., San Jose, CA (US)
Filed by ADOBE INC., San Jose, CA (US)
Filed on May 3, 2022, as Appl. No. 17/735,728.
Application 17/735,728 is a continuation of application No. 16/900,483, filed on Jun. 12, 2020, granted, now 11,367,199.
Prior Publication US 2022/0262011 A1, Aug. 18, 2022
Int. Cl. G06T 7/11 (2017.01); G06F 3/01 (2006.01); G06F 3/04845 (2022.01); G06N 3/02 (2006.01); G06T 7/00 (2017.01); G06T 7/20 (2017.01); G06T 11/60 (2006.01)
CPC G06T 7/20 (2013.01) [G06F 3/013 (2013.01); G06F 3/04845 (2013.01); G06N 3/02 (2013.01); G06T 7/0012 (2013.01); G06T 11/60 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30041 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
generating a mask of an object in a video segment based on an initial frame of the video segment and a first focal region associated with the object in the initial frame;
for each frame of a plurality of frames of the video segment, generating, based on the frame and the mask of the object, using a neural network, a corresponding focal region associated with the mask of the object that tracks the object through the plurality of frames; and
executing an operation based on the corresponding focal region for one or more frames of the plurality of frames.