US 12,475,537 B2
Method and system for image processing
Thomas Davies, Toronto (CA); Ali Mahdavi-Amiri, North Vancouver (CA); Matthew Panousis, Toronto (CA); Jonathan Bronfman, Toronto (CA); Lon Molnar, Toronto (CA); Paul Birulin, Toronto (CA); Debjoy Chowdhury, Toronto (CA); Ishrat Badami, Toronto (CA); and Anton Skourides, Toronto (CA)
Assigned to MONSTERS ALIENS ROBOTS ZOMBIES INC., Toronto (CA)
Filed by MONSTERS ALIENS ROBOTS ZOMBIES INC., Toronto (CA)
Filed on Jan. 16, 2024, as Appl. No. 18/413,914.
Application 18/413,914 is a continuation of application No. 17/696,535, filed on Mar. 16, 2022, granted, now 11,875,491.
Claims priority of provisional application 63/161,967, filed on Mar. 16, 2021.
Prior Publication US 2024/0273676 A1, Aug. 15, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 5/50 (2006.01); G06T 7/11 (2017.01); G06T 11/60 (2006.01); G06V 10/774 (2022.01); G06V 40/10 (2022.01)
CPC G06T 5/50 (2013.01) [G06T 7/11 (2017.01); G06T 11/60 (2013.01); G06V 10/774 (2022.01); G06V 40/10 (2022.01); G06T 2207/20084 (2013.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer system configured to automatically interpolate or extrapolate visual modifications from a set of keyframes extracted from a set of target video frames, the system comprising:
a computer processor, operating in conjunction with computer memory maintaining a machine learning model architecture, the computer processor configured to:
receive the set of target video frames;
identify, from the set of target video frames, the set of keyframes;
provide the set of keyframes for visual modification;
receive a set of modified keyframes;
train the machine learning model architecture using the set of modified keyframes and the set of keyframes, the machine learning model architecture configured for reconstruction of the set of modified keyframes from the set of keyframes to obtain a trained machine learning model architecture; and
process one or more frames of the set of target video frames to generate a corresponding set of modified target video frames having the automatically interpolated or extrapolated visual modifications.