US 12,284,396 B2
Systems and methods for motion compensated temporal filtering during image processing operations
Jae Young Park, Los Gatos, CA (US); Jaehong Chon, San Diego, CA (US); Jim C Chou, San Jose, CA (US); and Athanasios Leontaris, Cupertino, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jan. 25, 2023, as Appl. No. 18/101,571.
Claims priority of provisional application 63/404,102, filed on Sep. 6, 2022.
Prior Publication US 2024/0080498 A1, Mar. 7, 2024
Int. Cl. H04N 19/86 (2014.01); H04N 19/436 (2014.01); H04N 19/513 (2014.01); H04N 19/52 (2014.01); H04N 19/53 (2014.01)
CPC H04N 19/86 (2014.11) [H04N 19/436 (2014.11); H04N 19/52 (2014.11); H04N 19/521 (2014.11); H04N 19/53 (2014.11)] 20 Claims
OG exemplary drawing
 
1. A video encoding system configured to encode source image data corresponding with an image, comprising:
a low-resolution encoding pipeline and a full-resolution encoding pipeline configured to generate a plurality of motion vectors; and
motion compensated temporal filtering circuitry configured to:
receive the plurality of motion vectors from the low-resolution encoding pipeline and the full-resolution encoding pipeline;
determine a plurality of source pixel values and a plurality of reference pixel values based on the plurality of motion vectors;
generate a plurality of refined motion vectors by refining the plurality of motion vectors based at least in part on the plurality of source pixel values and reference pixel values and low-resolution motion vectors;
generate a plurality of filtered pixel values by filtering the plurality of source pixel values based on determining a weighted combination of the plurality of the reference pixel values and the plurality of source pixel values, wherein the weighted combination comprises a weight value determined based on multiplying a pixel weight by a motion vector weight and a frame weight; and
output the plurality of refined motion vectors and the plurality of filtered pixel values.