US 12,394,100 B2
Video coding using camera motion compensation and object motion compensation
Hoang Cong Minh Le, La Jolla, CA (US); Reza Pourreza, San Diego, CA (US); and Amir Said, San Diego, CA (US)
Assigned to QUALCOMM Incorporated, San Diego, CA (US)
Filed by QUALCOMM Incorporated, San Diego, CA (US)
Filed on Jul. 11, 2022, as Appl. No. 17/862,149.
Prior Publication US 2024/0013441 A1, Jan. 11, 2024
Int. Cl. G06T 9/00 (2006.01); G06T 3/18 (2024.01); G06T 3/40 (2024.01); G06T 7/246 (2017.01); G06T 7/50 (2017.01)
CPC G06T 9/00 (2013.01) [G06T 3/18 (2024.01); G06T 3/40 (2013.01); G06T 7/248 (2017.01); G06T 7/50 (2017.01); G06T 2207/20084 (2013.01); G06T 2207/20224 (2013.01)] 30 Claims
OG exemplary drawing
 
1. An apparatus for decoding video data, the apparatus comprising:
at least one memory; and
at least one processor coupled to the at least one memory, the at least one processor configured to:
obtain a frame of encoded video data associated with an input frame, the frame of encoded video data including camera information associated with generating the video data and a residual, wherein the camera information includes camera pose information associated with the input frame;
warp a reference frame using the camera information to generate a camera motion compensated frame;
generate optical flow information associated with object motion determined based on at least the input frame and the reference frame;
warp the camera motion compensated frame using the optical flow information to generate a motion compensated frame; and
generate, based on the motion compensated frame and the residual, a reconstructed input frame.