US 11,902,661 B2
Device motion aware temporal denoising
Barrett Bryson, Raleigh, NC (US); and John W. Nicholson, Cary, NC (US)
Assigned to Lenovo (Singapore) Pte. Ltd., New Tech Park (SG)
Filed by Lenovo (Singapore) Pte. Ltd., New Tech Park (SG)
Filed on Jan. 6, 2022, as Appl. No. 17/569,768.
Prior Publication US 2023/0217109 A1, Jul. 6, 2023
Int. Cl. H04N 23/68 (2023.01)
CPC H04N 23/683 (2023.01) [H04N 23/6811 (2023.01); H04N 23/6812 (2023.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus for device motion aware temporal denoising, the apparatus comprising:
a processor; and
a memory that stores code executable by the processor to:
receive video data comprising a sequence of video frames that includes a current frame and one or more preceding frames captured by a video capture device that functions as a camera of a portable electronic device;
determine one or more camera motion compensation adjustments to apply to the one or more preceding frames of the sequence based on one or more non-imaging device motion sensor measurements for the video capture device;
generate a sequence of camera-motion compensated preceding frames by applying the one or more camera motion compensation adjustments to the preceding frames of the sequence; and
apply a first denoising process comprising video temporal denoising and/or video spatial denoising to first portions of the current frame which have an overlapping temporal history with the corresponding preceding frames and apply a second denoising process comprising video spatial denoising, rather than temporal denoising, to second portions of the current frame which do not have an overlapping temporal history with the corresponding preceding frames.