US 12,223,663 B2
Frame processing and/or capture instruction systems and techniques
Mark Gintsburg, Haifa (IL); Nir Strauss, Yokneam Moshava (IL); Ron Gaizman, Hof HaCarmel (IL); Eran Pinhasov, Zichron Yaakov (IL); Yuri Dolgin, Haifa (IL); and Victor Pinto, Zichron Yaakov (IL)
Assigned to QUALCOMM Incorporated, San Diego, CA (US)
Filed by QUALCOMM Incorporated, San Diego, CA (US)
Filed on Apr. 26, 2021, as Appl. No. 17/240,837.
Claims priority of provisional application 63/108,221, filed on Oct. 30, 2020.
Prior Publication US 2022/0138964 A1, May 5, 2022
Int. Cl. G06T 7/215 (2017.01); G06N 20/00 (2019.01); G06T 7/246 (2017.01); H04N 5/14 (2006.01); H04N 23/73 (2023.01)
CPC G06T 7/246 (2017.01) [G06N 20/00 (2019.01); G06T 7/215 (2017.01); H04N 5/144 (2013.01); H04N 23/73 (2023.01)] 26 Claims
OG exemplary drawing
 
1. An apparatus for processing one or more frames, comprising:
a memory; and
one or more processors coupled to the memory and configured to:
obtain a motion map for the one or more frames, wherein the motion map includes a plurality of pixels and, for each pixel, a value indicating a respective amount of motion for the respective pixel and a respective confidence value associated with the respective amount of motion for the respective pixel;
determine, based on the motion map, motion associated with the one or more frames of a scene, the motion corresponding to movement of one or more objects in the scene;
determine, based on one or more sensor measurements, global motion associated with a camera used to capture the one or more frames;
determine a weighted combination of the determined motion and the global motion using a first weight for the determined motion and a second weight for the global motion, the first weight representing a sensitivity of frame processing to movement of the one or more objects in the scene;
determine, based on the weighted combination of the determined motion and the global motion, an amount of motion in the one or more frames is less than a motion threshold;
determine a number of frames and an exposure duration for capturing the number of frames, wherein the determined number of frames is less than a previously-captured number of frames used to generate a first frame for display and the determined exposure duration is greater than an exposure duration used to capture the previously-captured number of frames based on the amount of motion in the one or more frames being less than the motion threshold;
send a request to capture the number of frames using the determined exposure duration; and
output a second frame for display based on the number of frames captured using the determined exposure duration.