US 11,736,822 B1
Controlling an image sensor based on GPU temporal processing values
Bertrand Nepveu, Los Altos, CA (US); Marc-Andre Chenier, Saint-Hyacinthe (CA); Yan Cote, Notre-Dame-de-l'ile-Perrot (CA); and Yves Millette, Santa Clara, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Feb. 16, 2021, as Appl. No. 17/176,771.
Claims priority of provisional application 62/983,144, filed on Feb. 28, 2020.
Int. Cl. G06T 1/60 (2006.01); G06T 1/20 (2006.01); H04N 23/80 (2023.01); H04N 5/351 (2011.01)
CPC H04N 5/351 (2013.01) [G06T 1/20 (2013.01); G06T 1/60 (2013.01); H04N 23/80 (2023.01)] 21 Claims
OG exemplary drawing
 
1. A method comprising:
at an electronic device including a controller, a non-transitory memory, and a graphics processing unit (GPU):
obtaining a first plurality of image frames that are provided by an image sensor at a first output rate;
determining a GPU temporal processing value characterizing the GPU processing of the first plurality of image frames, wherein the GPU temporal processing value is a function of an amount of information associated with the first plurality of image frames;
determining an operation value associated with the image sensor based on a function of the GPU temporal processing value, wherein the operation value modifies the operation of the image sensor; and
changing, using the controller, the operation of the image sensor as a function of the operation value so that the image sensor provides a second plurality of image frames at a second output rate.