US 12,108,141 B2
Dynamically programmable image sensor
Andrew Samuel Berkovich, Bellevue, WA (US); Reid Pinkham, Redmond, WA (US); and Tanner Schmidt, Seattle, WA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Aug. 3, 2020, as Appl. No. 16/983,863.
Claims priority of provisional application 62/883,014, filed on Aug. 5, 2019.
Prior Publication US 2021/0044742 A1, Feb. 11, 2021
Int. Cl. H04N 23/617 (2023.01); G06N 3/02 (2006.01); H01L 27/146 (2006.01); H04N 23/60 (2023.01); H04N 23/80 (2023.01); H04N 25/443 (2023.01)
CPC H04N 23/617 (2023.01) [G06N 3/02 (2013.01); H01L 27/14634 (2013.01); H01L 27/14636 (2013.01); H04N 23/665 (2023.01); H04N 23/80 (2023.01); H04N 25/443 (2023.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus comprising:
a pixel cell array, each pixel cell in the pixel cell array including a photodiode and processing circuits, the photodiodes being formed in a first semiconductor substrate and the processing circuits formed in one or more second semiconductor substrates; and
a controller formed in at least one of the one or more second semiconductor substrates, the first semiconductor substrate and the one or more second semiconductor substrates forming a stack and housed within a semiconductor package;
wherein the pixel cell array is configured to:
capture pixel data at a first time;
generate, based on the pixel data and first programming signals received from the controller, a first image frame, the first programming signals identifying a first plurality of pixels in the pixel cell array;
generate a second image frame based on the pixel data and second programming signals, the second programming signals identifying a second plurality of pixels in the pixel cell array and having a different sparsity of pixels from the first image frame;
transmit the first image to a host processor; and
transmit the first image frame or the second image frame to the controller; and
wherein the controller is configured to:
receive the first image frame or the second image frame from the pixel cell array;
receive updated programming signals from the host processor, the updated programming signals being determined by the host processor based on the first image frame;
update the second programming signals based on the updated programming signals; and
control the pixel cell array to:
capture second pixel data at a second time; and
generate subsequent first and second image frames at the second time, the subsequent second image frame based on the updated second programming signals.