US 12,244,936 B2
On-sensor image processor utilizing contextual data
Andrew Samuel Berkovich, Bellevue, WA (US); and Xinqiao Liu, Medina, WA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Dec. 30, 2022, as Appl. No. 18/148,834.
Claims priority of provisional application 63/303,214, filed on Jan. 26, 2022.
Prior Publication US 2023/0239582 A1, Jul. 27, 2023
Int. Cl. H04N 23/84 (2023.01); G02B 27/01 (2006.01); H01L 27/146 (2006.01); H04N 25/772 (2023.01)
CPC H04N 23/84 (2023.01) [G02B 27/017 (2013.01); H01L 27/14641 (2013.01); H01L 27/14645 (2013.01); H04N 25/772 (2023.01); G02B 2027/0178 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A sensor apparatus comprising:
an array of pixel cells, each pixel cell of the array of pixel cells including one or more photodiodes configured to generate a charge in response to light, and a charge storage device of one or more charge storage devices to convert the charge to output a voltage of an array of voltages;
one or more analog-to-digital converters (ADC) configured the convert the array of voltages to first pixel data; and
a controller configured to:
receive the first pixel data from the ADC;
input the first pixel data into a machine-learning model to generate output data comprising prediction data associated with one or more features of the first pixel data;
generate, based on the prediction data, second pixel data, the second pixel data associated with one or more transformed features of the first pixel data; and
send, from the sensor apparatus to a separate receiving apparatus, the second pixel data.