US 12,475,673 B2
Smart sensor implementations of region of interest operating modes
Nirav Dharia, Milpitas, CA (US); and Lucian Ion, Santa Clara, CA (US)
Assigned to Waymo LLC, Mountain View, CA (US)
Filed by Waymo LLC, Mountain View, CA (US)
Filed on Jul. 24, 2023, as Appl. No. 18/225,329.
Application 18/225,329 is a continuation of application No. 17/123,440, filed on Dec. 16, 2020, granted, now 11,756,283.
Prior Publication US 2023/0368488 A1, Nov. 16, 2023
Int. Cl. G06V 10/20 (2022.01); G06T 7/246 (2017.01); G06V 40/16 (2022.01); H04N 23/70 (2023.01); H04N 23/80 (2023.01); H04N 23/951 (2023.01)
CPC G06V 10/255 (2022.01) [G06T 7/246 (2017.01); G06V 40/162 (2022.01); H04N 23/70 (2023.01); H04N 23/80 (2023.01); H04N 23/951 (2023.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
obtaining, by circuitry and from an image sensor comprising a plurality of pixels that form a plurality of regions of interest (ROIs), one or more ROI images representing of an environment and generated by one or more ROIs of the plurality of ROIs;
detecting, by the circuitry and based on the one or more ROI images, an object of interest;
determining an attribute associated with the object of interest based on processing the one or more ROI images using an image processing resource of the circuitry;
selecting, by the circuitry and based on the attribute associated with the object of interest, a mode of operation from a plurality of predetermined modes of operation, wherein each respective mode of operation of the plurality of predetermined modes of operation indicates a corresponding predetermined sequence of image data types to be captured by the image sensor and processed by the image processing resource during one or more subsequent processing cycles to which the mode of operation corresponds; and
processing, by the image processing resource and based on the mode of operation, subsequent image data during the one or more subsequent processing cycles, wherein the subsequent image data comprises the corresponding predetermined sequence of the image data types of the mode of operation of the object of interest.