US 12,323,701 B2
Apparatus and method for controlling image sensor, storage medium, and movable object
Jiong Chen, Shanghai (CN); Xianglong Gao, Shanghai (CN); Yunyue Cai, Shanghai (CN); Hao Rong, Shanghai (CN); and Yan Shi, Shanghai (CN)
Assigned to NIO TECHNOLOGY (ANHUI) CO., LTD, Hefei (CN)
Filed by NIO TECHNOLOGY (ANHUI) CO., LTD, Hefei (CN)
Filed on Jun. 10, 2022, as Appl. No. 17/837,399.
Claims priority of application No. 202110647288.1 (CN), filed on Jun. 10, 2021.
Prior Publication US 2022/0400204 A1, Dec. 15, 2022
Int. Cl. H04N 23/667 (2023.01); H04N 23/61 (2023.01)
CPC H04N 23/667 (2023.01) [H04N 23/61 (2023.01)] 9 Claims
OG exemplary drawing
 
1. An apparatus for controlling an image sensor, the apparatus comprising:
a memory;
a processor; and
a computer program stored on the memory and executable on the processor, wherein the execution of the computer program causes the following steps to be performed:
obtaining parameter data related to one or more moving scenarios; and
generating, based on the parameter data, an instruction for controlling operation mode of the image sensor,
wherein the one or more moving scenarios are scenarios in which a movable object with the image sensor is located;
wherein the parameter data comprises an ambient light illumination which represents a light intensity of an environment in which the movable object is located and a sensing distance which represents a distance between an object sensed by the image sensor and the movable object; and
wherein the operation modes correspond to setting manners of active pixels of the image sensor,
wherein the active pixels are pixels for constituting a sensing image,
wherein the ambient light illumination is obtained by the image sensor,
wherein the generating of the instruction comprising: determining a specific moving scenario from the one or more moving scenarios based on the ambient light illumination; and generating, based on the determined specific moving scenario, the instruction for controlling the operation modes of the image sensor,
wherein the specific moving scenario includes a high-illumination scenario and a low-illumination scenario,
wherein the operation mode comprise a default mode in which a first set of pixels corresponding to a highest resolution of the image sensor serves as the active pixels, a skipping mode in which pixels are selected from each of one or more subsets in the first set of pixels to serve as the active pixels, and a combination mode in which pixels from one or more subsets in the first set of pixels are combined to serve as the active pixels,
wherein the default mode is performed when the specific moving scenario is the high-illumination scenario, and the combination mode is performed when the specific moving scenario is the low-illumination scenario, and the skipping mode is performed when the specific moving scenario is the high-illumination scenario and there is a requirement on at least of bandwidth, power consumption and computing power.