	US 11,985,424 B2
	Signal processing device and signal processing method for correcting input signal from sensor
Hiroshi Arai, Kanagawa (JP); Yuriko Ohtsuka, Kanagawa (JP); Kenichiro Nishi, Kanagawa (JP); Takeshi Masuura, Kanagawa (JP); Norimitsu Okiyama, Kanagawa (JP); Yuji Matsui, Kanagawa (JP); and Satoshi Takashima, Kanagawa (JP)
Assigned to SONY SEMICONDUCTOR SOLUTIONS CORPORATION, Kanagawa (JP); and SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/910,355
Filed by Sony Semiconductor Solutions Corporation, Kanagawa (JP); and Sony Group Corporation, Tokyo (JP)
PCT Filed Feb. 10, 2021, PCT No. PCT/JP2021/005068 § 371(c)(1), (2) Date Sep. 9, 2022, PCT Pub. No. WO2021/186961, PCT Pub. Date Sep. 23, 2021.
Claims priority of application No. 2020-045254 (JP), filed on Mar. 16, 2020.
Prior Publication US 2023/0156331 A1, May 18, 2023
Int. Cl. H04N 23/68 (2023.01); H04N 25/79 (2023.01)

CPC H04N 23/683 (2023.01) [H04N 23/6812 (2023.01); H04N 25/79 (2023.01)]

11 Claims

1. A signal processing device comprising:

circuitry configured to

perform extraction of a feature quantity for a specific event with respect to an input signal from a sensor, the extraction being trained with a neural network, the sensor being a motion sensor detecting a motion of an imaging device,

perform correction of the input signal on the basis of the extracted feature quantity,

generate a grid point mesh having a plurality of grid points arranged in a horizontal direction and a vertical direction in an output coordinate system as a coordinate system of an output image, motion information obtained from the input signal being associated with each grid point in the grid point mesh, and

perform stabilization processing on a captured image of the imaging device on the basis of the input signal from the motion sensor corrected on the basis of the extracted feature quantity, the stabilization processing being performed on the basis of the motion information for each grid point in the grid point mesh.