US 12,087,172 B2
Image processing device and image processing method
Kenichiro Oi, Tokyo (JP); and Takahide Otani, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/756,180
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Oct. 21, 2020, PCT No. PCT/JP2020/039509
§ 371(c)(1), (2) Date May 18, 2022,
PCT Pub. No. WO2021/106436, PCT Pub. Date Jun. 3, 2021.
Claims priority of application No. 2019-214975 (JP), filed on Nov. 28, 2019.
Prior Publication US 2022/0415193 A1, Dec. 29, 2022
Int. Cl. G06T 7/70 (2017.01); G06T 11/20 (2006.01); G08G 5/00 (2006.01); H04N 5/272 (2006.01)
CPC G08G 5/0082 (2013.01) [G06T 7/70 (2017.01); G06T 11/203 (2013.01); H04N 5/272 (2013.01); G06T 2207/30244 (2013.01)] 11 Claims
OG exemplary drawing
 
2. An image processing method, comprising:
displaying, by a display unit of an image processing device, a camera-capturing image of a plurality of camera-capturing images of a moving device, wherein the plurality of camera-capturing images corresponds to different positions of the moving device;
controlling, by a data processing unit of the image processing device, the display unit to display a moving path of the moving device on the camera-capturing image of the moving device;
generating, by the data processing unit, simultaneous equations including a relational expression that indicates a correspondence between a position of the moving device in a first coordinate system and an imaging position of the moving device in the camera-capturing image, wherein the generation of the simultaneous equations is based on the plurality of camera-capturing images corresponding to the different positions of the moving device;
calculating, by the data processing unit, a parameter from the generated simultaneous equations;
generating, by the data processing unit, a coordinate conversion matrix based on the calculated parameter;
converting, by the data processing unit, based on the coordinate conversion matrix, first position information in the first coordinate system into second position information in a second coordinate system, wherein
the first position information indicates the moving path of the moving device, and
the second coordinate system specifies a pixel position of a display image on the display unit; and
outputting, to the display unit, the moving path having the second position information in the second coordinate system.