US 12,113,947 B2
Image processing apparatus, image processing method, and program for viewpoint transition control
Sho Ogura, Kanagawa (JP); and Yuya Yamashita, Kanagawa (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/794,413
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Jan. 26, 2021, PCT No. PCT/JP2021/002581
§ 371(c)(1), (2) Date Jul. 21, 2022,
PCT Pub. No. WO2021/161774, PCT Pub. Date Aug. 19, 2021.
Claims priority of application No. 2020-020784 (JP), filed on Feb. 10, 2020.
Prior Publication US 2023/0060691 A1, Mar. 2, 2023
Int. Cl. H04N 13/117 (2018.01); G06F 3/14 (2006.01); G06T 19/00 (2011.01)
CPC H04N 13/117 (2018.05) [G06F 3/14 (2013.01); G06T 19/003 (2013.01)] 18 Claims
OG exemplary drawing
 
1. An image processing apparatus comprising:
an output unit configured to output part of an image including recommended viewpoint information as a display image to a display unit; and
a transition control unit configured to cause a display range of the image to shift, based on a positional relationship between a viewpoint position corresponding to the display image output to the display unit and a viewpoint position corresponding to the recommended viewpoint information,
wherein the transition control unit causes the display range to shift at a speed determined based on a difference in an angle of a line-of-sight direction from the viewpoint position corresponding to the recommended viewpoint information to the viewpoint position corresponding to the display image,
wherein the output unit outputs the part of the image to the display unit based on the display range that has been made to shift,
wherein the transition control unit includes:
an operation movement amount calculation unit configured to calculate an operation movement amount for moving the viewpoint position corresponding to the display image in accordance with a viewpoint operation based on viewpoint operation information;
a return movement amount calculation unit configured to calculate a return movement amount for returning the viewpoint position corresponding to the display image to the viewpoint position corresponding to the recommended viewpoint information; and
a viewpoint position calculation unit configured to calculate a viewpoint position of a next frame to be output after a frame of the display image output to the display unit, based on the operation movement amount and the return movement amount,
wherein the output unit outputs the part of the image to the display unit, based on the display range determined from the viewpoint position of the next frame,
wherein the return movement amount calculation unit calculates the return movement amount, based on the difference in the angle of the line-of-sight direction from the viewpoint position corresponding to the recommended viewpoint information to the viewpoint position corresponding to the display image, and
wherein the output unit and the transition control unit are each implemented via at least one processor.