US 12,260,490 B2
Three-dimensional image processing apparatus, system, and method thereof
Masato Akao, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/786,130
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Dec. 1, 2020, PCT No. PCT/JP2020/044755
§ 371(c)(1), (2) Date Jun. 16, 2022,
PCT Pub. No. WO2021/131543, PCT Pub. Date Jul. 1, 2021.
Claims priority of application No. 2019-239640 (JP), filed on Dec. 27, 2019.
Prior Publication US 2023/0014562 A1, Jan. 19, 2023
Int. Cl. G06T 15/20 (2011.01); G06F 3/14 (2006.01); G06T 7/20 (2017.01); G06T 7/62 (2017.01); G06T 7/70 (2017.01); G06V 10/44 (2022.01); G06V 10/56 (2022.01); G06V 10/60 (2022.01); G06V 10/74 (2022.01); G09G 5/38 (2006.01); H04N 13/279 (2018.01)
CPC G06T 15/20 (2013.01) [G06F 3/14 (2013.01); G06T 7/20 (2013.01); G06T 7/62 (2017.01); G06T 7/70 (2017.01); G06V 10/44 (2022.01); G06V 10/56 (2022.01); G06V 10/60 (2022.01); G06V 10/761 (2022.01); G09G 5/38 (2013.01); H04N 13/279 (2018.05); G06T 2207/10024 (2013.01); G06V 2201/07 (2022.01)] 7 Claims
OG exemplary drawing
 
1. A three-dimensional image processing apparatus, comprising:
at least one processor configured to:
acquire, from a camera fixed to a display, a captured image including at least one user and a real object, wherein the real object is between the at least one user and the display in a real space;
determine a three-dimensional geometric relationship of the real object and a viewpoint of the at least one user based on the captured image;
determine, based on the three-dimensional geometric relationship, whether an entire area of the display includes a shielded area, wherein
the shielded area corresponds to a partial area of the display, and
the real object shields the partial area from the at least one user; and
control, based on determination that the entire area of the display includes the shielded area, the display to move a virtual object related to the real object to a non-shielded area of the display to avoid displaying the virtual object in the shielded area, wherein the non-shielded area is an area of the display other than the shielded area.