US 12,450,844 B2
Image signal processing based on occlusion culling
Antti Hirvonen, Helsinki (FI); and Mikko Strandborg, Helsinki (FI)
Assigned to Varjo Technologies Oy, Helsinki (FI)
Filed by Varjo Technologies Oy, Helsinki (FI)
Filed on Oct. 17, 2023, as Appl. No. 18/488,039.
Prior Publication US 2025/0124667 A1, Apr. 17, 2025
Int. Cl. G06T 19/00 (2011.01); G06V 10/26 (2022.01); H04N 9/73 (2023.01)
CPC G06T 19/006 (2013.01) [G06V 10/26 (2022.01); H04N 9/73 (2013.01)] 10 Claims
OG exemplary drawing
 
1. A system comprising at least one data repository and at least one server configured to:
obtain a real-world depth map of a real-world environment from a perspective of a given viewpoint;
divide the real-world depth map into a plurality of tiles;
for a given tile, determine a three-dimensional (3D) bounding volume comprising non-empty 3D points;
access, from the at least one data repository, a 3D model of a virtual environment;
perform occlusion culling on corresponding 3D bounding volumes of the plurality of tiles, by employing at least one of: the 3D model of the virtual environment, a virtual-reality (VR) depth map generated using the 3D model, to determine a set of virtual objects that occlude at least one real object in an extended-realty (XR) environment from a perspective of a given viewpoint and one or more of the plurality of tiles whose 3D bounding volumes are being fully occluded by the set of virtual objects from the perspective of the given viewpoint; and
send, to at least one display apparatus, a VR image representing the set of virtual objects and information indicative of the one or more of the plurality of tiles whose 3D bounding volumes are being fully occluded by the set of virtual objects from the perspective of the given viewpoint.