US 11,659,150 B2
Augmented virtuality self view
Hans Maarten Stokking, Wateringen (NL); and Milan Wijnmalen, Utrecht (NL)
Assigned to KONINKLIJKE KPN N.V., Rotterdam (NL)
Filed by Koninklijke KPN N.V., Rotterdam (NL)
Filed on Dec. 10, 2020, as Appl. No. 17/117,764.
Claims priority of application No. 19218242 (EP), filed on Dec. 19, 2019.
Prior Publication US 2021/0195157 A1, Jun. 24, 2021
Int. Cl. G06T 15/00 (2011.01); H04N 13/111 (2018.01); G06T 7/194 (2017.01); G06T 7/174 (2017.01); H04N 13/344 (2018.01); H04N 13/366 (2018.01); H04N 13/00 (2018.01)
CPC H04N 13/111 (2018.05) [G06T 7/174 (2017.01); G06T 7/194 (2017.01); H04N 13/344 (2018.05); H04N 13/366 (2018.05); H04N 2013/0085 (2013.01)] 16 Claims
OG exemplary drawing
 
1. Processor system for processing image data for rendering a virtual environment on a display system for a user, the user being present in a real environment, wherein the processor system comprises:
an interface for receiving head tracking data from a head tracking system, wherein the head tracking data is indicative of at least the orientation including the pitch orientation of the head of the user in the real environment, and
an image processor configured to:
generate image data for rendering a viewport of the virtual environment on the display system, the viewport being generated based on the head tracking data, thereby moving the viewport corresponding to head movements,
define at least one real-view area in the virtual environment,
determine at least one boundary of the real-view area, the boundary corresponding to predetermined coordinates in the virtual environment for making visible a corresponding part of the real environment in the real-view area, the part showing the real environment as perceived from the user head pose; and
modify the coordinates of the boundary in the virtual environment based on a change of the position of the user in the real environment, wherein the boundary comprises a horizontal boundary comprising a separating line horizontal with respect to the virtual environment, while the real-view area is below the separating line, and
the processor system is configured to maintain at least a part of the real-view area in the viewport by moving the horizontal boundary in the virtual environment when the pitch orientation of the head of the user as indicated by the tracking data exceeds a predetermined limit.