US 12,452,466 B2
Client-server communication for streaming of visual content
Sebastian Bosse, Berlin (DE); Yago Sánchez De La Fuente, Berlin (DE); Cornelius Hellge, Berlin (DE); Thomas Schierl, Berlin (DE); Robert Skupin, Berlin (DE); and Thomas Wiegand, Berlin (DE)
Assigned to Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V., Munich (DE)
Filed by Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V., Munich (DE)
Filed on Jun. 9, 2023, as Appl. No. 18/332,082.
Application 18/332,082 is a continuation of application No. PCT/EP2021/085265, filed on Dec. 10, 2021.
Claims priority of application No. 20214313 (EP), filed on Dec. 15, 2020.
Prior Publication US 2023/0319324 A1, Oct. 5, 2023
Int. Cl. H04N 21/218 (2011.01); G06T 15/20 (2011.01); H04N 21/442 (2011.01); H04N 21/81 (2011.01)
CPC H04N 21/21805 (2013.01) [G06T 15/20 (2013.01); H04N 21/44213 (2013.01); H04N 21/8146 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A client device for streaming visual content from a server, configured for integrating the visual content into a 3D scene of a user application, and configured for acquiring a rendered view of the 3D scene including the visual content streamed from the server, wherein the 3D scene depends on a behavior of a user of the user application,
wherein the client device is configured for determining an indication regarding one or more of
1 an information relating to a first viewpoint and a second viewpoint, wherein the first viewpoint is a viewpoint of the user of the user application, from which viewpoint the rendered view of the 3D scene is acquired, and wherein the second viewpoint is a viewpoint which has been used for generating the visual content streamed from the server and integrated into the 3D scene,
2 a latency between an event occurring at the client device and a change in the rendered view in response to the event, and
3a property of the 3D scene, wherein the indication regarding the property of the 3D scene is an indicative of one or more of
a texture of the 3D scene or of a region of the 3D scene, within which the visual content is positioned,
a contrast of the 3D scene or of the region of the 3D scene, within which the visual content is positioned,
a brightness of the 3D scene or of the region of the 3D scene, within which the visual content is positioned,
a visual clutter of the 3D scene or of the region of the 3D scene, within which the visual content is positioned,
a temporal dynamic of the 3D scene or of the region of the 3D scene, within which the visual content is positioned,
a depth of the 3D scene or of the region of the 3D scene, within which the visual content is positioned, and
a depth discontinuity of the 3D scene in a vicinity of the position of the visual content in the 3D scene, and
wherein the client device is configured for providing the indication in a message.