US 12,238,362 B2
Consistence of acoustic and visual scenes
Jun Tian, Belle Mead, NJ (US); Xiaozhong Xu, State College, PA (US); and Shan Liu, San Jose, CA (US)
Assigned to Tencent America LLC, Palo Alto, CA (US)
Filed by Tencent America LLC, Palo Alto, CA (US)
Filed on Sep. 14, 2022, as Appl. No. 17/945,024.
Claims priority of provisional application 63/248,942, filed on Sep. 27, 2021.
Prior Publication US 2023/0098577 A1, Mar. 30, 2023
Int. Cl. H04N 21/43 (2011.01); G06T 7/40 (2017.01); G06T 7/50 (2017.01); G06T 7/60 (2017.01); G06T 7/70 (2017.01); H04S 7/00 (2006.01); G10L 19/008 (2013.01)
CPC H04N 21/4302 (2013.01) [G06T 7/40 (2013.01); G06T 7/50 (2017.01); G06T 7/60 (2013.01); G06T 7/70 (2017.01); H04S 7/303 (2013.01); G06T 2207/10016 (2013.01); G10L 19/008 (2013.01); H04S 2400/11 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of media processing at a media processing device, comprising:
receiving media content data of an object, the media content data including a first description of the object in an acoustic scene of a virtual environment that is generated by an audio engine and a second description of the object in a visual scene of the virtual environment that is generated by a visual engine;
determining whether a first parameter of an object characteristic indicated by the first description of the object in the acoustic scene and a second parameter of the object characteristic indicated by the second description of the object in the visual scene are different;
when the first parameter indicated by the first description of the object in the acoustic scene and the second parameter indicated by the second description of the object in the visual scene are different, modifying one of the first parameter indicated by the first description of the object in the acoustic scene and the second parameter indicated by the second description of the object in the visual scene based on another one of the first parameter indicated by the first description and the second parameter indicated by the second description that is not modified, wherein the modified one of the first parameter indicated by the first description and the second parameter indicated by the second description is the same as the other one of the first parameter indicated by the first description and the second parameter indicated by the second description that is not modified; and
providing the media content data of the object to a receiver that renders the media content data of the object for a media application,
wherein the receiver renders audio based on the first parameter of the object characteristic and renders content for display based on the second parameter of the object characteristic after the one of the first description of the object in the acoustic scene and the second description of the object in the visual scene is modified based on the other one of the first description and the second description that is not modified.