US 12,088,959 B2
Session description protocol (SDP) based signaling of camera calibration
Ozgur Oyman, Palo Alto, CA (US); Gang Shen, Hillsboro, OR (US); Wenqing Fu, Portland, OR (US); Wei Zong, Beijing (CN); and Juan Zhao, Shanghai (CN)
Assigned to Intel Corporation, Santa Clara, CA (US)
Filed by Intel Corporation, Santa Clara, CA (US)
Filed on Oct. 14, 2020, as Appl. No. 17/070,306.
Claims priority of provisional application 62/915,483, filed on Oct. 15, 2019.
Claims priority of provisional application 62/923,977, filed on Oct. 21, 2019.
Prior Publication US 2021/0029326 A1, Jan. 28, 2021
Int. Cl. H04N 7/15 (2006.01); H04N 21/2347 (2011.01); H04N 21/236 (2011.01)
CPC H04N 7/15 (2013.01) [H04N 21/2347 (2013.01); H04N 21/23602 (2013.01)] 18 Claims
OG exemplary drawing
 
1. One or more non-transitory computer-readable media (NTCRM) having instructions, stored thereon, that when executed by one or more processors, cause a device to:
receive a plurality of real-time transport protocol (RTP) streams, wherein individual RTP streams of the plurality of RTP streams includes two-dimensional (2D) video captured by a corresponding camera;
receive a session description protocol (SDP) attribute to indicate one or more camera calibration parameters associated with the plurality of RTP streams, wherein the one or more camera calibration parameters include a set of extrinsic camera parameters and a set of intrinsic camera parameters;
generate a decoder output signal and decoder metadata from an elementary stream that is based on the plurality of RTP media streams, wherein the decoder metadata includes a set of Supplemental Enhancement Information (SEI) messages; and
generate an immersive video from the plurality of RTP streams and based on the one or more camera calibration parameters, wherein the generating the immersive video includes rendering the immersive video based on the decoder output signal, and based on the decoder metadata in a subset of SEI messages in the set of SEI messages.