US 12,406,463 B2
Representing volumetric video in saliency video streams
Ajit Ninan, San Jose, CA (US); Shwetha Ram, San Jose, CA (US); Gregory John Ward, San Francisco, CA (US); Domagoj Baricevic, San Francisco, CA (US); and Vijay Kamarshi, San Francisco, CA (US)
Assigned to Dolby Laboratories Licensing Corporation, San Francisco, CA (US)
Appl. No. 18/009,120
Filed by Dolby Laboratories Licensing Corporation, San Francisco, CA (US)
PCT Filed Jun. 16, 2021, PCT No. PCT/US2021/037608
§ 371(c)(1), (2) Date Dec. 8, 2022,
PCT Pub. No. WO2021/257690, PCT Pub. Date Dec. 23, 2021.
Claims priority of provisional application 63/039,589, filed on Jun. 16, 2020.
Claims priority of application No. 20180178 (EP), filed on Jun. 16, 2020.
Prior Publication US 2023/0215129 A1, Jul. 6, 2023
Int. Cl. G06V 10/46 (2022.01); G06T 7/20 (2017.01); G06T 7/40 (2017.01); G06T 7/55 (2017.01); G06V 10/25 (2022.01); H04N 13/383 (2018.01); H04N 13/388 (2018.01)
CPC G06V 10/462 (2022.01) [G06T 7/20 (2013.01); G06T 7/40 (2013.01); G06T 7/55 (2017.01); G06V 10/25 (2022.01); H04N 13/383 (2018.05); H04N 13/388 (2018.05)] 11 Claims
OG exemplary drawing
 
1. A method for streaming volumetric video, comprising:
identifying a set of one or more saliency regions in a global scene depicted by the volumetric video;
generating a set of one or more saliency video streams that track the set of one or more saliency regions identified in the global scene, wherein each saliency video stream in the set of one or more saliency video streams tracks a respective saliency region in the set of one or more saliency regions;
generating a saliency stream based representation of the volumetric video, wherein the saliency stream based representation includes the set of one or more saliency video streams;
transmitting the saliency stream based representation of the volumetric video to a video streaming client,
wherein the set of one or more saliency video streams includes a first saliency video stream assigned with a first saliency rank and a second saliency video stream assigned with a second saliency rank lower than the first saliency rank, wherein the second saliency video stream is removed from the set of one or more saliency video streams to be transmitted to the video streaming client at a later time, in response to determining that an available data rate has been reduced.