US 12,439,042 B2
Real-time wide-angle video communication system
Sheng Zhong, Santa Clara, CA (US); Zhonghou Zheng, Shanghai (CN); and Zesen Zhuang, Shanghai (CN)
Assigned to Agora Lab, Inc., Santa Clara, CA (US)
Filed by Agora Lab, Inc., Santa Clara, CA (US)
Filed on Jan. 5, 2022, as Appl. No. 17/569,328.
Prior Publication US 2023/0217022 A1, Jul. 6, 2023
Int. Cl. H04N 19/44 (2014.01); H04N 19/119 (2014.01); H04N 19/184 (2014.01); H04N 19/593 (2014.01)
CPC H04N 19/119 (2014.11) [H04N 19/184 (2014.11); H04N 19/44 (2014.11); H04N 19/593 (2014.11)] 16 Claims
OG exemplary drawing
 
1. A method of decoding a compressed wide-angle video including a wide-angle image, comprising:
maintaining, at a receiving device of the compressed wide-angle video, a phase-out list that includes tiles of a current viewport of the wide-angle image that are currently being displayed in the viewport but predicted to no longer be in the viewport after a time duration d from a current time t, wherein the compressed wide-angle device is received from a sending device via a network;
obtaining, by the receiving device, predicted tiles of the wide-angle image, wherein the predicted tiles are predicted to be viewed at a time that is later than the current time t;
updating, by the receiving device, a receiver list by adding to a receiver list those of the predicted tiles that are not in the receiver list; and
rendering, by the receiving device, tiles that form a current viewing area of the wide-angle image using the receiver list, wherein each tile of the receiver list and the phase-out list is associated with a respective display time, and wherein rendering the tiles comprises:
decoding and displaying tiles of the receiver list associated with display times that are not larger than the current time t;
stopping decoding and displaying tiles of the phase-out list associated with the display times that are not larger than the current time t; and
removing from the receiver list the tiles of the phase-out list having display times that are not larger than the current time t,
wherein the method further comprises transmitting the receiver list to an edge node of a network.