US 11,727,619 B2
Video pipeline
Arthur Y Zhang, San Jose, CA (US); Ray L. Chang, Saratoga, CA (US); Timothy R. Oriol, San Jose, CA (US); Ling Su, Los Altos, CA (US); Gurjeet S. Saund, Saratoga, CA (US); Guy Cote, San Jose, CA (US); Jim C. Chou, San Jose, CA (US); Hao Pan, Sunnyvale, CA (US); Tobias Eble, San Francisco, CA (US); Avi Bar-Zeev, Oakland, CA (US); Sheng Zhang, Milpitas, CA (US); Justin A. Hensley, Mountain View, CA (US); and Geoffrey Stahl, San Jose, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jun. 18, 2021, as Appl. No. 17/352,080.
Application 17/352,080 is a continuation of application No. 16/662,952, filed on Oct. 24, 2019, granted, now 11,043,018.
Application 16/662,952 is a continuation of application No. PCT/US2018/029862, filed on Apr. 27, 2018.
Claims priority of provisional application 62/492,000, filed on Apr. 28, 2017.
Prior Publication US 2021/0312694 A1, Oct. 7, 2021
Int. Cl. G06T 15/00 (2011.01); H04W 76/10 (2018.01); G06F 3/01 (2006.01); G06T 3/00 (2006.01); G06T 9/00 (2006.01); H04W 88/08 (2009.01)
CPC G06T 15/005 (2013.01) [G06F 3/012 (2013.01); G06T 3/0093 (2013.01); G06T 9/00 (2013.01); H04W 76/10 (2018.02); H04W 88/08 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A device, comprising:
one or more processors;
one or more cameras configured to capture frames that include views of a user's environment; and
a display subsystem for displaying a 3D virtual view to the user;
wherein the one or more processors are configured to:
transform the frames captured by the one or more cameras into a warp space;
for each frame, resample the warp space at equal angles to generate a warp space frame;
transmit the warp space frames to a base station over a wireless connection; and
decompress compressed rendered frames received from the base station over the wireless connection and provide the rendered frames to the display subsystem for display.