US 12,086,919 B2
Video pipeline
Arthur Y Zhang, San Jose, CA (US); Ray L. Chang, Saratoga, CA (US); Timothy R. Oriol, San Jose, CA (US); Ling Su, Los Altos, CA (US); Gurjeet S. Saund, Saratoga, CA (US); Guy Cote, San Jose, CA (US); Jim C. Chou, San Jose, CA (US); Hao Pan, Sunnyvale, CA (US); Tobias Eble, San Francisco, CA (US); Avi Bar-Zeev, Oakland, CA (US); Sheng Zhang, Milpitas, CA (US); Justin A. Hensley, Mountain View, CA (US); and Geoffrey Stahl, San Jose, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jun. 29, 2023, as Appl. No. 18/344,294.
Application 18/344,294 is a continuation of application No. 17/352,080, filed on Jun. 18, 2021, granted, now 11,727,619.
Application 17/352,080 is a continuation of application No. 16/662,952, filed on Oct. 24, 2019, granted, now 11,043,018, issued on Jun. 22, 2021.
Application 16/662,952 is a continuation of application No. PCT/US2018/029862, filed on Apr. 27, 2018.
Claims priority of provisional application 62/492,000, filed on Apr. 28, 2017.
Prior Publication US 2023/0351672 A1, Nov. 2, 2023
Int. Cl. G06T 15/00 (2011.01); G06F 3/01 (2006.01); G06T 3/18 (2024.01); G06T 9/00 (2006.01); H04W 76/10 (2018.01); H04W 88/08 (2009.01)
CPC G06T 15/005 (2013.01) [G06F 3/012 (2013.01); G06T 3/18 (2024.01); G06T 9/00 (2013.01); H04W 76/10 (2018.02); H04W 88/08 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system, comprising:
a first device configured to:
receive frames captured by a second device, wherein the received frames have a first resolution;
render frames based, at least in part, on transmitted information about a user of the second device and an environment of the second device, wherein the rendered frames, or portions of the rendered frames, are generated based on the received frames and have a second resolution; and
provide compressed versions of the rendered frames, or the portions of the rendered frames, to the second device; and
the second device, wherein the second device comprises:
one or more cameras configured to capture captured frames that are received by the first device as the received frames, wherein the captured frames include views of the second device's environment;
one or more sensors configured to capture data about the user and the second device's environment; and
one or more processors configured to:
receive the data, via the one or more sensors, about the user and the second device's environment;
transmit the captured frames to the first device;
transmit information about the user of the second device and the second device's environment to the first device, wherein the transmitted information is generated, based, at least in part, on the received data about the user and the second device's environment;
receive the compressed versions of the rendered frames, or of the portions of the rendered frames, from the first device;
decompress the compressed versions of the rendered frames, or the portions of the rendered frames; and
generate a display view based, at least in part, on the decompressed rendered frames or the decompressed portions of the rendered frames.