US 12,437,422 B2
Digital representation of multi-sensor data stream
Patrick Soon-Shiong, Los Angeles, CA (US)
Assigned to Nant Holdings IP, LLC, Culver City, CA (US)
Filed by Nant Holdings IP, LLC, Culver City, CA (US)
Filed on Apr. 26, 2024, as Appl. No. 18/647,472.
Application 18/647,472 is a continuation of application No. 18/196,535, filed on May 12, 2023, granted, now 12,002,223.
Application 18/196,535 is a continuation of application No. 17/218,331, filed on Mar. 31, 2021, granted, now 11,688,079.
Claims priority of provisional application 63/002,708, filed on Mar. 31, 2020.
Prior Publication US 2024/0296570 A1, Sep. 5, 2024
Int. Cl. H04N 21/234 (2011.01); G06F 16/70 (2019.01); G06T 7/246 (2017.01); G09B 19/00 (2006.01); H04N 7/18 (2006.01)
CPC G06T 7/246 (2017.01) [G06F 16/70 (2019.01); G09B 19/0038 (2013.01); H04N 7/181 (2013.01); G06T 2207/30221 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A 3D rendering system comprising:
at least one non-transitory computer memory storing software instructions and a prioritization policy;
a plurality of sensors; and
at least one processor coupled with the plurality of sensors and the memory, and that performs the following operations upon execution of the software instructions:
capturing a digital representation of a physical environment via the plurality of sensors;
generating a set of digital data streams of renderable content from the digital representation wherein each digital data stream comprises prioritized rendering instruction for at least one layer of a 3D model of the renderable content and as prioritized according to the prioritization policy;
compiling and transmitting the set of digital data streams to at least one endpoint device according to each digital data stream's priority from the prioritization policy thereby enabling the at least one endpoint device to render the 3D model via each digital data stream's at least one layer rendered according its priority, wherein the set of digital data streams includes a first stream comprising a background 3D object and a first priority associated therewith and a second stream comprising the 3D model and a second priority associated therewith, and wherein the second priority is higher than the first priority; and
adjusting, in real-time, which sensor feeds from the plurality of sensors are compiled into the first stream and the second stream.