US 12,219,118 B1
Method and device for generating a 3D reconstruction of a scene with a hybrid camera rig
Afshin Taghavi Nasrabadi, Santa Clara, CA (US); and Maneli Noorkami, Menlo Park, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Feb. 23, 2022, as Appl. No. 17/678,815.
Claims priority of provisional application 63/159,342, filed on Mar. 10, 2021.
Int. Cl. H04N 13/25 (2018.01); G06T 15/00 (2011.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01)
CPC H04N 13/25 (2018.05) [G06T 15/00 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01)] 28 Claims
OG exemplary drawing
 
1. A camera rig comprising:
a first array of image sensors arranged in a planar configuration, wherein the first array of image sensors is provided to capture a first image stream from a first perspective of a physical environment, and wherein the first image stream is associated with six degrees of freedom (6DOF), a first quality value, and a first field-of-view (FOV);
a second array of image sensors arranged in a non-planar configuration, wherein the second array of image sensors is provided to capture a second image stream from a second perspective of the physical environment different from the first perspective, and wherein the second image stream is associated with a second quality value that is less than the first quality value and a second FOV smaller than the first FOV;
a buffer provided to store the first and second image streams; and
an image processing engine provided to generate a three-dimensional (3D) reconstruction of the physical environment based on the first and second image streams.