US 12,003,695 B2
Self-organizing rolling shutter camera arrays for low-cost, accurate volumetric capture workflows
Luis Vanconcelos, San Marcos, CA (US); and Nikolaos Georgis, San Diego, CA (US)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Filed by Sony Group Corporation, Tokyo (JP)
Filed on Sep. 1, 2022, as Appl. No. 17/901,731.
Prior Publication US 2024/0080432 A1, Mar. 7, 2024
Int. Cl. H04N 13/282 (2018.01); G06V 10/44 (2022.01); G06V 20/50 (2022.01); H04N 23/63 (2023.01)
CPC H04N 13/282 (2018.05) [G06V 10/443 (2022.01); G06V 20/50 (2022.01); H04N 23/633 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
receiving images from a set of cameras that are positioned in a plurality of levels around one or more objects, wherein the set of cameras are positioned at a same orientation and each image is captured by a rolling shutter and associated with a position and orientation of a corresponding camera from the set of cameras;
for each level of cameras:
performing feature extraction on a subset of the images corresponding to the level to identify features of one or more objects;
matching extracted features between the subset of the images; and
generating a three-dimensional pointcloud based on the position and orientation of corresponding cameras and matched extracted features; and
merging the three-dimensional pointcloud for each level of the cameras to form a three-dimensional volumetric model of one or more objects.