US 12,250,439 B2
Multi-sensor system
Christophe Bourreau, Paris (FR); and William D. Houck, Santa Rosa, CA (US)
Assigned to VIAVI Solutions Inc., Chandler, AZ (US)
Filed by VIAVI Solutions Inc., San Jose, CA (US)
Filed on Aug. 16, 2021, as Appl. No. 17/445,156.
Claims priority of provisional application 62/706,614, filed on Aug. 28, 2020.
Prior Publication US 2022/0070425 A1, Mar. 3, 2022
Int. Cl. H04N 23/45 (2023.01); G06V 10/58 (2022.01); G06V 10/60 (2022.01); G06V 20/00 (2022.01); H04N 9/64 (2023.01); H04N 9/77 (2006.01); H04N 23/71 (2023.01); H04N 23/74 (2023.01)
CPC H04N 23/45 (2023.01) [G06V 10/60 (2022.01); G06V 20/00 (2022.01); H04N 9/646 (2013.01); H04N 9/77 (2013.01); H04N 23/71 (2023.01); H04N 23/74 (2023.01); G06V 10/58 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
obtaining, by a system, image data associated with a scene;
obtaining, by the system, multispectral data associated with the scene;
identifying, by the system, one or more objects depicted by the image data;
performing, by the system and after identifying the one or more objects, a lookup operation in a data structure to determine representative optical properties of the one or more objects,
wherein the data structure includes information identifying:
a first optical property associated with at least a portion of an object, of the one or more objects, being of a first type of material, and
a second optical property associated with at least the portion of the object being of a second type of material that is an alternative to the first type of material for the portion of the object;
identifying, by the system and based on at least one of the image data or the multispectral data, captured optical properties of the one or more objects;
processing the multispectral data to generate illumination data that identifies one or more of
one or more illumination sources that illuminate the one or more objects within the scene,
one or more locations of the one or more illumination sources that illuminate the one or more objects within the scene, or
one or more illumination properties of the one or more illumination sources that illuminate the one or more objects within the scene;
generating, by the system, a color corrected image by performing a color adjustment correction on the image data based on the illumination data and a difference between the representative optical properties and the captured optical properties; and
providing, by the system, the color corrected image to a user device for display by the user device.