US 12,288,293 B1
Systems and methods for photorealistic image data simulation and monitoring in a virtual facility
Mohamed Amer, San Francisco, CA (US); Dylan Bourgeois, Brooklyn, NY (US); Stefan Nusser, Palo Alto, CA (US); Pierre-Emmanuel Evreux, San Francisco, CA (US); Kyle Marshall, New York, NY (US); Josh Staker, Tigard, OR (US); and Nick Vander Valk, East Brunswick, NJ (US)
Assigned to Claryo, Inc., San Francisco, CA (US)
Filed by Claryo, Inc., San Francisco, CA (US)
Filed on Sep. 23, 2024, as Appl. No. 18/893,650.
Claims priority of provisional application 63/594,152, filed on Oct. 30, 2023.
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 17/00 (2006.01); G06Q 10/087 (2023.01); G06T 7/70 (2017.01); G06T 7/80 (2017.01)
CPC G06T 17/00 (2013.01) [G06Q 10/087 (2013.01); G06T 7/70 (2017.01); G06T 7/80 (2017.01); G06T 2207/20081 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A virtual facility system providing a photorealistic three-dimensional representation of a physical environment, the virtual facility system comprising:
a storage system storing data collected from a real facility, the data including video of the real facility;
a data engine configured to train a neural rendering model of the real facility based on the data, the neural rendering model providing a photorealistic three-dimensional representation of the real facility;
an integration system providing one or more interfaces facilitating communication with one or more control systems associated with the real facility, the one or more control systems including a management system providing historical or live inventory tracking data and facility operations process data characterizing a plurality of locations and tasks corresponding with a plurality of inventory items or materials stored or handled in the real facility;
a virtual facility interface system providing access to information stored in a virtual facility that includes the photorealistic three-dimensional representation of the real facility and that represents the plurality of locations; and
a simulator engine configured to simulate one or more novel views generated based on the neural rendering model, wherein the virtual facility system is configured to determine one or more parameter values based on the virtual facility in response to a query about the virtual facility.