US 12,276,989 B1
Systems and methods for a virtual facility supporting robotics fleet control and sensor data simulation
Mohamed Amer, San Francisco, CA (US); Dylan Bourgeois, Brooklyn, NY (US); Stefan Nusser, Palo Alto, CA (US); Pierre-Emmanuel Evreux, San Francisco, CA (US); Kyle Marshall, New York, NY (US); Josh Staker, Tigard, OR (US); and Nick Vander Valk, East Brunswick, NJ (US)
Assigned to Claryo, Inc., San Francisco, CA (US)
Filed by Claryo, Inc., San Francisco, CA (US)
Filed on Sep. 23, 2024, as Appl. No. 18/893,656.
Claims priority of provisional application 63/594,152, filed on Oct. 30, 2023.
Int. Cl. G05D 1/69 (2024.01); G06N 3/049 (2023.01); G06N 7/01 (2023.01); G06N 10/00 (2022.01); G06T 15/20 (2011.01); G05D 105/28 (2024.01); G05D 107/70 (2024.01); G06N 7/00 (2023.01)
CPC G05D 1/69 (2024.01) [G06N 3/049 (2013.01); G06N 7/01 (2023.01); G06N 10/00 (2019.01); G06T 15/20 (2013.01); G05B 2219/39001 (2013.01); G05D 2105/28 (2024.01); G05D 2107/70 (2024.01); G06N 7/00 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A virtual facility robotics system comprising:
a storage system storing data collected from a real facility, the data including video of the real facility;
a data engine configured to train a neural rendering model of the real facility based on the data, the neural rendering model providing a photorealistic three-dimensional representation of the real facility;
an integration system providing one or more interfaces facilitating communication with one or more control systems associated with the real facility, the one or more control systems including a robot fleet manager configured to control one or more robots operating within the real facility;
a virtual facility interface system providing access to information stored in a virtual facility that includes the photorealistic three-dimensional representation of the real facility, wherein the virtual facility interface system is configured to provide information to the robot fleet manager via the integration system upon request; and
a simulator engine configured to simulate a future state of the real facility based on the virtual facility, the future state of the real facility including one or more novel views generated based on the neural rendering model.