| CPC G06Q 30/0643 (2013.01) [G06T 15/005 (2013.01); G06T 19/006 (2013.01); H04L 67/306 (2013.01)] | 16 Claims |
|
1. A method comprising, at an online system comprising at least one processor and memory:
receiving data collected via one or more sensors and one or more cameras mounted on a cart at a physical space, the received data including a plurality of times at which the cart passed a plurality of physical elements within the physical space, sensor data for determining a speed at which the cart was moving at the physical space during the plurality of times, and images of the plurality of physical elements;
determining, based on the received data, information describing the physical space, the information comprising one or more attributes of the plurality of physical elements within the physical space and an arrangement of the plurality of physical elements within the physical space, the arrangement of the plurality of physical elements including dimensions of the plurality of physical elements within the physical space and distances between the plurality of physical elements within the physical space;
determining, using a machine-learned item availability model, a probability of an availability of an item at the physical space and an error score representing a confidence of the availability, wherein the error score is determined based on the data collected via the one or more sensors and the one or more cameras mounted on the cart at the physical space and an indication about whether a prior probability of the availability was correct;
generating a rendering of the physical space in a virtual reality environment based at least in part on the determined information describing the physical space, the determined probability of availability and the error score, wherein the rendering of the physical space comprises a plurality of virtual reality elements representing a set of the plurality of physical elements, and the plurality of virtual reality elements are arranged based at least in part on the arrangement of the plurality of physical elements;
sending the rendering of the physical space for display at a device associated with a user of the online system;
receiving data corresponding to an interaction by the user via the device with one or more of the plurality of virtual reality elements, the interaction including placing the one or more virtual reality elements into a virtual reality element;
receiving an update to the information describing the physical space;
updating the rendering of the physical space based at least in part on the update to the information describing the physical space; and
sending the updated rendering of the physical space for display to the user of the online system.
|