US 11,783,400 B1
Method, computer program product, and system for displaying augmented reality elements for navigating to a location of an item within a warehouse
Spencer Schack, Seattle, WA (US); Andrew Peters, Tiburon, CA (US); Aditya Godbole, San Francisco, CA (US); Dominic Cocchiarella, Berkeley, CA (US); and Brandon Leonardo, San Carlos, CA (US)
Assigned to Maplebear Inc., San Francisco, CA (US)
Filed by Maplebear Inc., San Francisco, CA (US)
Filed on Jul. 29, 2022, as Appl. No. 17/877,718.
Int. Cl. G06Q 30/0601 (2023.01); G06T 19/00 (2011.01); G06Q 10/087 (2023.01)
CPC G06Q 30/0631 (2013.01) [G06Q 10/087 (2013.01); G06Q 30/0633 (2013.01); G06Q 30/0643 (2013.01); G06T 19/003 (2013.01); G06T 19/006 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, at a wayfinding application executing on a client device, a current location of the client device within a warehouse, wherein the warehouse is associated with a retailer and a plurality of items included among an inventory of the warehouse;
accessing, from a layout database by a route engine, a layout of the warehouse, wherein the layout of the warehouse describes a set of locations within the warehouse associated with each item of the plurality of items;
identifying, by the route engine, a route for navigating from the current location of the client device to one or more locations within the warehouse associated with one or more of the plurality of items based at least in part on the current location of the client device and the layout of the warehouse;
generating, by an interface engine, a set of augmented reality elements comprising a set of instructions for navigating the identified route within the warehouse;
sending, by the interface engine, the set of augmented reality elements to a display area of the client device wherein the sending causes the client device to overlay the augmented reality elements onto portions of the display area of the client device;
detecting, by a detection engine, a location within the warehouse associated with a target item of the plurality of items wherein the detecting comprises detecting physical elements within the display area of the client device;
determining, by the detection engine, whether the target item is at the location within the warehouse associated with the target item based at least in part on an image captured by the client device;
determining, by the detection engine, that the target item is not at the location within the warehouse associated with the target item; and
alerting a user of the client device to a replacement item by:
generating, by the interface engine, an augmented reality element that calls attention to the replacement item, and
sending, by the interface engine, the augmented reality element to the display area of the client device.