US 12,190,457 B2
Object counting on AR wearable devices
Piotr Gurgul, Hergiswil (CH); Sharon Moll, Lachen (CH); and Tomasz Zakrzewski, Lachen (CH)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Aug. 23, 2022, as Appl. No. 17/893,738.
Prior Publication US 2024/0070996 A1, Feb. 29, 2024
Int. Cl. G06T 7/73 (2017.01); G06F 3/01 (2006.01); G06T 19/00 (2011.01); G06V 20/52 (2022.01); G06V 20/68 (2022.01)
CPC G06T 19/006 (2013.01) [G06F 3/011 (2013.01); G06T 7/73 (2017.01); G06V 20/53 (2022.01); G06V 20/68 (2022.01); G06T 2200/16 (2013.01); G06T 2200/24 (2013.01); G06T 2207/30242 (2013.01); G06T 2210/12 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method performed on an augmented reality (AR) wearable device comprising:
capturing, by an image capturing device of the AR wearable device, an image corresponding to a first user view of a real-world scene;
sending the image to a backend computer via a wireless communication link;
receiving indications of a plurality of objects within the image, indications of the locations of the plurality of objects, and indications of labels for the plurality of objects;
selecting a group of objects of the plurality of objects based at least on the labels of each object of the group of objects indicating a same label;
counting a number of objects in the group of objects to generate a count for the group of objects;
identifying, by processing the image, an area of the image where additional objects are obscured by the group of objects, wherein the additional objects are excluded from the count of the group of objects; and
displaying, on a display of the AR wearable device, indications that the objects in the group of objects have been counted, an indication that the additional objects are obscured, and an indication of the count, wherein locations of the indications on the display are based on the locations of the objects in the group of objects and a second user view of the real-world scene.