US 12,346,960 B2
Systems and methods for generating virtual tags for items in a physical environment
Kimberley Tamara Lockett, Richmond, VA (US); Michael Mossoba, Great Falls, VA (US); Jerry Wagner, Chesterfield, VA (US); and Joshua Edwards, Philadelphia, PA (US)
Assigned to Capital One Services, LLC, McLean, VA (US)
Filed by Capital One Services, LLC, McLean, VA (US)
Filed on Nov. 1, 2022, as Appl. No. 18/051,681.
Prior Publication US 2024/0144338 A1, May 2, 2024
Int. Cl. G06Q 30/00 (2023.01); G06F 16/535 (2019.01); G06F 16/587 (2019.01); G06Q 30/0601 (2023.01); G06V 10/70 (2022.01)
CPC G06Q 30/0643 (2013.01) [G06F 16/535 (2019.01); G06F 16/587 (2019.01); G06Q 30/0623 (2013.01); G06Q 30/0631 (2013.01); G06V 10/70 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
receiving an image of a physical environment, the image captured by a computing device and displayed on a user interface of the computing device, the physical environment including a plurality of items each having item attributes;
receiving one or more item filter criteria associated with at least one of the item attributes;
providing the image as input to a trained machine learning model configured to identify the plurality of items that are present in the image, including, for each of the plurality of items, a first subset of the item attributes;
performing a first item filtering to determine, based on the first subset of the item attributes identified for each of the plurality of items, a subset of one or more items from the plurality of items that are at least not inconsistent with the one or more item filter criteria;
for each of the one or more items within the subset:
using the first subset of the item attributes to identify the item from a data store; and
receiving information associated with the item from the data store, the information including a second subset of the item attributes for the item, the second subset of the item attributes including one or more different item attributes from the first subset;
performing a second item filtering to determine that at least one item from the one or more items within the subset matches the one or more item filter criteria based on the first subset and the second subset of the item attributes;
identifying a spatial location of the at least one item in the image, the spatial location including a pixel coordinate of the image corresponding to a predefined point of the at least one item;
generating an icon for the at least one item that is indicative of at least one of the item attributes for the item from the first subset or the second subset; and
generating and providing instructions to the computing device, the instructions including the icon and the spatial location of the at least one item in the image, wherein the computing device executes the instructions to render the icon for display on the user interface in association with the spatial location of the at least one item in the image such that the rendered icon is overlaid on the image at the pixel coordinate of the image.