US 11,836,850 B2
Visually augmenting images of three-dimensional containers with virtual elements
Sanjeev Tagra, Haryana (IN); Sachin Soni, New Delhi (IN); Ajay Jain, Ghaziabad (IN); Ryan Rozich, Austin, TX (US); Jonathan Roeder, Round Rock, TX (US); and Prasenjit Mondal, West Bengal (IN)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on Jun. 1, 2021, as Appl. No. 17/336,109.
Application 17/336,109 is a continuation of application No. 16/535,780, filed on Aug. 8, 2019, granted, now 11,055,905.
Prior Publication US 2021/0287425 A1, Sep. 16, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 19/20 (2011.01); G06T 15/50 (2011.01); G06T 7/50 (2017.01); G06T 7/40 (2017.01)
CPC G06T 15/50 (2013.01) [G06T 7/40 (2013.01); G06T 7/50 (2017.01); G06T 19/20 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method in which one or more processing devices performs operations comprising:
receiving a first image that depicts a storage container;
identifying, based on an analysis of one or more shapes detected within the first image, a sub-container within the storage container;
performing a semantics pairing process to:
select, from a virtual object library, a plurality of virtual objects that are semantically related to a type of the sub-container;
determine an arrangement of the plurality of virtual objects within the sub-container, wherein the arrangement comprises the plurality of virtual objects arranged according to semantic categories;
generating a second image that depicts the arrangement of the plurality of virtual objects within the sub-container; and
generating, for display, the second image depicting the storage container and the arrangement of the plurality of virtual objects within the sub-container.