US 12,361,657 B2
Physical object integration with extended reality environments
Donald Gerard Madden, Columbia, MD (US)
Assigned to ObjectVideo Labs, LLC, Tysons, VA (US)
Filed by ObjectVideo Labs, LLC, Tysons, VA (US)
Filed on Sep. 16, 2022, as Appl. No. 17/946,562.
Claims priority of provisional application 63/246,569, filed on Sep. 21, 2021.
Prior Publication US 2023/0092395 A1, Mar. 23, 2023
Int. Cl. G06T 19/20 (2011.01); G06T 19/00 (2011.01)
CPC G06T 19/20 (2013.01) [G06T 19/006 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
maintaining a database of types of extended reality objects and corresponding feature sets compatible for use with extended reality environments;
detecting one or more physical objects, for use with an extended reality environment;
determining, for each of the one or more physical objects and using the database of types of extended reality objects and corresponding feature sets compatible for use with extended reality environments, a corresponding feature set for the corresponding physical object, wherein at least one physical object has a different feature set than another physical object;
determining one or more candidate virtual objects for presentation in the extended reality environment;
determining, for each of the one or more candidate virtual objects, corresponding virtual feature sets;
determining whether a corresponding feature set for a physical object from the one or more physical objects satisfies a similarity criterion for a virtual feature set for a virtual object from the one or more candidate virtual objects;
determining whether to select the virtual object using a result of the determination whether the corresponding feature set for a physical object from the one or more physical objects satisfies the similarity criterion for a virtual feature set for the virtual object from the one or more candidate virtual objects;
selecting one or more virtual objects for presentation in the extended reality environment using the feature sets of the one or more physical objects;
generating, for each of the one or more physical objects and using the corresponding feature set and data for the one or more virtual objects, data for a representation of the physical object for use in the extended reality environment;
providing, to a user device, at least some of the data for the representation of the physical object to cause the user device to present at least a portion of the representation in the extended reality environment;
determining to change a presentation of the representation in the extended reality environment; and
in response to determining to change the presentation of the representation, controlling a physical position of the physical object using the change to the presentation of the representation in the extended reality environment.