US 12,216,811 B2
Multiparty object recognition
Bing Song, La Canada, CA (US); John Wiacek, Culver City, CA (US); David McKinnon, Culver City, CA (US); and Matheen Siddiqui, Culver City, CA (US)
Assigned to Nant Holdings IP, LLC, Culver City, CA (US)
Filed by Nant Holdings IP, LLC, Culver City, CA (US)
Filed on Jun. 11, 2020, as Appl. No. 16/899,518.
Application 16/899,518 is a continuation of application No. 14/800,554, filed on Jul. 15, 2015, granted, now 10,719,123.
Claims priority of provisional application 62/024,825, filed on Jul. 15, 2014.
Prior Publication US 2020/0301502 A1, Sep. 24, 2020
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); A63F 13/213 (2014.01); A63F 13/215 (2014.01); A63F 13/65 (2014.01); G06F 3/04815 (2022.01); G06F 3/04845 (2022.01); G06T 19/00 (2011.01); H04L 65/403 (2022.01)
CPC G06F 3/011 (2013.01) [A63F 13/213 (2014.09); A63F 13/215 (2014.09); A63F 13/65 (2014.09); G06F 3/017 (2013.01); G06F 3/04815 (2013.01); G06F 3/04845 (2013.01); G06T 19/00 (2013.01); H04L 65/403 (2013.01); G06T 2219/024 (2013.01)] 27 Claims
OG exemplary drawing
 
1. A multiparty object recognition system for interactively manipulating virtual object data, the system comprising:
a processor;
an object database configured to store first party object data, obtained using a first device associated with a first party, that include first virtual object data and further configured to store second party object data, obtained using a second device associated with a second party, that include second virtual object data, wherein at least one of the first virtual object data and the second virtual object data comprises one or more representations of virtual elements of a virtual object associated with an augmented reality environment, a virtual reality environment, or a mixed reality environment, at least one of the one or more representations of virtual elements of a virtual object being generated based on one or both of recognition of a real-world object within a scene in which the first device is located and recognition of a real-world object within a scene in which the second device is located; and
a memory storing software instructions that, when executed by a processor, cause the processor to operate as a portal engine configured to:
obtain the first party object data and the second party object data for storage within the object database;
control access to the object database such that the first party object data and the second party object data is accessible to at least the first party and the second party;
analyze matching features of the first party object data and the second party object data by using geographic recognition, wherein the analysis of matching features comprises determining a match of geographic features between the scene in which the first device is located and the scene in which the second device is located, and a match of at least one speech feature, geometric feature, or a user-relationship feature;
generate modified first party object data by facilitating modification of at least one structure of the virtual object of the first party object data by the second party based on the analyzed matching features of the first party object data and the second party object data, wherein the modification represents a manipulation of the at least one structure of the virtual object of the first party object data within the augmented reality environment, the virtual reality environment, or the mixed reality environment, the modified first party object data being in accordance with at least one context parameter of the second party object data;
identify the modified first party object data as a recognized object;
retrieve, from the object database, additional object data associated with the recognized object, wherein the additional object data is updatable over time to include increasingly specific recognitions of the recognized object; and
communicate the modified first party object data for presentation to the first party, wherein the communication includes at least portions of the first party object data and second party object data such that, when displayed to the first party, the presentation comprises the at least a portion of first virtual object data and the at least a portion of second virtual object data, wherein the first virtual object data is rendered as being manipulated or otherwise modified by the second virtual object data in accordance with the modified first party object data.