US 12,112,519 B1
Scripted interactive scenarios based on scene graph matching
Alexander S. Polichroniadis, San Francisco, CA (US); Angela Blechschmidt, San Jose, CA (US); and Daniel Ulbricht, Sunnyvale, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Feb. 23, 2022, as Appl. No. 17/678,090.
Claims priority of provisional application 63/152,895, filed on Feb. 24, 2021.
Int. Cl. G06V 10/74 (2022.01); G06T 17/00 (2006.01); G06V 10/762 (2022.01); G06V 10/80 (2022.01); G06V 20/70 (2022.01)
CPC G06V 10/761 (2022.01) [G06T 17/00 (2013.01); G06V 10/7635 (2022.01); G06V 10/80 (2022.01); G06V 20/70 (2022.01); G06T 2210/61 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
at an electronic device having a processor:
obtaining sensor data for a physical environment;
generating a local scene graph for the physical environment based on the sensor data, wherein the local scene graph represents a set of objects and relationships between the objects;
identifying a principal scene graph from a set of previously obtained principal scene graphs based on matching characteristics and relationships between the set of objects associated with the local scene graph to one or more characteristics and relationships between a set of objects associated with each principal scene graph; and
executing one or more scripted actions involving the objects based on a narrative associated with the identified principal scene graph.