US 11,756,294 B2
Scene classification
Peter Meier, Los Gatos, CA (US); and Michael J. Rockwell, Palo Alto, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Aug. 9, 2021, as Appl. No. 17/397,747.
Application 17/397,747 is a continuation of application No. 16/370,231, filed on Mar. 29, 2019, granted, now 11,087,136.
Claims priority of provisional application 62/657,570, filed on Apr. 13, 2018.
Prior Publication US 2021/0365686 A1, Nov. 25, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/00 (2022.01); G06V 20/20 (2022.01)
CPC G06V 20/35 (2022.01) [G06V 20/20 (2022.01)] 24 Claims
OG exemplary drawing
 
1. An electronic device, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
presenting one or more virtual objects and a representation of a first entity from a set of one or more entities in a physical environment, wherein a virtual object of the one or more virtual object performs one or more tasks corresponding to the physical environment;
receiving a set of one or more inputs representing a selection of the virtual object of the one or more presented virtual objects; and
in response to receiving the set of one or more inputs representing the selection of the virtual object, performing the one or more tasks corresponding to the physical environment, wherein performing the one or more tasks includes changing a state of a second entity from the set of one or more entities in the physical environment.