US 12,222,512 B2
Displaying content based on state information
Gregory Lutter, Boulder Creek, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jun. 21, 2023, as Appl. No. 18/339,121.
Claims priority of provisional application 63/399,151, filed on Aug. 18, 2022.
Prior Publication US 2024/0061250 A1, Feb. 22, 2024
Int. Cl. G02B 27/01 (2006.01)
CPC G02B 27/0172 (2013.01) [G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0141 (2013.01)] 21 Claims
OG exemplary drawing
 
1. An electronic device comprising:
one or more sensors comprising one or more cameras;
communication circuitry;
one or more processors; and
memory storing instructions configured to be executed by the one or more processors, the instructions for:
capturing, via the one or more cameras, one or more images;
analyzing the one or more images, wherein analyzing the one or more images comprises detecting an external electronic device in the one or more images;
obtaining, via the communication circuitry, state information from the external electronic device; and
in accordance with a determination that the state information does not satisfy a criterion:
capturing, via the one or more cameras, one or more additional images;
estimating state information for the external electronic device based on the one or more additional images; and
presenting content that is based on the estimated state information for the external electronic device.
 
8. A method of operating an electronic device that comprises one or more sensors and communication circuitry, the one or more sensors comprising one or more cameras and the method comprising:
capturing, via the one or more cameras, one or more images;
analyzing the one or more images, wherein analyzing the one or more images comprises detecting an external electronic device in the one or more images;
obtaining, via the communication circuitry, state information from the external electronic device; and
in accordance with a determination that the state information does not satisfy a criterion:
capturing, via the one or more cameras, one or more additional images;
estimating state information for the external electronic device based on the one or more additional images; and
presenting content that is based on the estimated state information for the external electronic device.
 
15. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device that comprises one or more sensors and communication circuitry, the one or more sensors comprising one or more cameras and the one or more programs including instructions for:
capturing, via the one or more cameras, one or more images;
analyzing the one or more images, wherein analyzing the one or more images comprises detecting an external electronic device in the one or more images;
obtaining, via the communication circuitry, state information from the external electronic device; and
in accordance with a determination that the state information does not satisfy a criterion:
capturing, via the one or more cameras, one or more additional images;
estimating state information for the external electronic device based on the one or more additional images; and
presenting content that is based on the estimated state information for the external electronic device.