US 12,266,170 B2
Computer-generated supplemental content for video
James Patrick Costello, San Jose, CA (US); Rena Yu Chen, Santa Clara, CA (US); and Divya Navaneetha Krishna, Los Gatos, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by APPLE INC., Cupertino, CA (US)
Filed on Feb. 24, 2021, as Appl. No. 17/184,586.
Claims priority of provisional application 63/011,978, filed on Apr. 17, 2020.
Prior Publication US 2021/0326594 A1, Oct. 21, 2021
Int. Cl. G06V 20/20 (2022.01); G06T 19/00 (2011.01); G06V 20/00 (2022.01); G06V 20/40 (2022.01)
CPC G06V 20/20 (2022.01) [G06T 19/006 (2013.01); G06V 20/35 (2022.01); G06V 20/46 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
identifying, using at least one of a camera or a microphone of a first device, scene information for a video content currently playing on a second device at a first location in a physical environment of the first device and the second device based at least in part on one or more features of an image of the video content obtained from the camera or corresponding audio content obtained from the microphone;
generating, with the first device, virtual content based on the scene information;
displaying, with the first device, the generated virtual content overlaid on the physical environment at a second location while the video content is currently playing on the second device at the first location;
identifying, with the first device, a scene change in the video content currently playing on the second device; and
dynamically modifying, by the first device, the generated virtual content based on the identified scene change in the video content.