| CPC G06T 11/00 (2013.01) [G06F 3/04842 (2013.01); G06V 20/42 (2022.01); G06V 20/46 (2022.01); G06T 2200/24 (2013.01); G06V 2201/10 (2022.01)] | 18 Claims |

|
1. A method comprising:
receiving a first video feed comprising a visual appearance of a first viewer captured by a user-facing camera of a first user device;
streaming a live program for presentation on the first user device and on a second user device,
wherein the live program is displayed with the first video feed of the first viewer viewing the live program on the first user device, and
wherein the live program and the first video feed are displayed with a second video feed of a second viewer viewing the live program on the second user device;
receiving program metadata describing events occurring in the live program;
generating an augmented reality overlay relevant to the live program in response to the program metadata describing the events occurring in the live program, the first video feed of the first viewer viewing the live program, and the second video feed of the second viewer viewing the live program; and
displaying the generated augmented reality overlay over the first video feed on the first user device and on the second user device, wherein the augmented reality overlay modifies the visual appearance of the first viewer in the first video feed,
wherein the augmented reality overlay moves at least partially from the visual appearance of the first viewer in the first video feed to a visual appearance of the second viewer in the second video feed in response to a first action by the first viewer in the first video feed,
wherein the augmented reality overlay reacts to a second action by the visual appearance of the second viewer in the second video feed.
|