US 12,327,318 B2
Logged reality (LR) scene generation
Yaron Yashinski, Tel-Aviv (IL); Nimrod Harel, Ramat HaSharon (IL); and Ilan Yashinski, Kiryat-Ono (IL)
Assigned to GameChanger Ltd, Tel-Aviv (IL)
Filed by GameChanger Ltd, Tel-Aviv (IL)
Filed on Aug. 24, 2022, as Appl. No. 17/894,299.
Prior Publication US 2024/0070998 A1, Feb. 29, 2024
Int. Cl. H04N 5/262 (2006.01); G06T 13/80 (2011.01); G06T 19/00 (2011.01); H04N 5/14 (2006.01)
CPC G06T 19/006 (2013.01) [G06T 13/80 (2013.01); H04N 5/144 (2013.01); H04N 5/262 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of generating a live-action scene video stream with enriched scenery settings and background by creating automatically a merged video stream combining live-action and animation, comprising:
using at least one processor for:
receiving a video stream comprising a plurality of frames depicting a live-action scene pre-recorded in a scenery having a first scenery settings and background, in which at least one person participates in an activity, the video stream captured by at least one video camera is associated with an annotated timecode associating a timestamp of at least one of the plurality of frames depicting at least one of a plurality of predefined events relating to the activity with a description of the at least one predefined event;
selecting automatically at least one of a plurality of predefined animation elements according to at least one event attribute of the at least one predefined event, wherein said at least one of a plurality of predefined animation elements comprises a second scenery settings and background;
creating a merged video stream by merging the selected at least one predefined animation element into the at least one frame identified by its timestamp, wherein in said created merged video stream, said first scenery settings and background is replaced by said second scenery settings and background and wherein said second scenery settings and background are adjusted to fit said first scenery settings and background using one or more scene elements deployed in the scene and depicted in the at least one frame; and
outputting an editable digital record of the merged video stream.