US 12,489,948 B2
Dynamic conversation-based video feedback system
Steve Mushkin, Beverly, MA (US); and Christopher Simpkins, North Smithfield, RI (US)
Assigned to Lumiere AI LLC, Beverly, MA (US)
Filed by Lumiere AI LLC, Beverly, MA (US)
Filed on Dec. 11, 2024, as Appl. No. 18/976,943.
Claims priority of provisional application 63/608,887, filed on Dec. 12, 2023.
Prior Publication US 2025/0193491 A1, Jun. 12, 2025
Int. Cl. H04N 21/466 (2011.01); H04N 21/472 (2011.01)
CPC H04N 21/4666 (2013.01) [H04N 21/47205 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
providing video output;
receiving first feedback from a viewer of the video output, the first feedback including:
feedback content;
temporal data representing a time within the video output; and
spatial data representing a spatial location within the video output, wherein receiving the spatial data comprises receiving input from the viewer selecting a subset of a currently-rendered frame of the video output;
extracting data based on the selected subset of the currently-rendered frame of the video output, wherein the extracted data relates to at least one element within the video content;
receiving external data that is external to the video output, wherein the external data comprises contextual information related to the video content that is not contained within the video output, wherein the contextual information comprises at least one of character backstory information, historical context information, or information about a book or play on which the video output is based;
generating a feedback prompt, wherein generating the feedback prompt comprises providing at least some of the first feedback, at least some of the extracted data, and at least some of the external data as input to a machine learning model to generate the feedback prompt;
providing the feedback prompt to the viewer of the video output;
receiving second feedback from the viewer of the video output in response to the feedback prompt, the second feedback including:
second feedback content;
second temporal data representing a second time within the video output; and
second spatial data representing a second spatial location within the video output;
generating a second feedback prompt based on the second feedback and the machine learning model, comprising providing the second feedback to the machine learning model to generate the second feedback prompt; and
providing the second feedback prompt to the viewer of the video output;
wherein generating the second feedback prompt comprises providing at least some of the first feedback and at least some of the second feedback as input to the machine learning model to generate the second feedback prompt.