US 12,089,303 B2
Determining a light effect based on a degree of speech in media content
Tobias Borra, Rijswijk (NL); Dzmitry Viktorovich Aliakseyeu, Eindhoven (NL); and Antonie Leonardus Johannes Kamp, San Francisco, CA (US)
Assigned to SIGNIFY HOLDING B.V., Eindhoven (NL)
Appl. No. 17/299,482
Filed by SIGNIFY HOLDING B.V., Eindhoven (NL)
PCT Filed Jan. 9, 2020, PCT No. PCT/EP2020/050408
§ 371(c)(1), (2) Date Jun. 3, 2021,
PCT Pub. No. WO2020/144265, PCT Pub. Date Jul. 16, 2020.
Claims priority of provisional application 62/790,219, filed on Jan. 9, 2019.
Claims priority of application No. 19153773 (EP), filed on Jan. 25, 2019.
Prior Publication US 2022/0053618 A1, Feb. 17, 2022
Int. Cl. H05B 45/20 (2020.01); H05B 47/12 (2020.01); H05B 47/155 (2020.01); A63J 17/00 (2006.01); G10L 25/48 (2013.01); G10L 25/78 (2013.01)
CPC H05B 45/20 (2020.01) [H05B 47/12 (2020.01); H05B 47/155 (2020.01); A63J 17/00 (2013.01); G10L 25/48 (2013.01); G10L 25/78 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A system for determining one or more light effects to be rendered while media content is being rendered, said one or more light effects being determined based on an analysis of said media content, said system comprising:
at least one input interface;
at least one output interface; and
at least one processor configured to:
use said at least one input interface to obtain media content,
determine one or more light effects to be rendered on one or more light sources while said media content is being rendered, said one or more light effects being determined based on:
an analysis of an audio portion of said media content, and
an analysis of a video portion of said media content, and
use said at least one output interface to control said one or more light sources to render said one or more light effects,
obtain information indicating a degree of speech in said audio portion, said degree of speech being determined based on said analysis of said audio portion by determining an amount of speech in said audio portion and classifying said audio portion as predominantly speech or predominantly non-speech based on said amount of speech, said degree of speech in said audio portion being determined by classifying said audio portion as a class of a plurality of classes, said plurality of classes comprising at least two of: conversation, whispering, screaming, narration, singing, diegetic speech, and non-diegetic speech;
determine an extent to which said audio portion should be used to determine said one or more light effects, said extent being determined based on said determined degree of speech; and
determine a brightness and/or chromaticity of said one or more light effects based on an intensity and/or a loudness of said audio portion in dependence upon the determined extent to which said audio portion should be used to determine said one or more light effects.