US 12,309,452 B2
Detection of mute and compensation therefor during media replacement event
Markus K. Cremer, Orinda, CA (US); and Shashank Merchant, Sunnyvale, CA (US)
Assigned to Roku, Inc., San Jose, CA (US)
Filed by Roku, Inc., San Jose, CA (US)
Filed on Dec. 28, 2021, as Appl. No. 17/563,713.
Application 17/563,713 is a continuation of application No. 16/433,530, filed on Jun. 6, 2019, granted, now 11,245,958.
Claims priority of provisional application 62/768,587, filed on Nov. 16, 2018.
Prior Publication US 2022/0124404 A1, Apr. 21, 2022
Int. Cl. H04N 21/439 (2011.01); H04N 21/44 (2011.01); H04N 21/442 (2011.01); H04N 21/462 (2011.01); H04N 21/81 (2011.01); G06Q 30/0251 (2023.01)
CPC H04N 21/44016 (2013.01) [H04N 21/4396 (2013.01); H04N 21/442 (2013.01); H04N 21/4622 (2013.01); H04N 21/812 (2013.01); G06Q 30/0251 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method comprising:
presenting, by a playback device, media content that is provided to the playback device by a media device, wherein the media device receives the media content from a content source;
encountering, by the playback device, a trigger to replace a replaceable content segment of the media content with a replacement content segment;
detecting, by the playback device, within an audio signal associated with the media content, a transition from an unmuted state to a muted state;
based on detecting the transition from the unmuted state to the muted state, determining, by the playback device, that the media device is providing the media content to the playback device in the muted state;
based on determining that the media device is providing the media content to the playback device in the muted state, determining, by the playback device, whether audio of the media content is being rendered for playback on a separate audio device, wherein the separate audio device is different from the media device and the playback device;
responsive to determining that the audio of the media content is being rendered for playback on the separate audio device, receiving an instruction to prevent presenting the replacement content segment by the playback device;
responsive to encountering the trigger, and based on the determining that the audio of the media content is not being rendered for playback on the separate audio device, presenting, by the playback device, the replacement content segment in the muted state and in place of the replaceable content segment; and
identifying, by a classifier that is trained using a trained data set that comprises an audio signal including a training mute operation and a second audio signal that does not include a mute operation, a transition from an unmuted state to a muted state in the audio signal associated with the media content, wherein the classifier is configured to distinguish the transition from the unmuted state to the muted state from a transition from noise to silence.