US 12,308,005 B2
Audio-visual effects system for augmentation of captured performance based on content thereof
David Steinwedel, San Francisco, CA (US); Perry R. Cook, Jacksonville, OR (US); Paul T. Chi, San Jose, CA (US); Wei Zhou, San Francisco, CA (US); Jon Moldover, San Francisco, CA (US); Anton Holmberg, San Francisco, CA (US); and Jingxi Li, San Francisco, CA (US)
Assigned to SMULE, INC., San Francisco, CA (US)
Filed by SMULE, INC., San Francisco, CA (US)
Filed on Oct. 31, 2022, as Appl. No. 18/051,391.
Application 18/051,391 is a continuation of application No. 16/107,351, filed on Aug. 21, 2018, granted, now 11,488,569.
Application 18/051,391 is a continuation of application No. 15/910,646, filed on Mar. 2, 2018, granted, now 10,424,283, issued on Sep. 24, 2019.
Application 16/107,351 is a continuation of application No. 15/173,041, filed on Jun. 3, 2016, granted, now 9,911,403, issued on Mar. 3, 2018.
Application 18/051,391 is a continuation in part of application No. 15/944,537, filed on Apr. 3, 2018, granted, now 11,032,602, issued on Jun. 8, 2021.
Claims priority of provisional application 62/548,122, filed on Aug. 21, 2017.
Claims priority of provisional application 62/170,255, filed on Jun. 3, 2015.
Claims priority of provisional application 62/480,610, filed on Apr. 3, 2017.
Prior Publication US 2023/0335094 A1, Oct. 19, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G10H 1/36 (2006.01); G06T 11/00 (2006.01); G11B 27/02 (2006.01)
CPC G10H 1/368 (2013.01) [G06T 11/00 (2013.01); G10H 1/366 (2013.01); G11B 27/02 (2013.01); G10H 2210/331 (2013.01); G10H 2220/005 (2013.01); G10H 2220/011 (2013.01); G10H 2220/355 (2013.01); G10H 2230/015 (2013.01); G10H 2240/175 (2013.01); G10H 2240/251 (2013.01)] 25 Claims
OG exemplary drawing
 
1. A system including an audiovisual processing pipeline comprising:
a video effects planner that, based on a selected video style recipe, maps computationally extracted audio features corresponding to a machine-readable encoding of an audiovisual performance to particular sets of visual effects; and
a video effects renderer that applies differing visual effects of the particular sets of visual effects to the audiovisual performance encoding in correspondence with differing audio features of the computationally extracted audio features.