US 11,889,229 B2
Modifying video streams with supplemental content for video conferencing
Christopher M. Garrido, San Jose, CA (US); Eric L. Chien, Santa Clara, CA (US); Austin W. Shyu, San Diego, CA (US); Ming Jin, Saratoga, CA (US); Yan Yang, San Jose, CA (US); Ian J. Baird, San Jose, CA (US); and Joe S. Abuan, Cupertino, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on May 5, 2020, as Appl. No. 16/867,466.
Application 16/867,466 is a continuation of application No. 16/151,244, filed on Oct. 3, 2018, granted, now 10,681,310.
Claims priority of provisional application 62/668,126, filed on May 7, 2018.
Prior Publication US 2020/0267349 A1, Aug. 20, 2020
Int. Cl. H04N 7/15 (2006.01); H04L 51/10 (2022.01); G06F 3/04845 (2022.01); H04M 1/72439 (2021.01); G06V 40/16 (2022.01); H04L 51/043 (2022.01); H04L 51/046 (2022.01)
CPC H04N 7/152 (2013.01) [G06F 3/04845 (2013.01); G06V 40/166 (2022.01); H04L 51/043 (2013.01); H04L 51/046 (2013.01); H04L 51/10 (2013.01); H04M 1/72439 (2021.01)] 25 Claims
OG exemplary drawing
 
1. A method, comprising:
detecting, while a video stream from a camera of a local device is being sent to one or more remote devices during a video conferencing session between the local device and the one or more remote devices, a face in the video stream from the camera of the local device;
receiving, by the local device, a selection of adaptive facial modification content;
adding the selected adaptive facial modification content to the video stream to replace the detected face in the video stream;
detecting changes in the detected face while the detected face in the video stream is replaced by the selected adaptive facial modification content;
adapting the selected adaptive facial modification content to the changes in the detected face;
integrating the video stream with the adaptive facial modification content to form an integrated modified video stream; and
sending the integrated modified video stream to the one or more remote devices during the video conferencing session.