US 12,231,803 B2
Video conference background cleanup
Shihwei Chang, Sammamish, WA (US); Robert Aaron Klegon, Chicago, IL (US); Cynthia Eshiuan Lee, Austin, TX (US); Nicholas Mueller, Fitchburg, WI (US); and Shane Paul Springer, Manchester, MI (US)
Assigned to Zoom Communications, Inc., San Jose, CA (US)
Filed by Zoom Communications, Inc., San Jose, CA (US)
Filed on Jul. 29, 2022, as Appl. No. 17/877,790.
Prior Publication US 2024/0040073 A1, Feb. 1, 2024
Int. Cl. H04N 5/272 (2006.01); G06T 11/00 (2006.01); G06V 20/40 (2022.01); G06V 40/16 (2022.01); H04L 65/403 (2022.01)
CPC H04N 5/272 (2013.01) [G06T 11/00 (2013.01); G06V 20/41 (2022.01); G06V 40/161 (2022.01); G06T 2200/24 (2013.01); G06V 20/48 (2022.01); H04L 65/403 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving, during a video conference to which a client device is connected, camera-generated visual data for output to at least one remote device participating in the video conference;
identifying, using software-based image processing applied to the camera-generated visual data, foreground imagery representing a participant and background imagery representing content of the camera-generated visual data other than the foreground imagery;
identifying, within the background imagery, an extraneous item for removal, wherein the extraneous item comprises a portion of the background imagery;
determining whether to generate a composite image at the client device or at a server based on capabilities of the client device, wherein the capabilities comprise at least one of processing capabilities, memory capabilities, network access capabilities, software capabilities, and hardware capabilities, wherein the hardware capabilities are related to item recognition technology;
generating the composite image by removing the extraneous item from the camera-generated visual data and predicting, using replacement imagery prediction software, replacement imagery to replace the removed extraneous item; and
transmitting the composite image to the at least one remote device during the video conference.