US 11,856,328 B2
Virtual 3D video conference environment generation
Yuval Gronau, Ramat Hasharon (IL); Ran Oz, Maccabim (IL); Omri Kaduri, Los Altos, CA (US); and Osnat Goren-Peyser, Tel Aviv (IL)
Assigned to TRUE MEETING INC., Los Altos, CA (US)
Filed by TRUE MEETING INC., Los Altos, CA (US)
Filed on Nov. 30, 2021, as Appl. No. 17/539,008.
Application 17/539,008 is a continuation of application No. 17/249,468, filed on Mar. 2, 2021.
Claims priority of provisional application 63/201,713, filed on May 10, 2021.
Claims priority of provisional application 63/199,014, filed on Dec. 1, 2020.
Claims priority of provisional application 63/081,860, filed on Sep. 22, 2020.
Claims priority of provisional application 63/023,836, filed on May 12, 2020.
Prior Publication US 2022/0345665 A1, Oct. 27, 2022
Int. Cl. H04N 7/15 (2006.01); G06T 15/04 (2011.01); G06T 15/20 (2011.01); G06T 7/11 (2017.01); G06T 7/70 (2017.01); G06F 3/01 (2006.01); G06N 3/04 (2023.01); G06T 17/20 (2006.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01); H04N 7/14 (2006.01); G06N 3/045 (2023.01)
CPC H04N 7/157 (2013.01) [G06F 3/013 (2013.01); G06N 3/04 (2013.01); G06N 3/045 (2023.01); G06T 7/11 (2017.01); G06T 7/70 (2017.01); G06T 15/04 (2013.01); G06T 15/20 (2013.01); G06T 15/205 (2013.01); G06T 17/20 (2013.01); G06T 19/00 (2013.01); G06T 19/20 (2013.01); H04N 7/144 (2013.01); H04N 7/147 (2013.01); H04N 7/152 (2013.01); G06T 2200/08 (2013.01); G06T 2207/30201 (2013.01); G06T 2219/2004 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A method for virtual 3D video conference environment generation, the method comprises:
determining a first optical axis of a first virtual camera, the first optical axis represents a line of sight of a participant of the 3D video conference while the participant looks at a current displayed version of a virtual 3D video conference environment (V3DVCE); the current displayed version of the V3DVCE is displayed on a display;
determining a second optical axis of a second virtual camera that virtually captures the V3DVCE to provide the current displayed version of the V3DVCE; wherein the determining of the second optical axis of the second virtual camera comprises applying a temporal filter on multiple intermediate determinations of the second optical axis, made during the certain time period; wherein the second optical axis is updated at a slower rate than the first optical axis and is less prone to movements of the participant than the first optical axis; and
generating a next displayed version of the V3DVCE based on at least one of the first optical axis and the second optical axis.