US 11,694,438 B2
Scalable extended reality video conferencing
Anthony Rowe, Pittsburgh, PA (US); Michael Farb, Pittsburgh, PA (US); Ivan Liang, Pittsburgh, PA (US); Edward Lu, Pittsburgh, PA (US); Nuno Pereira, Pittsburgh, PA (US); and Eric Riebling, Pittsburgh, PA (US)
Assigned to Carnegie Mellon University, Pittsburgh, PA (US)
Filed by Carnegie Mellon University, Pittsburgh, PA (US)
Filed on Mar. 3, 2022, as Appl. No. 17/685,869.
Claims priority of provisional application 63/156,426, filed on Mar. 4, 2021.
Prior Publication US 2022/0286311 A1, Sep. 8, 2022
Int. Cl. G06T 15/10 (2011.01); G06V 20/20 (2022.01); G06T 19/00 (2011.01); H04S 7/00 (2006.01); H04L 12/18 (2006.01); H04L 65/403 (2022.01); H04L 65/60 (2022.01)
CPC G06V 20/20 (2022.01) [G06T 15/10 (2013.01); G06T 19/006 (2013.01); H04L 12/1827 (2013.01); H04L 65/403 (2013.01); H04S 7/303 (2013.01); G06T 2219/024 (2013.01); H04L 65/60 (2013.01); H04S 2400/11 (2013.01); H04S 2400/13 (2013.01)] 16 Claims
OG exemplary drawing
 
13. A computing system of a telepresence management system, the computing system comprising:
memory; and
one or more processors coupled to the memory and configured to:
receive an indication that a first client connection in combination with a set of client connections forms a first conversation cluster within an extended reality telepresence session, wherein the extended reality telepresence session comprises a plurality of client connections hosted by a plurality of servers, wherein the plurality of client connections includes the first client connection and the set of client connections;
generate a first server allocation map, wherein the first server allocation map indicates an assignment of at least one server of the plurality of servers to each client connection of the plurality of client connections, wherein the first server allocation map indicates an assignment of more servers of the plurality of servers to other client connections of the first conversation cluster than the first client connection;
allocate the plurality of client connections to the plurality of servers based on the first server allocation map; and
based on a map transition policy, transition from the first server allocation map to a second server allocation map, wherein based on the transitioning, the plurality of client connections are allocated to the plurality of servers based on the second server allocation map, wherein the second server allocation map indicates an assignment of fewer servers of the plurality of servers to the other client connections of the first conversation cluster than the first server allocation map,
wherein a first server generates an audio stream for a first avatar based on spatial relationships between the first avatar and other avatars in a telepresence environment of the extended reality telepresence session, generates a video stream for the first avatar based on a field-of-view of the first avatar; and communicates the audio stream and video stream to the first client connection, wherein the first client connection is associated with the first avatar.