US 12,141,350 B2
Vergence based gaze matching for mixed-mode immersive telepresence application
Ethan Schur, San Jose, CA (US); Xiaozhong Xu, State College, PA (US); and Shan Liu, San Jose, CA (US)
Assigned to Tencent America LLC, Palo Alto, CA (US)
Filed by Tencent America LLC, Palo Alto, CA (US)
Filed on Jun. 8, 2023, as Appl. No. 18/207,594.
Claims priority of provisional application 63/359,746, filed on Jul. 8, 2022.
Prior Publication US 2024/0012472 A1, Jan. 11, 2024
Int. Cl. G06F 3/01 (2006.01); G06T 7/70 (2017.01)
CPC G06F 3/013 (2013.01) [G06F 3/012 (2013.01); G06T 7/70 (2017.01); G06T 2207/10012 (2013.01); G06T 2207/30201 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method of gaze matching of a first user and a second user conducting an immersive telepresence, comprising:
displaying one or more images of the second user on a display screen for the first user;
determining a position of an object of interest on the display screen for the first user, wherein the object of interest is an eye of the one or more images of the second user;
receiving one or more images of the first user that is taken by a camera;
detecting a first vergence of eyes of the first user;
calculating a mismatch of the first vergence for viewing the object of interest; and
performing a gaze correction of the one or more images of the first user based on the mismatch of the first vergence for viewing the object of interest.