US 11,995,776 B2
Extended reality interaction in synchronous virtual spaces using heterogeneous devices
Edgar Charles Evangelista, San Jose, CA (US); Aaron Faucher, San Mateo, CA (US); Jaehyun Kim, San Francisco, CA (US); and Andrew R McHugh, San Jose, CA (US)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Gyeonggi-Do (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Gyeonggi-Do (KR)
Filed on Jun. 25, 2021, as Appl. No. 17/359,300.
Claims priority of provisional application 63/139,175, filed on Jan. 19, 2021.
Prior Publication US 2022/0230399 A1, Jul. 21, 2022
Int. Cl. G06T 19/00 (2011.01); G06F 3/01 (2006.01); G06T 15/20 (2011.01); G06T 17/20 (2006.01); G06V 20/40 (2022.01)
CPC G06T 19/006 (2013.01) [G06F 3/017 (2013.01); G06T 15/20 (2013.01); G06T 17/20 (2013.01); G06V 20/49 (2022.01)] 18 Claims
OG exemplary drawing
 
1. A method, comprising:
capturing, with a first device, video of a first user and conveying the video to a second device, wherein the first device lacks extended reality capabilities and the second device is extended reality capable;
displaying, on the first device, a 3D mesh rendering of an extended reality environment based on a 3D mesh received from the second device for enabling the first device to render the extended reality environment, wherein the extended reality environment is simultaneously displayed on the second device;
receiving, with the first device, video of a second user and pose transforms for compositing the video of the second user in the extended reality environment displayed on the first device, wherein a view perspective of the video of the second user composited in the extended reality environment is based on the pose transforms;
responsive to predefined input to the first device, changing the view perspective of the video of the second user composited in the extended reality environment; and
conveying view perspective data from the first device to the second device as changed for causing a corresponding change in a location of the video of the first user composited in the extended reality environment simultaneously displayed on the second device;
wherein the corresponding change in the location of the video of the first user composited in the extended reality environment simultaneously displayed on the second device comprises a rotation of the first user about the second user.