US 12,079,903 B1
Real screens in extended reality
Diego Rivas Vetencourt, San Francisco, CA (US); Yilong Yao, San Jose, CA (US); David Kim, Zug (CH); and Steven Soon Leong Toh, Alameda, CA (US)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Jun. 26, 2023, as Appl. No. 18/341,461.
Int. Cl. G06F 3/01 (2006.01); G06T 7/70 (2017.01); G06T 11/00 (2006.01); G06V 20/20 (2022.01); G06V 20/40 (2022.01); G06K 7/14 (2006.01); H04L 67/131 (2022.01)
CPC G06T 11/00 (2013.01) [G06F 3/011 (2013.01); G06F 3/017 (2013.01); G06T 7/70 (2017.01); G06V 20/20 (2022.01); G06V 20/41 (2022.01); G06K 7/1417 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/30196 (2013.01); H04L 67/131 (2022.05)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for displaying a screen in extended reality, the method comprising:
receiving, by a processor, video data of a real-world environment of a user of an extended reality device;
identifying, by the processor, a screen of a separate computing device in the video data;
pairing, by the processor, the extended reality device and the separate computing device;
generating, by the processor, a graphical outline around the screen of the separate computing device;
displaying, by the processor, the screen of the separate computing device and the graphical outline around the screen of the separate computing device on a display of the extended reality device, wherein the displayed screen on the display of the extended reality device has at least one display characteristic different from the screen being displayed on the separate computing device;
detecting, by the processor, a user interaction with the graphical outline around the screen of the separate computing device based on the received video data; and
in response to detecting the user interaction, performing, by the processor, an action associated with the user interaction.