US 12,293,134 B2
Voice assisted remote screen sharing
Hao Wu, Nanjing (CN); Taodong Lu, Nanjing (CN); and Yu Xin, Nanjing (CN)
Filed by Citrix Systems, Inc., Fort Lauderdale, FL (US)
Filed on Nov. 24, 2021, as Appl. No. 17/534,603.
Application 17/534,603 is a continuation of application No. PCT/CN2021/125229, filed on Oct. 21, 2021.
Prior Publication US 2023/0126163 A1, Apr. 27, 2023
Int. Cl. G10L 15/26 (2006.01); G06F 3/14 (2006.01); G06F 3/16 (2006.01); G10L 15/22 (2006.01)
CPC G06F 3/167 (2013.01) [G06F 3/1423 (2013.01); G10L 15/22 (2013.01); G10L 15/26 (2013.01); G10L 2015/223 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method comprising:
receiving, by a client device, speech of a user during a screen sharing session;
transcribing, by the client device, the speech into text;
enumerating a plurality of applications visible within the screen sharing session;
analyzing, by the client device, the text to identify one or more UI elements referenced within the speech, the one or more UI elements visible within the screen sharing session; and
highlighting the one or more UI elements visible on the client device,
wherein the analyzing includes searching one or more of the plurality of applications for the one or more UI elements referenced within the speech.