US 12,147,614 B2
System and method for remotely controlling extended reality by virtual mouse
Chao-Hsiang Lai, Taoyuan (TW); Cheng-Han Hsieh, Taoyuan (TW); and Tzu-Yin Chang, Taoyuan (TW)
Assigned to HTC Corporation, Taoyuan (TW)
Filed by HTC Corporation, Taoyuan (TW)
Filed on Apr. 10, 2023, as Appl. No. 18/298,359.
Claims priority of provisional application 63/391,322, filed on Jul. 22, 2022.
Prior Publication US 2024/0028137 A1, Jan. 25, 2024
Int. Cl. G06F 3/0346 (2013.01); G06F 3/00 (2006.01); G06F 3/01 (2006.01); G06F 3/0485 (2022.01)
CPC G06F 3/0346 (2013.01) [G06F 3/005 (2013.01); G06F 3/014 (2013.01); G06F 3/0485 (2013.01); G06F 2203/0331 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for remotely controlling extended reality by a virtual mouse, comprising:
a head mounted display, comprising an image capture device; and
a first remote controller for being worn on a hand, wherein the first remote controller communicatively connects to the head mounted display and comprises a first inertial measurement unit, wherein the head mounted display is configured to:
capture an image through the image capture device;
detect the image to obtain first data of the hand in the image and second data of a plane in the image;
enable the virtual mouse according to the first data and the second data;
receive a first signal generated by the first inertial measurement unit;
detect a wave peak and a wave valley of the first signal; and
in response to a first time point of the wave peak being later than a second time point of the wave valley, perform a first scroll operation by the virtual mouse in an extended reality scene.