US 12,449,910 B2
Virtual image display system and control method thereof
Su Kang Chou, Taoyuan (TW); and Chih Chien Chen, Taoyuan (TW)
Assigned to HTC Corporation, Taoyuan (TW)
Filed by HTC Corporation, Taoyuan (TW)
Filed on Nov. 13, 2023, as Appl. No. 18/507,097.
Prior Publication US 2025/0155984 A1, May 15, 2025
Int. Cl. G02B 27/01 (2006.01); G06F 3/01 (2006.01)
CPC G06F 3/017 (2013.01) [G02B 27/017 (2013.01)] 11 Claims
OG exemplary drawing
 
1. A virtual image display system, comprising:
a virtual image display device, wherein the virtual image display device is a head-mounted display; and
an accessory worn on a finger of a user and coupled to the virtual image display device, wherein the accessory comprises an inertial sensor configured to measure inertial information of the accessory and an optical input interface configured to present a visual indicator to instruct a user to touch the optical input interface according to a direction of the visual indicator using the finger to generate a valid input command;
wherein the virtual image display device comprising processors is configured to:
receive the inertial information and obtain the positional information of the accessory;
receive image information of the hand of the user by an image capturer;
receive the input command transmitted from the optical input interface;
perform a gesture tracking action of the hand of the user according to the received inertial information and positional information of the accessory, and image information captured from the virtual image display device;
create a virtual pen and a virtual desktop on a display of the virtual image display device according to gesture tracking information; and
decide whether to generate a virtual handwriting by determining a positional relationship between a pen tip of the virtual pen and the virtual desktop;
display the virtual handwriting on the display of the virtual image display device according to the position of the pen tip of the virtual pen when the pen tip is in contact with the virtual desktop; and
display a function menu on the display of the virtual image display device according to the input command received via the optical input interface of the accessory.