US 11,714,493 B2
Electromagnetically tracked three-dimensional air mouse
Sherk Chung, Piedmont, CA (US); Ian Atkinson, Castro Valley, CA (US); Murphy Stein, San Jose, CA (US); Advait Jain, Santa Clara, CA (US); Saket Patkar, Mountain View, CA (US); Lucine Oganesian, Redwood City, CA (US); Xiaomi Mao, Sunnyvale, CA (US); Tri Pho, San Bruno, CA (US); Joe Ethier, San Jose, CA (US); and Jacob Sharf, Palo Alto, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Appl. No. 17/250,879
Filed by GOOGLE LLC, Mountain View, CA (US)
PCT Filed Apr. 12, 2019, PCT No. PCT/US2019/027232
§ 371(c)(1), (2) Date Mar. 18, 2021,
PCT Pub. No. WO2020/209864, PCT Pub. Date Oct. 15, 2020.
Prior Publication US 2021/0349541 A1, Nov. 11, 2021
Int. Cl. G06F 3/01 (2006.01); H04B 17/318 (2015.01); G06F 30/12 (2020.01); G06F 3/0346 (2013.01); G06F 3/0354 (2013.01); G06F 3/038 (2013.01); G06F 3/16 (2006.01)
CPC G06F 3/017 (2013.01) [G06F 3/0346 (2013.01); G06F 3/0383 (2013.01); G06F 3/03541 (2013.01); G06F 3/03543 (2013.01); G06F 3/167 (2013.01); G06F 30/12 (2020.01); H04B 17/318 (2015.01)] 21 Claims
OG exemplary drawing
 
1. A handheld electronic device for controlling three-dimensional content displayed in a user interface of a computing device, the handheld electronic device including:
an electromagnetic sensing system for detecting, for the handheld electronic device, a pose of the handheld electronic device in three-dimensional space;
an inertial measurement unit sensor for detecting, for the handheld electronic device, an orientation in three-dimensional space of the handheld electronic device in three-dimensional space;
at least one processor coupled to memory, the at least one processor configured to generate commands to manipulate the three-dimensional content in the computing device, the commands being generated based on a determined proximity of the handheld electronic device relative to a receiver module associated with the computing device, the determined proximity triggering selection of data for use in generation of the commands, the data including:
the pose of the electromagnetic sensing system when the determined proximity indicates that the handheld electronic device is within range of the receiver module, pose being indicative of orientation and position, and
only the orientation of the inertial measurement unit sensor when the determined proximity indicates that the handheld electronic device is out of range of the receiver module; and
at least one communication module to trigger transmission of the commands to manipulate the three-dimensional content displayed in the computing device based on detected changes in pose of the handheld electronic device.