US 12,293,019 B2
Method, computer program and head-mounted device for triggering an action, method and computer program for a computing device and computing device
Alexandru Serbanati, Stuttgart (DE); Dimitri Torfs, Stuttgart (DE); Francis M. Meyvis, Stuttgart (DE); and Pierre Saelens, Stuttgart (DE)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/618,519
Filed by Sony Group Corporation, Tokyo (JP)
PCT Filed Jun. 17, 2020, PCT No. PCT/EP2020/066693
§ 371(c)(1), (2) Date Dec. 13, 2021,
PCT Pub. No. WO2020/260085, PCT Pub. Date Dec. 30, 2020.
Claims priority of application No. 19183121 (EP), filed on Jun. 28, 2019.
Prior Publication US 2022/0236801 A1, Jul. 28, 2022
Int. Cl. G06F 3/01 (2006.01); G02B 27/01 (2006.01); G06F 3/0481 (2022.01); G06V 20/20 (2022.01)
CPC G06F 3/015 (2013.01) [G02B 27/0172 (2013.01); G06F 3/013 (2013.01); G06F 3/0481 (2013.01); G06V 20/20 (2022.01); G02B 2027/0138 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for triggering an action with relation to a selected object in a field of view of a user, the method comprising:
detecting a pre-defined brain activity pattern of the user using a brain activity sensor of a head-mounted device worn by the user, the pre-defined brain activity pattern expressing a user command to select an object on which a gaze of the user is focused;
upon detection of the pre-defined brain activity pattern, determining a direction of the gaze of the user based on measurement of electromagnetic fields generated by eye muscle contractions and capturing an image of the field of view of the user, the measurement of the electromagnetic fields generated by the eye muscle contractions being compared with reference values for different directions of gaze in order to determine the direction of the gaze of the user; and
providing at least a part of the image to a computing entity, to cause the computing entity to trigger the action with relation to the selected object.