US 12,311,256 B2
Using eye-tracking / eye metrics to detect VR eye-strain-levels, then using adaptive rendering to lower levels of eye-strain
Edward Cheung, San Mateo, CA (US)
Assigned to SONY INTERACTIVE ENTERTAINMENT INC., Tokyo (JP)
Filed by Sony Interactive Entertainment Inc., Tokyo (JP)
Filed on Feb. 28, 2023, as Appl. No. 18/175,948.
Prior Publication US 2024/0286026 A1, Aug. 29, 2024
Int. Cl. A63F 13/212 (2014.01); A63F 13/213 (2014.01); A63F 13/67 (2014.01); G06F 3/01 (2006.01)
CPC A63F 13/213 (2014.09) [A63F 13/212 (2014.09); A63F 13/67 (2014.09); G06F 3/012 (2013.01); G06F 3/013 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A method for assisting a user of a head mounted display (HMD) during interaction with a video game, comprising:
monitoring eye strain indicators of the user as the user is interacting with a first portion of game content, the eye strain indicators collected from a plurality of sensors distributed within a physical environment in which the user is operating;
computing eye strain metrics for the user using the eye strain indicators collected from the plurality of sensors as the user is interacting with the first portion of the game content, the eye strain metrics used to determine a level of eye strain experienced by the user as the user is interacting with the first portion;
identifying and examining a second portion of the game content that is predicted to occur after the first portion to determine if the second portion includes one or more rendering attributes that are known to cause eye strain for the user, the second portion identified based on game state of the game content included in the first portion and the interactivity of the user in the first portion;
forwarding an action to the video game, the action including a command to adjust select ones of the one or more rendering attributes of the game content included in the second portion of the video game that are likely to cause the eye strain, the action identified based on the one or more rendering attributes used to present the first portion of the game content and the one or more rendering attributes identified for the game content included in the second portion; and
when the game content of the second portion is detected to be selected for rendering following rendering of the game content of the first portion and in response to receiving the action, executing the command at the video game to dynamically adjust the select ones of the one or more rendering attributes for the game content included in the second portion prior to forwarding the game content of the second portion to the HMD for rendering,
wherein operations of the method are performed by an eye strain detector engine executing on a processor of a computing system.