US 12,130,964 B2
Use of eye tracking to adjust region-of-interest (ROI) for compressing images for transmission
Andrew Young, San Mateo, CA (US); and Jeffrey Roger Stafford, Redwood City, CA (US)
Assigned to Sony Interactice Entertainment Inc., Tokyo (JP)
Filed by Sony Interactive Entertainment Inc., Tokyo (JP)
Filed on Dec. 3, 2023, as Appl. No. 18/527,350.
Application 18/527,350 is a continuation of application No. 17/691,656, filed on Mar. 10, 2022, granted, now 11,836,289.
Application 17/691,656 is a continuation of application No. 17/347,173, filed on Jun. 14, 2021, granted, now 11,287,884, issued on Mar. 29, 2022.
Application 17/347,173 is a continuation of application No. 16/897,926, filed on Jun. 10, 2020, granted, now 11,314,325, issued on Apr. 26, 2022.
Application 16/897,926 is a continuation of application No. 16/533,659, filed on Aug. 6, 2019, granted, now 10,684,685, issued on Jun. 16, 2020.
Application 16/533,659 is a continuation of application No. 15/087,471, filed on Mar. 31, 2016, granted, now 10,401,952, issued on Sep. 3, 2019.
Prior Publication US 2024/0103620 A1, Mar. 28, 2024
Int. Cl. G06F 3/01 (2006.01); G02B 27/01 (2006.01); G06F 1/16 (2006.01); G06F 1/3234 (2019.01); G06F 3/03 (2006.01); G06F 3/147 (2006.01); H04N 19/124 (2014.01); H04N 19/167 (2014.01)
CPC G06F 3/013 (2013.01) [G02B 27/017 (2013.01); G06F 1/163 (2013.01); G06F 1/1686 (2013.01); G06F 1/325 (2013.01); G06F 3/011 (2013.01); G06F 3/0304 (2013.01); G06F 3/147 (2013.01); H04N 19/124 (2014.11); H04N 19/167 (2014.11); G02B 2027/014 (2013.01); G02B 2027/0178 (2013.01); G02B 2027/0187 (2013.01); G09G 2310/04 (2013.01); G09G 2340/0428 (2013.01); G09G 2350/00 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
analyzing gaze tracking data representing a user's gaze with respect to one or more images transmitted to a user to determine one or more regions of interest;
determining one or more gaze tracking parameters from the gaze tracking data including determining whether a saccade or blink is occurring or about to occur in the user's vision;
generating adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters; and
adjusting compression of the one or more transmitted images so that fewer bits are needed to transmit data for portions of an image outside the one or more regions of interest than for portions of the image within the one or more regions of interest, wherein adjusting compression of the one or more transmitted images includes eliminating the one or more regions of interest from a subset of the one or more images that are presented to the user during the saccade or blink.