US 12,141,998 B2
Electronic device with gaze-based autofocus of camera during video rendition of scene
Amit Kumar Agrawal, Bangalore (IN); and Rahul Bharat Desai, Hoffman Estates, IL (US)
Assigned to Motorola Mobility LLC, Chicago, IL (US)
Filed by MOTOROLA MOBILITY LLC, Wilmington, DE (US)
Filed on Mar. 17, 2022, as Appl. No. 17/697,156.
Prior Publication US 2023/0298197 A1, Sep. 21, 2023
Int. Cl. G06F 3/01 (2006.01); G06T 7/11 (2017.01); G06T 7/70 (2017.01); G06V 40/16 (2022.01); H04N 23/617 (2023.01); H04N 23/67 (2023.01); H04N 23/69 (2023.01)
CPC G06T 7/70 (2017.01) [G06F 3/013 (2013.01); G06T 7/11 (2017.01); G06V 40/161 (2022.01); G06T 2207/20104 (2013.01); H04N 23/617 (2023.01); H04N 23/675 (2023.01); H04N 23/69 (2023.01)] 20 Claims
OG exemplary drawing
 
1. An electronic device comprising:
a front surface and a rear surface;
a display embedded in the front surface;
at least one front facing camera and at least one rear facing camera;
a memory having stored thereon a camera control module (CCM) for controlling the at least one front facing camera and the at least one rear facing camera; and
at least one processor communicatively coupled to the display, each of the at least one front facing camera, each of the at least one rear facing camera, and to the memory, the at least one processor executing program code of the CCM and configuring the electronic device to:
in response to detecting a video recording session is being record via the at least one rear facing camera, capture, via the at least one front facing camera, a first image stream containing a face of a first user;
determine a first eye gaze direction of the first user based on a first image retrieved from the first image stream, the first eye gaze direction corresponding to a first location on the display where the first user is looking;
map the first location on the display to a first region of interest (ROI) for focusing the at least one rear facing camera;
generate at least one camera setting of the at least one rear facing camera at least partially based on the first ROI, wherein the at least one processor:
receives at least one camera parameter from the at least one rear facing camera;
determines a first zoom level for the first ROI based at least partially on the at least one camera parameter and image characteristics of the first ROI; and
determines a first focal distance for the first ROI based at least partially on the at least one camera parameter and image characteristics of the first ROI; and
adjust the at least one rear facing camera using the generated at least one camera setting comprising the first zoom level and the first focal distance such that the at least one rear facing camera focuses on the first ROI, and the first ROI is in focus on the display.