US 12,475,891 B2
Information processing device and information processing method
Yusuke Morita, Kanagawa (JP); and Tomokazu Furuya, Kanagawa (JP)
Assigned to Nissan Motor Co., Ltd., Yokohama (JP)
Appl. No. 18/030,382
Filed by Nissan Motor Co., Ltd., Yokohama (JP)
PCT Filed Oct. 22, 2020, PCT No. PCT/IB2020/000891
§ 371(c)(1), (2) Date Apr. 5, 2023,
PCT Pub. No. WO2022/084708, PCT Pub. Date Apr. 28, 2022.
Prior Publication US 2023/0377578 A1, Nov. 23, 2023
Int. Cl. G10L 15/25 (2013.01); B60K 35/10 (2024.01); B60K 35/60 (2024.01); B60K 35/80 (2024.01); G06F 3/01 (2006.01); G06F 3/04845 (2022.01); G10L 15/22 (2006.01)
CPC G10L 15/25 (2013.01) [B60K 35/10 (2024.01); B60K 35/60 (2024.01); B60K 35/80 (2024.01); G06F 3/013 (2013.01); G06F 3/04845 (2013.01); G10L 15/22 (2013.01); G10L 2015/223 (2013.01)] 14 Claims
OG exemplary drawing
 
1. An information processing device comprising:
a line-of-sight detecting device arranged to receive image data from a camera arranged and configured to capture image data of a user's face, the line-of-sight detecting device being configured to generate line-of-sight data indicating a line-of-sight direction of the user;
a storage device configured to store the line-of-sight data in association with time;
a voice-data-receiving unit configured for inputting voice data from the user; and
a controller,
the controller being configured to
determine whether a target apparatus to be operated can be specified based on the voice data;
refer to time information included in the voice data;
acquire one piece of line-of-sight data among the line-of-sight data, the one piece of line-of-sight data corresponding to a specific time indicated by the time information or a time prior to the specific time;
specify the target apparatus based on the one piece of line-of-sight data upon determining that the target apparatus cannot be specified based on the voice data,
generate a control command directed at the target apparatus based on the voice data, and
control the target apparatus based on the control command.