CPC G06F 3/167 (2013.01) [G06F 3/005 (2013.01); G06F 3/011 (2013.01); G06F 3/012 (2013.01); G06F 3/0482 (2013.01); G06V 40/20 (2022.01); G10L 15/25 (2013.01); G06F 2203/0381 (2013.01); G10L 2015/223 (2013.01); H04M 2250/52 (2013.01); H04M 2250/74 (2013.01)] | 15 Claims |
1. A portable terminal device comprising:
a camera that captures images of an operator;
a microphone that captures voice instructions of the operator;
a controller which is programmed to execute a plurality of operations;
a communication interface that transmits and receives data with an external server; and
wherein the controller is further programmed to:
when the images are obtained from the camera and a single voice instruction is obtained from the microphone, perform a face recognition based on the images and thereafter control the communication interface to transmit data of the obtained single voice instruction to the external server, and
when the communication interface receives information from the external server including one or more results identified by the external server based on the transmitted data,
wherein, when the communication interface receives only one result for operation identified in response to the transmitted data by the external server as operation based on the single voice instruction, the controller is further programmed to execute an operation corresponding to the one result,
wherein, when the communication interface receives a plurality of results for operation identified in response to the transmitted data by the external server as operation based on the single voice instruction, the controller is further programmed to:
display a plurality of operation options to be operable by the portable terminal device, the plurality of operation options relating to each of the plurality of results for operation based on the single voice instruction,
capture additional voice instruction for selecting one operation option from the plurality of the operation options corresponding to the single voice instruction to be operable by the portable terminal device during displaying of the plurality of operation options based on the single voice instruction,
determine one operation option from the plurality of the operation options to be operable by the portable terminal device based on the captured voice instruction, and
execute an operation corresponding to the determined one operation option.
|