US 11,861,264 B2
Portable terminal device and information processing system
Motoyuki Suzuki, Ibaraki (JP); and Hideo Nishijima, Ibaraki (JP)
Assigned to Maxell, Ltd., Kyoto (JP)
Filed by Maxell, Ltd., Kyoto (JP)
Filed on Oct. 20, 2022, as Appl. No. 17/969,868.
Application 17/969,868 is a continuation of application No. 16/396,985, filed on Apr. 29, 2019, granted, now 11,487,502.
Application 16/396,985 is a continuation of application No. 14/651,002, granted, now 10,303,433, issued on May 28, 2019, previously published as PCT/JP2013/083815, filed on Dec. 18, 2013.
Claims priority of application No. 2013-000297 (JP), filed on Jan. 7, 2013.
Prior Publication US 2023/0039067 A1, Feb. 9, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/16 (2006.01); G06F 3/00 (2006.01); G10L 15/25 (2013.01); G06F 3/01 (2006.01); G06F 3/0482 (2013.01); G06V 40/20 (2022.01); G10L 15/22 (2006.01)
CPC G06F 3/167 (2013.01) [G06F 3/005 (2013.01); G06F 3/011 (2013.01); G06F 3/012 (2013.01); G06F 3/0482 (2013.01); G06V 40/20 (2022.01); G10L 15/25 (2013.01); G06F 2203/0381 (2013.01); G10L 2015/223 (2013.01); H04M 2250/52 (2013.01); H04M 2250/74 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A portable terminal device comprising:
a camera that captures images of an operator;
a microphone that captures voice instructions of the operator;
a controller which is programmed to execute a plurality of operations;
a communication interface that transmits and receives data with an external server; and
wherein the controller is further programmed to:
when the images are obtained from the camera and a single voice instruction is obtained from the microphone, perform a face recognition based on the images and thereafter control the communication interface to transmit data of the obtained single voice instruction to the external server, and
when the communication interface receives information from the external server including one or more results identified by the external server based on the transmitted data,
wherein, when the communication interface receives only one result for operation identified in response to the transmitted data by the external server as operation based on the single voice instruction, the controller is further programmed to execute an operation corresponding to the one result,
wherein, when the communication interface receives a plurality of results for operation identified in response to the transmitted data by the external server as operation based on the single voice instruction, the controller is further programmed to:
display a plurality of operation options to be operable by the portable terminal device, the plurality of operation options relating to each of the plurality of results for operation based on the single voice instruction,
capture additional voice instruction for selecting one operation option from the plurality of the operation options corresponding to the single voice instruction to be operable by the portable terminal device during displaying of the plurality of operation options based on the single voice instruction,
determine one operation option from the plurality of the operation options to be operable by the portable terminal device based on the captured voice instruction, and
execute an operation corresponding to the determined one operation option.