US 12,380,698 B2
Information processing terminal and remote control method
Mayumi Nakade, Kyoto (JP); and Tamotsu Ito, Kyoto (JP)
Assigned to MAXELL, LTD., Kyoto (JP)
Appl. No. 18/011,879
Filed by MAXELL, LTD., Kyoto (JP)
PCT Filed Jul. 8, 2020, PCT No. PCT/JP2020/026710
§ 371(c)(1), (2) Date Dec. 21, 2022,
PCT Pub. No. WO2022/009338, PCT Pub. Date Jan. 13, 2022.
Prior Publication US 2023/0245456 A1, Aug. 3, 2023
Int. Cl. G06V 20/50 (2022.01); G06F 3/01 (2006.01); G06T 11/00 (2006.01); G06V 20/20 (2022.01); G08C 17/02 (2006.01)
CPC G06V 20/50 (2022.01) [G06F 3/011 (2013.01); G06T 11/00 (2013.01); G06V 20/20 (2022.01); G08C 17/02 (2013.01)] 12 Claims
OG exemplary drawing
 
10. An information processing terminal including a communication device, which transmits a control command to a controlled device via the communication device to remotely control the controlled device, the information processing terminal comprising:
a memory storing an analysis table and a control data table;
a camera configured to acquire a surrounding image which is an image around the information processing terminal;
an identification information acquisition processor configured to acquire controlled device identification information for identifying a controlled device and desired control operation identification information for identifying a desired control operation to the controlled device, respectively, from a controlled device description and a desired control operation description written on a presentation surface member included in the surrounding image acquired by the camera, using the analysis table;
a control data acquisition processor configured to acquire control data on the controlled device based on the controlled device identification information acquired by the identification information acquisition processor, using the control data table;
an association processor configured to associate a predetermined control command of a set of control commands for controlling the controlled device included in the control data with the desired control operation identified by the desired control operation identification information;
a virtual remote control generator configured to generate a virtual remote control image including an acceptance object corresponding to the desired control operation identification information;
a display configured to display the virtual remote control image generated by the virtual remote control generator;
an operation acceptor configured to accept an operation instruction from a user of the information processing terminal; and
a command transmitter configured to transmit the predetermined control command, associated with the desired control operation identified by the desired control operation identification information corresponding to the acceptance object, to the controlled device via the communication device when the operation instruction accepted by the operation acceptor is an instruction to the acceptance object included in the virtual remote control image.