US 11,995,580 B2
Data processing device and data processing method
Kenta Kawamoto, Tokyo (JP); Masahiro Fujita, Saitama (JP); and Michael Siegfried Spranger, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/287,031
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Oct. 24, 2019, PCT No. PCT/JP2019/041606
§ 371(c)(1), (2) Date Apr. 20, 2021,
PCT Pub. No. WO2020/095687, PCT Pub. Date May 14, 2020.
Claims priority of application No. 2018-208192 (JP), filed on Nov. 5, 2018.
Prior Publication US 2021/0379766 A1, Dec. 9, 2021
Int. Cl. G06F 17/00 (2019.01); A23L 5/10 (2016.01); A47J 36/32 (2006.01); B25J 9/16 (2006.01); B25J 11/00 (2006.01); G06Q 10/0631 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/40 (2022.01); G06V 20/52 (2022.01)
CPC G06Q 10/0631 (2013.01) [A23L 5/10 (2016.08); A47J 36/321 (2018.08); B25J 9/1661 (2013.01); B25J 9/1664 (2013.01); B25J 9/1697 (2013.01); B25J 11/0045 (2013.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/41 (2022.01); G06V 20/52 (2022.01); G06V 20/44 (2022.01)] 18 Claims
OG exemplary drawing
 
1. A data processing device comprising:
a command generation unit configured to generate an instruction command for giving an instruction of one or more operations to be executed during a process by a robot provided with at least one arm,
wherein the instruction command is generated on a basis of instruction data including
image data obtained by capturing one or more images of situations during or after a prior execution of the process, and
text data indicating at least one of an object to be utilized in the process by the robot or each operation to be executed during the process by the robot,
wherein the command generation unit generates the instruction command according to a state of an object appearing in the image data set as a goal state,
wherein, when a current state of the object to be utilized in the process by the robot does not satisfy the goal state of the object appearing in the image data, the command generation unit generates the instruction command according to the current state of the object to be utilized in the process by the robot, and
wherein the command generation unit is implemented via at least one processor.