US 12,258,726 B2
Operation support system for construction machine and construction machine
Mengmeng Li, Kanagawa (JP); Masaki Ogawa, Kanagawa (JP); and Ayano Shinato, Kanagawa (JP)
Assigned to SUMITOMO HEAVY INDUSTRIES, LTD., Tokyo (JP)
Filed by SUMITOMO HEAVY INDUSTRIES, LTD., Tokyo (JP)
Filed on Sep. 29, 2020, as Appl. No. 17/036,325.
Application 17/036,325 is a continuation of application No. PCT/JP2019/014344, filed on Mar. 29, 2019.
Claims priority of application No. 2018-070359 (JP), filed on Mar. 30, 2018.
Prior Publication US 2021/0012163 A1, Jan. 14, 2021
Int. Cl. E02F 3/43 (2006.01); E02F 9/20 (2006.01); E02F 9/26 (2006.01); G06F 18/21 (2023.01); G06F 18/214 (2023.01); G06N 20/00 (2019.01); G06V 10/778 (2022.01); G06V 20/13 (2022.01); G06V 20/17 (2022.01); G06V 20/56 (2022.01)
CPC E02F 3/434 (2013.01) [E02F 9/2045 (2013.01); E02F 9/261 (2013.01); G06F 18/2148 (2023.01); G06F 18/2185 (2023.01); G06N 20/00 (2019.01); G06V 10/7788 (2022.01); G06V 20/13 (2022.01); G06V 20/17 (2022.01); G06V 20/56 (2022.01)] 7 Claims
OG exemplary drawing
 
1. An operation support system for a construction machine including an attachment, the operation support system comprising:
a memory that stores a program; and
a processor configured to execute the program stored in the memory to perform a process including
generating multiple operation patterns or multiple arrangement patterns for the construction machine under different environmental conditions with respect to each of a plurality of different types of operations including an operation that moves the attachment, such that each of the operation or arrangement patterns generated with respect to each of the plurality of different types of operations maximizes a rating regarding a predetermined target index under each of the different environmental conditions, said generating including
simulating an operation or an arrangement of the construction machine to generate an operation pattern or an arrangement pattern for the construction machine, and
performing reinforcement learning to generate an operation pattern or an arrangement pattern for the construction machine,
obtaining environmental information of the construction machine,
selecting, based on the generated operation patterns or the generated arrangement patterns, an operation pattern or an arrangement pattern that maximizes the rating regarding the predetermined target index under an environment corresponding to the obtained environmental information with respect to a type of operation specified among the plurality of different types of operations, and
outputting the selected operation pattern or arrangement pattern.