US 11,654,890 B2
Vehicle control data generation method, vehicle controller, vehicle control system, and vehicle learning device
Yosuke Hashimoto, Nagakute (JP); Akihiro Katayama, Toyota (JP); Yuta Oshiro, Nagoya (JP); Kazuki Sugie, Toyota (JP); and Naoya Oka, Nagakute (JP)
Assigned to TOYOTA JIDOSHA KABUSHIKI KAISHA, Toyota (JP)
Filed by TOYOTA JIDOSHA KABUSHIKI KAISHA, Toyota (JP)
Filed on Jan. 26, 2021, as Appl. No. 17/158,066.
Claims priority of application No. JP2020-024221 (JP), filed on Feb. 17, 2020.
Prior Publication US 2021/0253086 A1, Aug. 19, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. B60W 20/40 (2016.01); B60W 20/20 (2016.01); G01C 21/34 (2006.01); G01C 21/00 (2006.01); B60W 30/18 (2012.01)
CPC B60W 20/40 (2013.01) [B60W 20/20 (2013.01); B60W 30/18009 (2013.01); G01C 21/3469 (2013.01); G01C 21/3804 (2020.08)] 7 Claims
OG exemplary drawing
 
1. A vehicle control data generation method, wherein a memory device stores relationship defining data that defines a relationship between a state of a vehicle including a rotating electric machine and an internal combustion engine and an action variable related to operation of an electronic device in the vehicle,
the generation method comprising causing processing circuitry to execute:
an obtaining process that obtains time-series data of a specifying variable specifying whether an electric vehicle mode or a hybrid vehicle mode is being executed, the electric vehicle mode generating a state of the vehicle obtained based on a detection value of a sensor and generating a propelling force of the vehicle through only torque of the rotating electric machine, the hybrid vehicle mode causing torque of the internal combustion engine to contribute to the generation of the propelling force;
an operating process that operates the electronic device by outputting an operation signal based on the action variable;
a reward calculating process that provides, based on the time-series data of the state of the vehicle obtained by the obtaining process, a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard; and
an updating process that updates the relationship defining data by inputting, to a predetermined update map, the time-series data of the state of the vehicle obtained by the obtaining process, a value of the action variable used to operate the electronic device, and the reward corresponding to the operation of the electronic device,
the update map outputs the updated relationship defining data so as to increase an expected return for the reward in a case where the electronic device is operated in accordance with the relationship defining data, and
the reward calculating process includes a changing process that changes a reward provided when the electric vehicle mode is being executed and the characteristic of the vehicle is a predetermined characteristic such that the provided reward differs from a reward provided when the hybrid vehicle mode is being executed the characteristic of the vehicle is the predetermined characteristic.