Vehicle control data generation method, vehicle controller, vehicle control system, and vehicle learning device

Patent metadata

Field	Value
Publication number	US-11654890-B2
Application number	US-202117158066-A
Country	US
Kind code	B2
Filing date	Jan 26, 2021
Priority date	Feb 17, 2020
Publication date	May 23, 2023
Grant date	May 23, 2023

Abstract

A vehicle control data generation method includes causing processing circuitry to execute an obtaining process that obtains a state of a vehicle and a specifying variable, an operating process that operates an electronic device, a reward calculating process that provides a greater reward when a characteristic of the vehicle meets a standard than when the characteristic does not meet the standard, an updating process that updates relationship defining data. The update map outputs the updated relationship defining data so as to increase an expected return for the reward in a case where the electronic device is operated in accordance with the relationship defining data. The reward calculating process includes a changing process that changes the reward between when the characteristic of the vehicle is a predetermined characteristic in an EV mode and when the characteristic is the predetermined characteristic in a HV mode.

First claim

The invention claimed is:

1. A vehicle control data generation method, wherein a memory device stores relationship defining data that defines a relationship between a state of a vehicle including a rotating electric machine and an internal combustion engine and an action variable related to operation of an electronic device in the vehicle,
the generation method comprising causing processing circuitry to execute:
an obtaining process that obtains time-series data of a specifying variable specifying whether an electric vehicle mode or a hybrid vehicle mode is being executed, the electric vehicle mode generating a state of the vehicle obtained based on a detection value of a sensor and generating a propelling force of the vehicle through only torque of the rotating electric machine, the hybrid vehicle mode causing torque of the internal combustion engine to contribute to the generation of the propelling force;
an operating process that operates the electronic device by outputting an operation signal based on the action variable;
a reward calculating process that provides, based on the time-series data of the state of the vehicle obtained by the obtaining process, a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard; and
an updating process that updates the relationship defining data by inputting, to a predetermined update map, the time-series data of the state of the vehicle obtained by the obtaining process, a value of the action variable used to operate the electronic device, and the reward corresponding to the operation of the electronic device,
the update map outputs the updated relationship defining data so as to increase an expected return for the reward in a case where the electronic device is operated in accordance with the relationship defining data, and
the reward calculating process includes a changing process that changes a reward provided when the electric vehicle mode is being executed and the characteristic of the vehicle is a predetermined characteristic such that the provided reward differs from a reward provided when the hybrid vehicle mode is being executed the characteristic of the vehicle is the predetermined characteristic.

2. The vehicle control data generation method according to claim 1 , wherein
the reward calculating process includes a process that provides a greater reward when an energy use efficiency is high than when the energy use efficiency is low, and
the changing process includes a process that changes the reward such that increasing the energy use efficiency is more advantageous to obtain a great reward in the electric vehicle mode than in the hybrid vehicle mode.

3. The vehicle control data generation method according to claim 1 , further comprising causing the processing circuitry to execute a process that generates control map data, based on the relationship defining data updated by the updating process, by associating the state of the vehicle with the value of the action variable that maximizes the expected return, the control map data using the state of the vehicle as an input and outputting the value of the action variable that maximizes the expected return.

4. A controller for a vehicle including a rotating electric machine and an internal combustion engine, the controller comprising:
a memory device configured to store relationship defining data that defines a relationship between a state of the vehicle and an action variable related to operation of an electronic device in the vehicle; and
processing circuitry, wherein
the processing circuitry is configured to execute:
an obtaining process that obtains time-series data of a specifying variable specifying whether an electric vehicle mode or a hybrid vehicle mode is being executed, the electric vehicle mode generating a state of the vehicle obtained based on a detection value of a sensor and generating a propelling force of the vehicle through only torque of the rotating electric machine, the hybrid vehicle mode causing torque of the internal combustion engine to contribute to the generation of the propelling force;
an operating process that operates the electronic device by outputting an operation signal based on the action variable;
a reward calculating process that provides, based on the time-series data of the state of the vehicle obtained by the obtaining process, a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard; and
an updating process that updates the relationship defining data by inputting, to a predetermined update map, the time-series data of the state of the vehicle obtained by the obtaining process, a value of the action variable used to operate the electronic device, and the reward corresponding to the operation of the electronic device,

the update map outputs the updated relationship defining data so as to increase an expected return for the reward in a case where the electronic device is operated in accordance with the relationship defining data,
the reward calculating process includes a changing process that changes a reward provided when the electric vehicle mode is being executed and the characteristic of the vehicle is a predetermined characteristic such that the provided reward differs from a reward provided when the hybrid vehicle mode is being executed the characteristic of the vehicle is the predetermined characteristic, and
the operating process includes a process that operates, based on the relationship defining data, the electronic device in accordance with the value of the action variable corresponding to the state of vehicle.

5. A control system for a vehicle including a rotating electric machine and an internal combustion engine, the control system comprising:
a memory device configured to store relationship defining data that defines a relationship between a state of the vehicle and an action variable related to operation of an electronic device in the vehicle; and
processing circuitry, wherein the processing circuitry is configured to execute:
an obtaining process that obtains time-series data of a specifying variable specifying whether an electric vehicle mode or a hybrid vehicle mode is being executed, the electric vehicle mode generating a state of the vehicle obtained based on a detection value of a sensor and generating a propelling force of the vehicle through only torque of the rotating electric machine, the hybrid vehicle mode causing torque of the internal combustion engine to contribute to the generation of the propelling force;
an operating process that operates the electronic device by outputting an operation signal based on the action variable;
a reward calculating process that provides, based on the time-series data of the state of the vehicle obtained by the obtaining process, a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard; and
an updating process that updates the relationship defining data by inputting, to a predetermined update map, the time-series data of the state of the vehicle obtained by the obtaining process, a value of the action variable used to operate the electronic device, and the reward corresponding to the operation of the electronic device,

the update map outputs the updated relationship defining data so as to increase an expected return for the reward in a case where the electronic device is operated in accordance with the relationship defining data,
the reward calculating process includes a changing process that changes a reward provided when the electric vehicle mode is being executed and the characteristic of the vehicle is a predetermined characteristic such that the pro

Assignees

• Toyota Motor Co Ltd

Inventors

• Hashimoto Yosuke
• Katayama Akihiro
• Oshiro Yuta
• Sugie Kazuki
• Oka Naoya

Classifications

• F02D2200/1002

  Output torque · CPC title

• B60W2050/0088

  Adaptive recalibration · CPC title

• F02D41/0002

  Controlling intake air · CPC title

• F02D29/02

  peculiar to engines driving vehicles; peculiar to engines driving variable pitch propellers · CPC title

• B60W20/20 Primary

  Control strategies involving selection of hybrid configuration, e.g. selection between series or parallel configuration · CPC title