Vehicle controller, vehicle control system, vehicle learning device, vehicle control method, and memory medium

Patent metadata

Field	Value
Publication number	US-11453375-B2
Application number	US-202017068879-A
Country	US
Kind code	B2
Filing date	Oct 13, 2020
Priority date	Oct 18, 2019
Publication date	Sep 27, 2022
Grant date	Sep 27, 2022

Abstract

A vehicle controller, a vehicle control system, a vehicle learning device, a vehicle control method, and a memory medium are provided. A switching process switches relationship defining data used in an operation process to post-measure data, when a detection process detects that a functional recovery measure has been taken. The switching process includes a process that uses, as the post-measure data, initial data that is the relationship defining data of a state before an update process is executed as the vehicle travels.

First claim

What is claimed is:

1. A vehicle controller, comprising:
a memory configured to store relationship defining data that defines a relationship between a state of a vehicle that includes at least one of an internal combustion engine and a rotating electric machine and an action variable related to an operation of an operated unit of the at least one of the internal combustion engine and the rotating electric machine; and
circuitry configured to execute:
an obtaining process that obtains a detection value of a sensor that detects the state of the vehicle,
an operation process that operates the operated unit of the at least one of the internal combustion engine and the rotating electric machine based on a value of the action variable that is determined by the detection value obtained by the obtaining process and the relationship defining data,
a reward calculating process that provides, based on the detection value obtained by the obtaining process, a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard,
an update process that updates the relationship defining data by inputting, to a predetermined update map, the state of the vehicle based on the detection value obtained by the obtaining process, the value of the action variable used to operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine, and the reward corresponding to the operation of the operated unit of the at least one of the internal combustion engine and the rotating electric machine,
a detection process that detects that a functional recovery measure has been taken for a component in the vehicle that affects the state of the vehicle created by the operation process, and
a switching process that switches the relationship defining data used in the operation process to post-measure data, when the detection process detects that the functional recovery measure has been taken,

the update map outputs the updated relationship defining data so as to increase an expected return of the reward of a case in which the operated unit of the at least one of the internal combustion engine and the rotating electric machine is operated in accordance with the relationship defining data, and
the switching process includes a process that uses, as the post-measure data, initial data that is the relationship defining data of a state before the update process is executed as the vehicle travels.

2. The vehicle controller according to claim 1 , wherein
the circuitry is configured to execute a past data maintaining process that stores, in the memory, the relationship defining data that is updated by the update process until a predetermined condition is met and avoids update by the update process after the predetermined condition is met, apart from the relationship defining data that is updated by the update process, and
the switching process includes a process that selects, as the post-measure data, the initial data or the relationship defining data that is updated in the past data maintaining process through the update process before the predetermined condition is met.

3. The vehicle controller according to claim 1 , wherein
the circuitry is configured to execute, when the detection process detects that the functional recovery measure has been taken:
a post-measure data requesting process that transmits a signal requesting the post-measure data, and
a post-measure data receiving process that receives the post-measure data transmitted as a result of the post-measure data requesting process, and

the switching process includes a process that switches the relationship defining data used in the operation process to the received post-measure data.

4. A vehicle control system, comprising
the vehicle controller according to claim 1 , wherein
the circuitry includes:
a first circuitry mounted on the vehicle, and
a second circuitry that is outside of the vehicle,

the second circuitry is configured to execute at least a post-measure data transmitting process that transmits the post-measure data, when the detection process detects that a functional recovery measure has been taken,
the first circuitry is configured to execute at least the obtaining process, the operation process, and a post-measure data receiving process, and
the post-measure data receiving process receives data transmitted by the post-measure data transmitting process.

5. The vehicle control system according to claim 4 , wherein
the first circuitry is configured to execute the detection process and a post-measure data requesting process, and
the post-measure data requesting process transmits a signal requesting the post-measure data, when the detection process detects that the functional recovery measure has been taken.

6. The vehicle control system according to claim 4 , wherein the update process is executed by the first circuitry.

7. The vehicle control system according to claim 4 , comprising:
a vehicle controller including the first circuitry.

8. The vehicle control system according to claim 4 , comprising:
a vehicle learning device including the second circuitry.

9. A vehicle control method comprising:
using a memory to store relationship defining data that defines a relationship between a state of a vehicle that includes at least one of an internal combustion engine and a rotating electric machine and an action variable related to an operation of an operated unit of the at least one of the internal combustion engine and the rotating electric machine in the vehicle; and
using circuitry to:
obtain a detection value of a sensor that detects the state of the vehicle,
operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine based on a value of the action variable that is determined by the obtained detection value and the relationship defining data,
based on the obtained detection value, provide a greater reward when a characteristic of the vehicle meets a standard than when the characteristic of the vehicle does not meet the standard,
update the relationship defining data by inputting, to a predetermined update map, the state of the vehicle based on the obtained detection value, a value of the action variable used to operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine, and the reward corresponding to the operation of the operated unit of the at least one of the internal combustion engine and the rotating electric machine,
detect that a functional recovery measure has been taken for a component in the vehicle that affects the state of the vehicle created by the operated unit of the at least one of the internal combustion engine and the rotating electric machine, and
switch the relationship defining data used to operate the operated unit of the at least one of the internal combustion engine and the rotating electric machine to post-measure data, when it is detected that the functional recovery measure has been made, wherein

the update map outputs the updated relationship defining data so as to increase an expected return of the reward of a case in which the operated unit of the at least one of the internal combustion engine and the rotating electric machine is operated in accordance with the relationship defining data, and
the switching the relationship defining data includes using, as the post-measure data, initial data that is the relationship defining data of a state before the relationship defining data is updated as the vehicle travels.

10. A non-transitory computer readable medium that stores a program for causing a co

Assignees

• Toyota Motor Co Ltd

Inventors

• Hashimoto Yosuke
• Katayama Akihiro
• Oshiro Yuta
• Sugie Kazuki
• Oka Naoya

Classifications

• B60W50/0098 Primary

  Details of control systems ensuring comfort, safety or stability not otherwise provided for · CPC title

• B60W10/06 Primary

  including control of combustion engines · CPC title

• G06F18/217

  Validation; Performance evaluation; Active pattern learning techniques · CPC title

• G06N20/00

  Machine learning · CPC title

• Y02T10/62

  Hybrid vehicles · CPC title