Vehicle control device, non-transitory computer-readable storage medium, and vehicle control method

Patent metadata

Field	Value
Publication number	US-2025136102-A1
Application number	US-202519010704-A
Country	US
Kind code	A1
Filing date	Jan 6, 2025
Priority date	Aug 8, 2022
Publication date	May 1, 2025
Grant date	—

Abstract

A vehicle control unit includes: a sensor-signal processing unit that acquires sensor signals from multiple sensors detecting physical quantities related to the surrounding environment of a vehicle and acquires, from at least one camera capturing images of the surrounding of the vehicle, image data indicating the captured images; a human-vision calculating unit that uses a human visual model calculated in advance calculates a visibility repulsive potential affected by vision of a human recognizing the images; and a potential-risk-prediction-model processing unit that uses a potential-risk prediction model for predicting a potential risk from characteristic quantities of the surrounding environment of a target vehicle to calculate a physical repulsive potential caused by the surrounding environment of the target vehicle on the basis of the physical quantities and the images, and calculates an integrated repulsive potential obtained by correcting the physical repulsive potential with the visibility repulsive potential.

First claim

What is claimed is:

1 . A vehicle control device comprising:
processing circuitry to acquire sensor signals from a plurality of sensors detecting a physical quantity related to a surrounding environment of a vehicle; to acquire image data indicating images of surroundings of the vehicle from at least one camera capturing the images; to use a potential-risk prediction model learned in advance to predict a potential risk from a characteristic quantity of the surrounding environment of a target vehicle, to calculate a physical repulsive potential based on the physical quantity and the images, the physical repulsive potential being a repulsive potential caused by the surrounding environment of the vehicle; to use a human visual model calculated in advance, to calculate a visibility repulsive potential, the visibility repulsive potential being a repulsive potential affected by vision of a human recognizing the images; to calculate an integrated repulsive potential obtained by correcting the physical repulsive potential with the visibility repulsive potential; to generate a target path to cause the vehicle to travel from a current position of the vehicle to a target point in accordance with a gradient calculated from the integrated repulsive potential; and to control the vehicle to cause the vehicle to travel along the target path.

2 . The vehicle control device according to claim 1 , wherein the processing circuitry uses a lateral inhibition model mathematically modeling human lateral inhibition, to calculate a psychological repulsive potential affecting an ability of discovering an obstacle by human lateral inhibition as at least a portion of the visibility repulsive potential.

3 . The vehicle control device according to claim 1 , wherein the processing circuitry uses a motion perception model mathematically modeling human motion perception, to calculate a motion-perception repulsive potential affecting an ability of discovering an obstacle by human motion perception as at least a portion of the visibility repulsive potential.

4 . The vehicle control device according to claim 1 , wherein the processing circuitry adds or multiplies the physical repulsive potential to or by the visibility repulsive potential to correct the physical repulsive potential.

5 . The vehicle control device according to claim 2 , wherein the processing circuitry adds or multiplies the physical repulsive potential to or by the visibility repulsive potential to correct the physical repulsive potential.

6 . The vehicle control device according to claim 3 , wherein the processing circuitry adds or multiplies the physical repulsive potential to or by the visibility repulsive potential to correct the physical repulsive potential.

7 . A non-transitory computer-readable storage medium storing a program that causes a computer to execute processing comprising:
acquiring sensor signals from a plurality of sensors detecting a physical quantity related to a surrounding environment of a vehicle; acquiring image data indicating images of surroundings of the vehicle from at least one camera capturing the images; using a potential-risk prediction model learned in advance to predict a potential risk from a characteristic quantity of the surrounding environment of a target vehicle, to calculate a physical repulsive potential based on the physical quantity and the images, the physical repulsive potential being a repulsive potential caused by the surrounding environment of the vehicle; using a human visual model calculated in advance, to calculate a visibility repulsive potential, the visibility repulsive potential being a repulsive potential affected by vision of a human recognizing the images; calculating an integrated repulsive potential obtained by correcting the physical repulsive potential with the visibility repulsive potential; generating a target path to cause the vehicle to travel from a current position of the vehicle to a target point in accordance with a gradient calculated from the integrated repulsive potential; and controlling the vehicle to cause the vehicle to travel along the target path.

8 . A vehicle control method comprising:
acquiring sensor signals from a plurality of sensors detecting a physical quantity related to a surrounding environment of a vehicle; acquiring image data indicating images of surroundings of the vehicle from at least one camera capturing the images; using a potential-risk prediction model learned in advance to predict a potential risk from a characteristic quantity of the surrounding environment of a target vehicle, to calculate a physical repulsive potential based on the physical quantity and the images, the physical repulsive potential being a repulsive potential caused by the surrounding environment of the vehicle; using a human visual model calculated in advance, to calculate a visibility repulsive potential, the visibility repulsive potential being a repulsive potential affected by vision of a human recognizing the images; calculating an integrated repulsive potential obtained by correcting the physical repulsive potential with the visibility repulsive potential; generating a target path to cause the vehicle to travel from a current position of the vehicle to a target point in accordance with a gradient calculated from the integrated repulsive potential; and controlling the vehicle to cause the vehicle to travel along the target path.

Assignees

• Mitsubishi Electric Corp

Inventors

• Abukawa Masahiro
• Tsushima Naoyuki

Classifications

• B60W30/0956

  the prediction being responsive to traffic or environmental parameters · CPC title

• B60W2050/0029

  Mathematical model of the driver · CPC title

• B60W50/0097

  Predicting future conditions · CPC title

• B60W40/02

  related to ambient conditions · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title