Control system for a vehicle

Patent metadata

Field	Value
Publication number	US-11999378-B2
Application number	US-201917278265-A
Country	US
Kind code	B2
Filing date	Jul 15, 2019
Priority date	Sep 20, 2018
Publication date	Jun 4, 2024
Grant date	Jun 4, 2024

Abstract

Embodiments of the present invention relate to a control system for a vehicle, the control system comprising at least one controller and being configured to: obtain image data relating to terrain to be traversed by the vehicle, and for each of a plurality of sub-regions of the image data: determine probability data relating to whether the respective sub-region relates to a path region or a non-path region of the terrain; and determine a cost for the vehicle to traverse a portion of the terrain to which the sub-region relates depending on the probability data meeting one or more path probability criteria indicating that the sub-region relates to the path region, one or more non-path probability criteria indicating that the sub-region relates to the non-path region or neither the path probability criteria nor the non-path probability criteria; and determining a vehicle path in dependence on the determined costs.

First claim

The invention claimed is:

1. A control system for a vehicle, the control system comprising at least one controller and being configured to:
obtain image data relating to terrain to be traversed by the vehicle, and for each of a plurality of sub-regions of the image data:
determine probability data relating to whether the respective sub-region relates to a path region or a non-path region of the terrain; and
determine a cost for the vehicle to traverse a portion of the terrain to which the sub-region relates depending on the probability data meeting one or more path probability criteria indicating that the sub-region relates to the path region, one or more non-path probability criteria indicating that the sub-region relates to the non-path region or neither the path probability criteria nor the non-path probability criteria;

determine a vehicle path in dependence on the determined costs; and
control the vehicle in dependence on the determined vehicle path and/or provide an audio and/or visual output representative of the determined path;
wherein the control system is configured to, for each of the said sub-regions, determine a different cost for the respective sub-region depending on whether the probability data meets one or more path probability criteria, one or more non-path probability criteria or neither the path probability criteria nor the non-path probability criteria, the determined cost being selected from at least a first cost when the probability data meets one or more path probability criteria, a second cost when the probability data meets one or more non-path probability criteria and a third cost when the probability data meets neither the path probability criteria nor the non-path probability criteria.

2. A control system according to claim 1 wherein the at least one controller collectively comprises:
at least one electronic processor having an input for receiving the image data; and
at least one electronic memory device electrically coupled to the at least one electronic processor having instructions stored therein,
wherein the at least one electronic processor is configured to access the at least one memory device and execute the instructions thereon so as to determine the probability data, the cost data and the vehicle path.

3. A control system according to claim 2 wherein the control system is configured to control the vehicle in dependence on the determined vehicle path.

4. A control system according to claim 1 wherein the control system is configured, for each of the said sub-regions, to determine the probability data by: determining, from the image data, image content data relating to the said sub-region; and comparing the image content data to a path model relating to the path region of the terrain.

5. A control system according to claim 4 wherein the path model is dependent on historical image data relating to the terrain.

6. A control system according to claim 5 wherein the path model is based on tyre region image data relating to locations on the terrain of one or more tyres of the vehicle.

7. A control system according to claim 5 wherein the control system is configured to determine the path model in dependence on one or more of the said sub-regions of the said image data relating to location(s) on the terrain of one or more tyres of the vehicle, the control system being configured to determine the one or more sub-regions of the said image data relating to location(s) on the terrain of one or more tyres of the vehicle in dependence on location data indicative of a location of the vehicle at a time after the image data was capture.

8. A control system according to claim 7 wherein the control system is configured to determine the said location data by performing visual odometry or inertial odometry in respect of the vehicle.

9. A control system according to claim 1 wherein the control system is configured to, for each of the said sub-regions, determine the probability data by: determining, from the image data, image content data relating to the said sub-region; and comparing the image content data to a non-path model.

10. A control system according to claim 9 wherein the non-path model is dependent on historical image data relating to the terrain.

11. A control system according to claim 10 wherein the non-path model is based on image data relating to one or more non-path regions of the terrain laterally offset from the vehicle.

12. The control system according to claim 1 wherein the control system is configured to, for each of the said sub-regions: determine the probability data by: determining image content data from the said sub-region; comparing the image content data to a path model to determine path probability data relating to a probability that the sub-region relates to the path region of the terrain; comparing the image content data to a non-path model to determine non-path probability data relating to a probability that the sub-region relates to the non-path region of the terrain; and determining the said probability data based on the said path and non-path probability data.

13. A control system according to claim 1 wherein the control system is configured to:
for each of a plurality of candidate trajectories of the vehicle across the terrain: determine candidate trajectory cost data in dependence on the determined costs for the vehicle to traverse at least some of the sub-regions traversed by the candidate trajectory, the candidate trajectory cost data relating to a cost for the vehicle to traverse at least a portion of the respective candidate trajectory; and determine the vehicle path by selecting a candidate trajectory from the said plurality of candidate trajectories in dependence on the candidate trajectory cost data, and/or
obtain 3D data in respect of the terrain; and, for respective portions of the terrain relating to each of a plurality of the said sub-regions, determine the cost for the vehicle to traverse the respective portion of the terrain to which the respective sub-region relates in dependence on the 3D data.

14. A control system according to claim 1 wherein the control system is configured to determine a cost map for the vehicle in dependence on the determined costs for the vehicle to traverse the sub-regions, wherein the cost map is defined with respect to a global reference.

15. A control system according to claim 14 wherein the cost map has a reference point associated with a globally referenced location and wherein the globally referenced location of the cost map changes in dependence on translation of the vehicle across the terrain, the cost map remaining oriented with respect to the global reference, and wherein the control system is configured to add and/or remove cost data from the cost map in dependence on a change of the globally referenced location.

16. A control system according to claim 14 wherein the cost map is oriented with respect to a global orientation reference.

17. A control system according to claim 14 wherein the at least one controller comprises a controller configured to obtain first data referenced to a first globally referenced location and second data referenced to a second globally referenced location and to determine the cost map in dependence on the first and second data and wherein the controller is configured to: obtain location data relating to each of the first and second data; and determine the cost map in dependence on the location data.

18. A vehicle comprising a control system according to claim 1 .

19. A method of determining a vehicle

Assignees

• Jaguar Land Rover Ltd

Inventors

• King Paul
• Fairgrieve Andrew
• Ravi Bineesh
• Jayaraj Jithin
• Jayaprakash Krishna
• Kotteri Jithesh

Classifications

• B60W60/0011 Primary

  involving control alternatives for a single driving scenario, e.g. planning several paths to avoid obstacles · CPC title

• B60W30/10

  Path keeping {(cruise control for automatically following a preceding vehicle B60W30/165)} · CPC title

• B60W40/06 Primary

  Road conditions · CPC title

• G06V20/588

  Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road · CPC title

• B60W2552/05

  Type of road, e.g. motorways, local streets, paved or unpaved roads · CPC title