Data determining interface for vehicle decision-making

Patent metadata

Field	Value
Publication number	US-12479463-B2
Application number	US-202217977641-A
Country	US
Kind code	B2
Filing date	Oct 31, 2022
Priority date	Oct 31, 2022
Publication date	Nov 25, 2025
Grant date	Nov 25, 2025

Abstract

Decision-making for a vehicle uses a data determining interface between perception and decision-making. The interface receives, from at least two data sources, operational environment data representing objects external to the vehicle while the vehicle is traversing a vehicle transportation network. The operational environment data is modified to determine output data for data types needed to determine a candidate vehicle control action responsive to the distinct vehicle operation scenario identified using the operational environment data. The solution is the same candidate vehicle control action for the same conditions regardless of the data types available from the data sources. That is, even where different data sources are available, consistent output is provided to a decision-making system. Consistent decision-making results whether the vehicle has a high-definition map, a standard-definition map, or no map as a data source, for example.

First claim

What is claimed is:

1 . An apparatus for vehicle decision-making, the apparatus comprising:
a perception system configured to:
produce, while a vehicle is traversing a vehicle transportation network, operational environment data using at least two data sources, wherein the operational environment data includes data associated with objects external to the vehicle; and
identify, using the operational environment data, a distinct vehicle operation scenario;
a decision-making component that comprises a scenario-specific operational control evaluation model of the distinct vehicle operation scenario that, when solved, produces a candidate vehicle control action; and a data determining interface between the perception system and the decision-making component that is configured to:
receive, from the perception system, the operational environment data having operational environment data types;
modify the operational environment data to determine output data for data types needed to solve the scenario-specific operational control evaluation model, wherein:
the operational environment data types comprise first operational environment data types when the at least two data sources comprise first data sources,
the operational environment data types comprise second operational environment data types when the at least two data sources comprise second data sources,
at least one of the second data sources is different from the first data sources,
at least one of the first operational environment data types is different from the second operational environment data types, and
the output data is the same whether the at least two data sources comprise the first data sources or the second data sources; and

transmit the output data to the decision-making component to output the candidate vehicle control action so as to cause the vehicle to perform the candidate vehicle control action for navigating the distinct vehicle operation scenario.

2 . The apparatus of claim 1 , wherein the data types needed to solve the scenario-specific operational control evaluation model comprise a minimum set of data types that are required to solve the scenario-specific operational control evaluation model.

3 . The apparatus of claim 1 , wherein the data types needed to solve the scenario-specific operational control evaluation model comprise a minimum set of data types that are required to produce candidate vehicle control actions consistent with vehicle control actions performed by a driver during the distinct vehicle operation scenario.

4 . The apparatus of claim 1 , wherein to modify the operational environment data comprises to filter out the operational environment data having a data type other than the data types needed to solve the scenario-specific operational control evaluation model.

5 . The apparatus of claim 1 , wherein a missing data type of the data types exists such that none of the operational environment data corresponds to the missing data type, and to modify the operational environment data comprises determining the output data corresponding to the missing data type using at least some of the operational environment data.

6 . The apparatus of claim 1 , wherein a map is excluded and only a global positioning system (GPS) sensor and one or more camera sensors are included in at least one of the first data sources or the second data sources.

7 . The apparatus of claim 1 , wherein light detection and ranging (LiDAR) and a high-definition map are excluded from at least one of the first data sources or the second data sources.

8 . The apparatus of claim 1 , wherein:
the scenario-specific operational control evaluation model is part of a decision-making system that recommends a vehicle control action for the vehicle using the candidate vehicle control action as input.

9 . An apparatus for vehicle decision-making, the apparatus comprising:
a data determining interface configured to: receive, while a vehicle is traversing a vehicle transportation network, operational environment data using at least two data sources, wherein:
the operational environment data includes data associated with objects external to the vehicle and having operational environment data types, and
the objects establish a distinct vehicle operation scenario;
modify the operational environment data to determine output data for data types needed to determine a candidate vehicle control action using a decision-making component, wherein:
the operational environment data types comprise first operational environment data types when the at least two data sources comprise first data sources,
the operational environment data types comprise second operational environment data types when the at least two data sources comprise second data sources,
at least one of the second data sources is different from the first data sources,
at least one of the first operational environment data types is different from the second operational environment data types, and
the output data is the same whether the at least two data sources comprise the first data sources or the second data sources; and
transmit the output data to the decision-making component to output the candidate vehicle control action so as to cause the vehicle to perform a vehicle control action for navigating the distinct vehicle operation scenario within the vehicle transportation network, the vehicle control action selected from any available candidate control action.

10 . The apparatus of claim 9 , wherein to modify the operational environment data comprises to:
filter out the operational environment data having operational environment data types that differ from the data types needed by the decision-making component to determine the candidate vehicle control action.

11 . The apparatus of claim 9 , wherein to modify the operational environment data comprises to:
generate, using at least some of the operational environment data, the output data for a missing data type of the data types needed by the decision-making component to determine the candidate vehicle control action where the operational environment data types do not include the missing data type.

12 . The apparatus of claim 9 , wherein the data determining interface is configured to:
determine whether the operational environment data types match the data types needed to determine the candidate vehicle control action.

13 . The apparatus of claim 9 , wherein:
the distinct vehicle operation scenario comprises an intersection of the vehicle transportation network, the at least two data sources do not include a high-definition map, the data types needed to determine the candidate vehicle control action include a relationship of another vehicle relative to line lane markings, the operational environment data types exclude the relationship of another vehicle relative to line lane markings, and to modify the operational environment data comprises to determine the output data for the relationship of another vehicle relative to line lane markings.

14 . The apparatus of claim 9 , wherein the data types needed to determine the candidate vehicle control action comprise a minimum set of data types that are required to produce candidate vehicle control actions consistent with vehicle control actions performed by a driver during the distinct vehicle operation scenario.

15 . The apparatus of claim 9 , wherein the first data sources comprise a sensor and a high-definition map, and the second data sources comprise the sensor and a standard-definition map.

16 . The apparatus of claim 15 , wherein th

Assignees

• Nissan North America Inc

Inventors

• Bill Clark Luis Lorenzo
• Wray Kyle Hollins
• Ilstrup David
• Witwicki Stefan

Classifications

• B60W2420/408

  Radar; Laser, e.g. lidar · CPC title

• B60W40/02

  related to ambient conditions · CPC title

• B60W2556/40

  High definition maps · CPC title

• B60W60/001 Primary

  Planning or execution of driving tasks · CPC title