Detecting and resolving information contradictions for a vehicle

Patent metadata

Field	Value
Publication number	US-2024166223-A1
Application number	US-202218057461-A
Country	US
Kind code	A1
Filing date	Nov 21, 2022
Priority date	Nov 21, 2022
Publication date	May 23, 2024
Grant date	—

Abstract

A system for resolving information contradictions in information received by a vehicle includes a plurality of vehicle sensors for receiving the information and a controller in electrical communication with the plurality of vehicle sensors. The controller is programmed to receive a first piece of information from a first of the plurality of vehicle sensors and receive a second piece of information from a second of the plurality of vehicle sensors. The controller is further programmed to determine a contradiction status between the first piece of information and the second piece of information. The controller is further programmed to resolve a contradiction between the first piece of information and the second piece of information using a third piece of information from a third of the plurality of vehicle sensors in response to determining that the contradiction status is a contradicting status.

First claim

What is claimed is:

1 . A system for resolving information contradictions in information received by a vehicle, the system comprising:
a plurality of vehicle sensors for receiving the information; a controller in electrical communication with the plurality of vehicle sensors, wherein the controller is programmed to:
receive a first piece of information from a first of the plurality of vehicle sensors and receive a second piece of information from a second of the plurality of vehicle sensors;
determine a contradiction status between the first piece of information and the second piece of information, wherein the contradiction status includes a contradicting status and a non-contradicting status; and
resolve a contradiction between the first piece of information and the second piece of information using a third piece of information from a third of the plurality of vehicle sensors in response to determining that the contradiction status is the contradicting status.

2 . The system of claim 1 , wherein to determine the contradiction status, the controller is further programmed to:
determine the contradiction status between the first piece of information and the second piece of information using at least a contradiction detection algorithm.

3 . The system of claim 2 , wherein the contradiction detection algorithm is a transformer model machine learning algorithm.

4 . The system of claim 1 , wherein the plurality of vehicle sensors includes at least: a microphone for receiving voice commands from an occupant of the vehicle, a camera for capturing images of an environment surrounding the vehicle, and a vehicle communication system for communicating with systems external to the vehicle.

5 . The system of claim 4 , wherein the first, second, and third pieces of information are at least one of: a voice command from the occupant of the vehicle received using the microphone, an image of the environment surrounding the vehicle captured using the camera, and information retrieved from an external system using the vehicle communication system.

6 . The system of claim 4 , wherein to resolve the contradiction between the first piece of information and the second piece of information, the controller is further programmed to:
construct if-then clauses from one of the first piece of information and the second piece of information; retrieve the third piece of information from the third of the plurality of vehicle sensors, wherein the third piece of information includes at least one of: an image of the environment surrounding the vehicle captured using the camera, information about a remote vehicle in the environment surrounding the vehicle retrieved using the vehicle communication system, and information retrieved from an external system using the vehicle communication system; evaluate the if-then clauses using the third piece of information; determine a truth score for each of the first and second pieces of information based on evaluating the if-then clauses using the third piece of information; and resolve the contradiction based on the truth score for each of the first and second pieces of information.

7 . The system of claim 6 , wherein to evaluate the if-then clauses, the controller is further programmed to:
evaluate the if-then clauses using an image of the environment surrounding the vehicle and a visual question answering algorithm.

8 . The system of claim 6 , wherein to evaluate the if-then clauses, the controller is further programmed to:
evaluate the if-then clauses using the information about the remote vehicle, wherein the information about the remote vehicle includes at least one of: a speed and a heading of the remote vehicle.

9 . The system of claim 6 , wherein to evaluate the if-then clauses, the controller is further programmed to:
evaluate the if-then clauses using the information retrieved from the external system, wherein the information retrieved from the external system includes at least one of: map data, driving law data, and vehicle operator manual data.

10 . The system of claim 6 , wherein to resolve the contradiction based on the truth score for each of the first and second pieces of information, the controller is further programmed to:
compare the truth score of the first piece of information to the truth score of the second piece of information; determine the first piece of information to be true in response to determining that the truth score of the first piece of information is greater than the truth score of the second piece of information and that a difference between the truth score of the first piece of information and the truth score of the second piece of information is greater than or equal to a predetermined truth score difference threshold; determine the second piece of information to be true in response to determining that the truth score of the second piece of information is greater than the truth score of the first piece of information and that the difference between the truth score of the first piece of information and the truth score of the second piece of information is greater than or equal to the predetermined truth score difference threshold; and prompt the occupant of the vehicle with the first piece of information and the second piece of information in response to determining that the difference between the truth score of the first piece of information and the truth score of the second piece of information is less than the predetermined truth score difference threshold.

11 . A method for resolving information contradictions for a vehicle, the method comprising:
receiving a first piece of information from a first of a plurality of vehicle sensors and receiving a second piece of information from a second of the plurality of vehicle sensors; determining a contradiction status between the first piece of information and the second piece of information, wherein the contradiction status includes a contradicting status and a non-contradicting status; and resolving a contradiction between the first piece of information and the second piece of information using a third piece of information from a third of the plurality of vehicle sensors in response to determining that the contradiction status is the contradicting status.

12 . The method of claim 11 , wherein determining the contradiction status further comprises:
determining the contradiction status between the first piece of information and the second piece of information using at least a transformer model machine learning algorithm.

13 . The method of claim 11 , wherein resolving the contradiction between the first piece of information and the second piece of information further comprises:
constructing if-then clauses from one of the first piece of information and the second piece of information; retrieving the third piece of information from the third of the plurality of vehicle sensors, wherein the third piece of information includes at least one of: an image of an environment surrounding the vehicle captured using a camera, information about a remote vehicle in the environment surrounding the vehicle retrieved using a vehicle communication system, and information retrieved from an external system using the vehicle communication system; evaluating the if-then clauses using the third piece of information; determining a truth score for each of the first and second pieces of information based on evaluating the if-then clauses using the third piece of information; and resolving the contradiction based on the truth score for each of the first and second pieces of information.

14 . The method of claim 13 , whe

Assignees

• Gm Global Tech Operations Llc

Inventors

• Esna Ashari Esfahani Alireza
• Mudalige Upali P

Classifications

• G01S13/931

  of land vehicles · CPC title

• G01S13/867

  Combination of radar systems with cameras · CPC title

• G06V20/56

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• B60W50/023

  Avoiding failures by using redundant parts · CPC title

• B60W2050/0215

  Sensor drifts or sensor failures · CPC title