Method and device for multi-sensor data fusion for automated and autonomous vehicles

Patent metadata

Field	Value
Publication number	US-12570293-B2
Application number	US-202017439805-A
Country	US
Kind code	B2
Filing date	Feb 19, 2020
Priority date	May 13, 2019
Publication date	Mar 10, 2026
Grant date	Mar 10, 2026

Abstract

A method estimates a course of a roadway in a vicinity of a vehicle based on a state function describing the course of the roadway, wherein the state function includes a clothoid spline. The method includes providing ambient measured data describing the course of the roadway at a current position of the vehicle, where the ambient measured data includes a polynomial function. The method also includes transforming the state function and the ambient measured data into a common coordinate system, and checking the ambient measured data for an error. If no error is detected, then the state function is adapted based on the ambient measured data in the common coordinate system. If an error is detected, then the error is stored.

First claim

The invention claimed is:

1 . A method for estimating a course of a roadway in a vicinity of a vehicle on the basis of a state function describing the course of the roadway, said state function encompassing a clothoid spline, said method comprising:
providing information including at least one polynomial function describing the course of the roadway at a current position of the vehicle, said information-based at least in part on data obtained from at least one of a sensor or a digital map; using a processing unit to perform the operations of, transforming the state function and the information including the at least one polynomial function into a common coordinate system; and checking the information including the at least one polynomial function for an error; wherein if no error is detected, adapting the state function on the basis of the information including the at least one polynomial function in the common coordinate system to generate an adapted state function, and generating an estimate of the course of the roadway at least in part based on the adapted state function, and if an error is detected, storing the error in memory; wherein the vehicle is controlled such that the vehicle follows the estimated course of a roadway and/or avoids obstacles by regulating steering, and acceleration.

2 . The method as claimed in claim 1 , wherein checking the information including the at least one polynomial function for the error comprises ascertaining a deviation between a value ascertained in a prediction step of a Kalman filter and the information including the at least one polynomial function, and subsequently comparing the deviation with a predetermined threshold value.

3 . The method as claimed in claim 2 wherein the processing unit is supported on the vehicle, and the method further comprises sending the stored error to a receiving unit arranged outside the vehicle.

4 . The method as claimed in claim 3 , further comprising using the stored error for at least one of the group consisting of: correcting a roadway marking as represented in the information including the at least one polynomial function; correcting map data; improving a lane-marking recognition function; and improving an autonomous driving function.

5 . A method as claimed in claim 1 , wherein the processing unit is supported on the vehicle, and the method further comprises sending the stored error to a receiving unit arranged outside the vehicle.

6 . The method as claimed in claim 1 , wherein the stored error is utilized for at least one of the group consisting of: correcting a roadway marking represented in the information including the at least one polynomial function; correcting map data; improving a lane-marking recognition function; and improving an autonomous driving function.

7 . A method as claimed in claim 1 , further comprising capturing data with at least one camera supported on the vehicle, wherein the processing unit is supported on the vehicle, and wherein the information including the at least one polynomial function is based at least in part on data captured by at least one camera.

8 . A method as claimed in claim 1 , wherein the information including the at least one polynomial function is provided from the digital map.

9 . The method as claimed in claim 1 , wherein the information including the at least one polynomial function includes first ambient data and second ambient data, and wherein the first ambient data are based in part by data captured by at least one camera supported on the vehicle and the second ambient data are provided from the digital map.

10 . A method as claimed in claim 1 , wherein the common coordinate system includes spatial coordinates.

11 . A method as claimed in claim 1 , wherein adapting the state function includes determining sample points, wherein in the case of several sample points in each instance there is a constant curve length between adjacent sample points.

12 . A method as claimed in claim 1 , wherein the common coordinate system includes curvature values.

13 . A method as claimed in claim 1 , wherein adapting the state function to the information including the at least one polynomial function includes providing for adapting at least one curvature value of the state function to at least one other curvature value of the information including the at least one polynomial function.

14 . A method as claimed in claim 1 , wherein the state function characterizes a course of a roadway marking of a roadway.

15 . A as claimed in claim 14 , further including ascertaining a course of a lane center by transforming the state function.

16 . A method as claimed in claim 1 , further including providing measured validation data and validating the estimate of the course of the roadway based at least in part on the validation data.

17 . A device for estimating a course of a roadway in the vicinity of the vehicle, comprising:
one or more interfaces which have been designed to capture the information including the at least one polynomial function; the processing unit, wherein the processing unit is configured to execute the method as claimed in claim 1 .

18 . A vehicle including the device as claimed in claim 17 .

19 . The vehicle of claim 18 , further comprising a camera, and wherein:
said information including the at least one polynomial function is based at least in part on data obtained from the camera, and wherein the processing unit is further configured to cause the stored error to be sent a receiving unit arranged outside the vehicle.

Assignees

• Bayerische Motoren Werke Ag

Inventors

• Brown Sean
• Keidel Frank
• Rauch Sebastian
• Born Alexander
• Jansen Axel

Classifications

• G06V10/803

  of input or preprocessed data · CPC title

• G06V10/443

  by matching or filtering · CPC title

• G06V20/588

  Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G01C21/3822

  Road feature data, e.g. slope data · CPC title