Methods and Systems for Generating and Using Localization Reference Data

Patent metadata

Field	Value
Publication number	US-2018209796-A1
Application number	US-201615743550-A
Country	US
Kind code	A1
Filing date	Aug 3, 2016
Priority date	Aug 3, 2015
Publication date	Jul 26, 2018
Grant date	—

Abstract

Methods and systems for improved positioning accuracy relative to a digital map are disclosed, and which are preferably used for highly and fully automated driving applications, and which may use localisation reference data associated with a digital map. The invention further extends to methods and systems for the generation of localisation reference data associated with a digital map.

First claim

1 . A method of determining a position of a vehicle relative to a digital map, the digital map comprising data representative of navigable elements of a navigable network along which the vehicle is travelling, the method comprising:
obtaining localisation reference data associated with the digital map for a deemed current position of the vehicle along a navigable element of the navigable network, wherein the location reference data comprises at least one depth map indicative of an environment around the vehicle projected on to a reference plane, the reference plane being defined by a reference line associated with the navigable element, each pixel of the at least one depth map being associated with a position in the reference plane associated with the navigable element along which the vehicle is travelling, and the pixel including a depth channel representing the distance to a surface of an object in the environment along a predetermined direction from the associated position of the pixel in the reference plane; determining real time scan data by scanning the environment around the vehicle using at least one sensor, wherein the real time scan data comprises at least one depth map indicative of an environment around the vehicle, each pixel of the at least one depth map being associated with a position in the reference plane associated with the navigable element, and the pixel including a depth channel representing the distance to a surface of an object in the environment along the predetermined direction from the associated position of the pixel in the reference plane as determined using the at least one sensor; determining a function indicative of a variation in a lateral alignment offset between corresponding pixels of the localisation reference and real time sensor data depth maps with respect to longitudinal position of the pixels along the depth maps; and using the determined function to adjust the deemed current heading of the vehicle to determine the heading of the vehicle relative to the digital map.

2 . The method as claimed in claim 1 , wherein the lateral alignment offset between corresponding pixels is based on the difference in the values indicated by the depth channel data of the pixels.

3 . The method as claimed in claim 1 , wherein the step of determining the function indicative of the variation in lateral alignment offset with longitudinal position comprises determining an average lateral alignment offset of corresponding pixels of the depth maps in each of a plurality of vertical sections through the depth maps along the longitudinal direction of the depth maps.

4 . The method as claimed in claim 3 , wherein the function is obtained based upon the variation in the average lateral alignment offset determined for each vertical section along the longitudinal direction of the depth maps.

5 . The method as claimed in claim 1 , further comprising determining a longitudinal alignment offset between the depth maps of the localisation reference data and the real time scan data by calculating a correlation between the localisation reference data and the real time scan data.

6 . The method as claimed in claim 5 , further comprising using the determined longitudinal alignment offset to adjust the deemed current position to determine the position of the vehicle relative to the digital map.

7 . The method as claimed in claim 1 , further comprising determining a lateral alignment offset between the depth maps, wherein the lateral offset is based on a most common lateral offset between corresponding pixels of the depth maps.

8 . The method as claimed in claim 7 , further comprising using the determined lateral alignment offset to adjust the deemed current position to determine the position of the vehicle relative to the digital map.

9 . The method as claimed in claim 1 , further comprising shifting the depth maps relative to one another to longitudinally align the depth maps.

10 . The method as claimed in claim 1 , wherein:
(i) a longitudinal alignment offset between the depth maps of the localisation reference data and the real time scan data is determined; (ii) then the determined longitudinal offset is used to adjust the deemed current position to determine an adjusted current position of the vehicle relative to the digital map; (iii) then the at least one depth map of the localisation reference data is recomputed based on the adjusted current position; (iv) then a lateral alignment offset between the recomputed depth map of the localisation reference data and the depth map of the real time scan data is determined; (v) then the determined longitudinal offset is used to further adjust the adjusted current position to determine a further adjusted current position of the vehicle relative to the digital map; (vi) then the at least one depth map of the localisation reference data is recomputed based on the further adjusted current position; (vii) then a function indicative of a variation in a lateral alignment offset between corresponding pixels of the recomputed localisation reference depth map and the real time scan data depth map with respect to longitudinal position of the pixels along the depth maps is determined; (viii) then the determined function is used to adjust the deemed current heading of the vehicle to determine the heading of the vehicle relative to the digital map; and (ix) then the at least one depth map of the localisation reference data is recomputed based on the adjusted current heading.

11 . The method as claimed in claim 10 , wherein steps (i)-(ix) are repeated until there is substantially zero longitudinal alignment offset and/or substantially zero lateral alignment offset and/or substantially zero heading offset between the recomputed depth map of the localisation reference data and the depth map of the real time scan data.

12 . A non-transitory computer readable medium comprising computer readable instructions executable to cause a system to perform a method as claimed in claim 1 .

13 . A system for determining a position of a vehicle relative to a digital map, the digital map comprising data representative of navigable elements of a navigable network along which the vehicle is travelling, the system comprising processing circuitry configured to:
obtain localisation reference data associated with the digital map for a deemed current position of the vehicle along a navigable element of the navigable network, wherein the location reference data comprises at least one depth map indicative of an environment around the vehicle projected on to a reference plane, the reference plane being defined by a reference line associated with the navigable element, each pixel of the at least one depth map being associated with a position in the reference plane associated with the navigable element along which the vehicle is travelling, and the pixel including a depth channel representing the distance to a surface of an object in the environment along a predetermined direction from the associated position of the pixel in the reference plane; determine real time scan data by scanning the environment around the vehicle using at least one sensor, wherein the real time scan data comprises at least one depth map indicative of an environment around the vehicle, each pixel of the at least one depth map being associated with a position in the reference plane associated with the navigable element, and the pixel including a depth channel representing the distance to a surface of an object in the environment along the predetermined direction from the associated position of the pixel in the reference plane as determined using the at least one sensor; de

Assignees

• Tomtom Global Content Bv

Inventors

• Kudrynski Krzysztof
• Miksa Krzysztof
• Gliszczynski Rafal Jan
• Kubiak Blazej

Classifications

• G01S13/89

  for mapping or imaging · CPC title

• G01S13/867

  Combination of radar systems with cameras · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G01C21/28

  with correlation of data from several navigational instruments · CPC title

• G06T2207/30248

  Vehicle exterior or interior · CPC title