Vehicle lane marking detection system

Patent metadata

Field	Value
Publication number	US-12344244-B2
Application number	US-202217683156-A
Country	US
Kind code	B2
Filing date	Feb 28, 2022
Priority date	Feb 28, 2022
Publication date	Jul 1, 2025
Grant date	Jul 1, 2025

Abstract

A vehicle lane marking detection system includes a 3D sensor, a driver assist component and an electronic controller. The 3D sensor is installed to a vehicle and is configured to scan physical objects around the vehicle outputting a plurality of data points each corresponding to a surface point of a physical feature. Each data point being defined by distance, direction, intensity and vertical location relative to the vehicle. The electronic controller is connected to the 3D sensor and the driver assist component. The electronic controller evaluates a point cloud defined by the data points identifying lane markings based on the intensity of the data points. The data points having intensities greater than a predetermined level are determined to correspond to lane marking and are provided to the driver assist component with the lane markings for use thereby.

First claim

What is claimed is:

1. A vehicle lane marking detection system, comprising:
a vehicle;
at least one 3D sensor mounted to the vehicle and being configured to scan physical objects forward of and along lateral sides of the vehicle outputting a point cloud that includes a plurality of data points while the vehicle is operating, the at least one 3D sensor operating while the vehicle is operating;
at least one driver assist component within the vehicle; and
an electronic controller within the vehicle, the electronic controller being connected to the at least one 3D sensor and the at least one driver assist component, the electronic controller being configured to:
accumulate a plurality of point clouds outputted from the at least one 3D sensor by determining a relative pose estimate of the 3D sensor, each data point of each of the plurality of point clouds corresponding to a surface point of a physical feature, each data point being defined by distance, direction, intensity and vertical location relative to the vehicle, and the relative pose estimate being determined based on at least one of wheel odometry of the vehicle and movement data from a vehicle speed sensor,
evaluate each of the plurality of point clouds identifying ground features forward and along lateral sides of the vehicle,
remove all data points from each of the plurality of point clouds with vertical locations above a predetermined height of ground,
identify data points related to roadway lane markings based on intensity of the data points, evaluating the data points having intensities greater than a predetermined level, further evaluating the data points having intensities greater than the predetermined level to geometric shapes including straight, non-parallel lines and curved lines corresponding to lane marking models identifying lane markings and cross-walk lines and curved road lines while the vehicle is operating, and
provide the at least one driver assist component with the lane markings for use thereby while the vehicle is operating.

2. The vehicle lane marking detection system according to claim 1 , wherein
the at least one 3D sensor is configured to repeatedly scan physical objects forward of and along lateral sides of the vehicle while the vehicle is in motion to produce the corresponding plurality of point clouds.

3. The vehicle lane marking detection system according to claim 1 , wherein
the at least one driver assist component includes at least one of the following components: a navigation unit, a collision avoidance application, a lane departure preventing application and a parking assistant.

4. The vehicle lane marking detection system according to claim 1 , further comprising
an electronic display within the vehicle connected to the electronic controller, the electronic controller providing the electronic display with the digital lane markings for display thereon.

5. The vehicle lane marking detection system according to claim 1 , wherein
the at least one driver assist component includes a navigation unit, and
the electronic controller is configured to align navigation data from the navigation unit with the digital lane markings.

6. The vehicle lane marking detection system according to claim 1 , wherein
the at least one driver assist component includes a collision avoidance application, and
the electronic controller is configured to detect and determine location of obstacles ahead of the vehicle relative to the digital lane markings and provide distance and location of obstacles to the collision avoidance application.

7. The vehicle lane marking detection system according to claim 1 , wherein
the at least one driver assist component includes a lane departure preventing application, and
the electronic controller is configured to assist the lane departure preventing application in determining location of the vehicle relative to the digital lane markings.

8. The vehicle lane marking detection system according to claim 1 , wherein
the at least one driver assist component includes a parking assistant, and
the electronic controller is configured to provide the parking assistant with location and distance to the digital lane markings and extracted data points corresponding to curb-like vertical surfaces proximate the vehicle during a parking maneuver controlled by the parking assistant.

9. The vehicle lane marking detection system according to claim 1 , wherein
the electronic controller is configured to evaluate the data from the 3D sensor and create a point cloud that includes data points representing vertical obstacles and non-vertical obstacles.

10. The vehicle lane marking detection system according to claim 1 , wherein
at least one 3D sensor is a LIDAR device installed on the vehicle proximate a central area of a roof of the vehicle oriented to scan areas forward and along lateral sides of the vehicle.

11. The vehicle lane marking detection system according to claim 10 , wherein
the intensity of each of the data points evaluated by the electronic controller corresponds to an intensity of laser signals from the LIDAR device reflected off surfaces forward of or along lateral sides of the vehicle that are detected by the LIDAR device.

12. The vehicle lane marking detection system according to claim 10 , wherein
the vehicle includes a second LIDAR device positioned on the vehicle to scan areas rearward of the vehicle and scan areas that are along rearward lateral sides of the vehicle.

13. A method for detecting lane markings on a roadway, comprising:
scanning areas forward and along lateral sides of a vehicle using at least one 3D sensor thereby generating data while the vehicle is operating;
pre-processing the data from the at least one 3D sensor to produce a point cloud having a plurality of data points, each data point representing distance, height, intensity and direction of features relative to the vehicle while the vehicle is operating;
accumulating a plurality of point clouds outputted from the at least one 3D sensor by determining a relative pose estimate of the 3D sensor, the relative pose estimate being determined based on at least one of wheel odometry of the vehicle and movement data from a vehicle speed sensor;
evaluating each of the plurality of point clouds identifying ground surfaces around the vehicle eliminating groups of data points above a predetermined height while the vehicle is operating;
evaluating light intensity of each of the plurality of data points of each of the plurality of point clouds and eliminating all data points below a predetermined intensity threshold while the vehicle is operating;
comparing groups of data points to stored geometric patterns identifying lane markings of a road surface that include straight, non-parallel and curved lines corresponding to lane marking models identifying markings including cross-walk lines and curved road lines while the vehicle is in motion; and
providing the location and distance of identified lane markings to at least one driver assist component for driving related actions in accordance with the at least one driver assist component while the vehicle is operating.

14. The method for detecting lane markings on a roadway according to claim 13 , further comprising
repeating the scanning of areas while vehicle is in motion to form the plurality of point clouds.

15. The method for detecting lane markings on a roadway according to claim 13 , wherein
the scanning is performed by a first LIDAR device fixed to the vehicle.

16. The method for detecting lane markings on a roadway according to claim 15 , further com

Assignees

• Nissan North America Inc

Inventors

• Kobashi Atsuhide
• Ostafew Christopher

Classifications

• B60W2420/408

  Radar; Laser, e.g. lidar · CPC title

• G01S7/4868

  Controlling received signal intensity or exposure of sensor · CPC title

• B60W2554/4041

  Position · CPC title

• B60W2552/53

  Road markings, e.g. lane marker or crosswalk · CPC title

• B60W2050/146

  Display means · CPC title